May 28 09:31:27.410548 ip-10-0-138-49 systemd[1]: Starting Kubernetes Kubelet...
May 28 09:31:27.917656 ip-10-0-138-49 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 09:31:27.917656 ip-10-0-138-49 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 28 09:31:27.917656 ip-10-0-138-49 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 09:31:27.917656 ip-10-0-138-49 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 28 09:31:27.917656 ip-10-0-138-49 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 09:31:27.918352 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.918274    2578 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 28 09:31:27.923130 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923116    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 09:31:27.923130 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923130    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 09:31:27.923193 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923134    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 09:31:27.923193 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923138    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 09:31:27.923193 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923141    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 09:31:27.923193 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923144    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 09:31:27.923193 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923147    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 09:31:27.923193 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923150    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 09:31:27.923193 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923152    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 09:31:27.923193 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923155    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 09:31:27.923193 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923157    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 09:31:27.923193 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923161    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 09:31:27.923193 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923163    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 09:31:27.923193 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923166    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 09:31:27.923193 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923168    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 09:31:27.923193 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923171    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 09:31:27.923193 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923173    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 09:31:27.923193 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923176    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 09:31:27.923193 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923185    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 09:31:27.923193 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923187    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 09:31:27.923193 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923190    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 09:31:27.923193 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923192    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 09:31:27.923691 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923195    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 09:31:27.923691 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923198    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 09:31:27.923691 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923200    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 09:31:27.923691 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923203    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 09:31:27.923691 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923206    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 09:31:27.923691 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923211    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 09:31:27.923691 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923214    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 09:31:27.923691 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923229    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 09:31:27.923691 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923232    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 09:31:27.923691 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923235    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 09:31:27.923691 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923238    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 09:31:27.923691 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923242    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 09:31:27.923691 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923244    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 09:31:27.923691 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923247    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 09:31:27.923691 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923249    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 09:31:27.923691 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923252    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 09:31:27.923691 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923255    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 09:31:27.923691 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923257    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 09:31:27.923691 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923259    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 09:31:27.923691 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923263    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 09:31:27.924274 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923267    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 09:31:27.924274 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923270    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 09:31:27.924274 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923273    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 09:31:27.924274 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923275    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 09:31:27.924274 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923278    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 09:31:27.924274 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923281    2578 feature_gate.go:328] unrecognized feature gate: Example2
May 28 09:31:27.924274 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923283    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 09:31:27.924274 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923286    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 09:31:27.924274 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923288    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 09:31:27.924274 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923290    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 09:31:27.924274 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923293    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 09:31:27.924274 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923295    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 09:31:27.924274 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923298    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 09:31:27.924274 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923301    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 09:31:27.924274 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923304    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 09:31:27.924274 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923306    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 09:31:27.924274 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923309    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 09:31:27.924274 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923311    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 09:31:27.924274 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923314    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 09:31:27.924744 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923316    2578 feature_gate.go:328] unrecognized feature gate: Example
May 28 09:31:27.924744 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923319    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 09:31:27.924744 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923321    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 09:31:27.924744 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923324    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 09:31:27.924744 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923326    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 09:31:27.924744 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923329    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 09:31:27.924744 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923331    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 09:31:27.924744 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923334    2578 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 09:31:27.924744 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923336    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 09:31:27.924744 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923338    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 09:31:27.924744 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923341    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 09:31:27.924744 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923343    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 09:31:27.924744 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923347    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 09:31:27.924744 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923349    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 09:31:27.924744 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923353    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 09:31:27.924744 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923355    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 09:31:27.924744 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923358    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 09:31:27.924744 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923360    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 09:31:27.924744 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923363    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 09:31:27.924744 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923365    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 09:31:27.925241 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923367    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 09:31:27.925241 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923370    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 09:31:27.925241 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923372    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 09:31:27.925241 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923374    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 09:31:27.925241 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923377    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 09:31:27.925241 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923757    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 09:31:27.925241 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923763    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 09:31:27.925241 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923766    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 09:31:27.925241 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923769    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 09:31:27.925241 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923772    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 09:31:27.925241 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923775    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 09:31:27.925241 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923778    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 09:31:27.925241 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923780    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 09:31:27.925241 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923783    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 09:31:27.925241 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923785    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 09:31:27.925241 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923788    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 09:31:27.925241 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923790    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 09:31:27.925241 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923793    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 09:31:27.925241 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923795    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 09:31:27.925241 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923797    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 09:31:27.925715 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923800    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 09:31:27.925715 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923802    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 09:31:27.925715 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923805    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 09:31:27.925715 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923807    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 09:31:27.925715 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923810    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 09:31:27.925715 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923812    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 09:31:27.925715 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923817    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 09:31:27.925715 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923821    2578 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 09:31:27.925715 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923824    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 09:31:27.925715 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923827    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 09:31:27.925715 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923830    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 09:31:27.925715 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923832    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 09:31:27.925715 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923835    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 09:31:27.925715 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923837    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 09:31:27.925715 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923840    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 09:31:27.925715 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923843    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 09:31:27.925715 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923845    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 09:31:27.925715 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923847    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 09:31:27.925715 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923851    2578 feature_gate.go:328] unrecognized feature gate: Example
May 28 09:31:27.926169 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923854    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 09:31:27.926169 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923856    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 09:31:27.926169 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923859    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 09:31:27.926169 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923862    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 09:31:27.926169 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923864    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 09:31:27.926169 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923867    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 09:31:27.926169 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923869    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 09:31:27.926169 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923872    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 09:31:27.926169 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923875    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 09:31:27.926169 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923877    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 09:31:27.926169 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923880    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 09:31:27.926169 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923882    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 09:31:27.926169 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923885    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 09:31:27.926169 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923887    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 09:31:27.926169 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923890    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 09:31:27.926169 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923892    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 09:31:27.926169 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923894    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 09:31:27.926169 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923897    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 09:31:27.926169 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923900    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 09:31:27.926169 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923902    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 09:31:27.926696 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923905    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 09:31:27.926696 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923913    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 09:31:27.926696 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923916    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 09:31:27.926696 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923918    2578 feature_gate.go:328] unrecognized feature gate: Example2
May 28 09:31:27.926696 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923921    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 09:31:27.926696 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923924    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 09:31:27.926696 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923926    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 09:31:27.926696 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923929    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 09:31:27.926696 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923931    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 09:31:27.926696 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923934    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 09:31:27.926696 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923936    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 09:31:27.926696 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923940    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 09:31:27.926696 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923943    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 09:31:27.926696 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923946    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 09:31:27.926696 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923948    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 09:31:27.926696 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923951    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 09:31:27.926696 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923953    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 09:31:27.926696 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923956    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 09:31:27.926696 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923958    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 09:31:27.926696 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923961    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 09:31:27.927179 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923967    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 09:31:27.927179 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923969    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 09:31:27.927179 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923972    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 09:31:27.927179 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923974    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 09:31:27.927179 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923977    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 09:31:27.927179 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923979    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 09:31:27.927179 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923982    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 09:31:27.927179 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923984    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 09:31:27.927179 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923988    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 09:31:27.927179 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923991    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 09:31:27.927179 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923994    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 09:31:27.927179 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.923996    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 09:31:27.927179 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924066    2578 flags.go:64] FLAG: --address="0.0.0.0"
May 28 09:31:27.927179 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924074    2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 28 09:31:27.927179 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924080    2578 flags.go:64] FLAG: --anonymous-auth="true"
May 28 09:31:27.927179 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924084    2578 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 28 09:31:27.927179 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924089    2578 flags.go:64] FLAG: --authentication-token-webhook="false"
May 28 09:31:27.927179 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924092    2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 28 09:31:27.927179 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924097    2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 28 09:31:27.927179 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924102    2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 28 09:31:27.927179 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924105    2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 28 09:31:27.927684 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924108    2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 28 09:31:27.927684 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924112    2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 28 09:31:27.927684 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924115    2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 28 09:31:27.927684 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924118    2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 28 09:31:27.927684 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924121    2578 flags.go:64] FLAG: --cgroup-root=""
May 28 09:31:27.927684 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924124    2578 flags.go:64] FLAG: --cgroups-per-qos="true"
May 28 09:31:27.927684 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924127    2578 flags.go:64] FLAG: --client-ca-file=""
May 28 09:31:27.927684 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924129    2578 flags.go:64] FLAG: --cloud-config=""
May 28 09:31:27.927684 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924132    2578 flags.go:64] FLAG: --cloud-provider="external"
May 28 09:31:27.927684 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924135    2578 flags.go:64] FLAG: --cluster-dns="[]"
May 28 09:31:27.927684 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924139    2578 flags.go:64] FLAG: --cluster-domain=""
May 28 09:31:27.927684 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924142    2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 28 09:31:27.927684 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924145    2578 flags.go:64] FLAG: --config-dir=""
May 28 09:31:27.927684 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924147    2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 28 09:31:27.927684 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924151    2578 flags.go:64] FLAG: --container-log-max-files="5"
May 28 09:31:27.927684 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924154    2578 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 28 09:31:27.927684 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924157    2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 28 09:31:27.927684 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924160    2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 28 09:31:27.927684 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924163    2578 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 28 09:31:27.927684 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924166    2578 flags.go:64] FLAG: --contention-profiling="false"
May 28 09:31:27.927684 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924169    2578 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 28 09:31:27.927684 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924172    2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 28 09:31:27.927684 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924175    2578 flags.go:64] FLAG: --cpu-manager-policy="none"
May 28 09:31:27.927684 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924178    2578 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 28 09:31:27.927684 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924182    2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 28 09:31:27.928337 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924186    2578 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 28 09:31:27.928337 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924189    2578 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 28 09:31:27.928337 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924192    2578 flags.go:64] FLAG: --enable-load-reader="false"
May 28 09:31:27.928337 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924196    2578 flags.go:64] FLAG: --enable-server="true"
May 28 09:31:27.928337 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924201    2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 28 09:31:27.928337 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924205    2578 flags.go:64] FLAG: --event-burst="100"
May 28 09:31:27.928337 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924209    2578 flags.go:64] FLAG: --event-qps="50"
May 28 09:31:27.928337 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924212    2578 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 28 09:31:27.928337 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924215    2578 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 28 09:31:27.928337 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924232    2578 flags.go:64] FLAG: --eviction-hard=""
May 28 09:31:27.928337 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924236    2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 28 09:31:27.928337 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924239    2578 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 28 09:31:27.928337 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924242    2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 28 09:31:27.928337 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924245    2578 flags.go:64] FLAG: --eviction-soft=""
May 28 09:31:27.928337 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924248    2578 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 28 09:31:27.928337 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924251    2578 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 28 09:31:27.928337 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924254    2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 28 09:31:27.928337 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924257    2578 flags.go:64] FLAG: --experimental-mounter-path=""
May 28 09:31:27.928337 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924260    2578 flags.go:64] FLAG: --fail-cgroupv1="false"
May 28 09:31:27.928337 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924263    2578 flags.go:64] FLAG: --fail-swap-on="true"
May 28 09:31:27.928337 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924266    2578 flags.go:64] FLAG: --feature-gates=""
May 28 09:31:27.928337 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924272    2578 flags.go:64] FLAG: --file-check-frequency="20s"
May 28 09:31:27.928337 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924275    2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 28 09:31:27.928337 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924278    2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 28 09:31:27.928337 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924282    2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 28 09:31:27.928970 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924285    2578 flags.go:64] FLAG: --healthz-port="10248"
May 28 09:31:27.928970 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924287    2578 flags.go:64] FLAG: --help="false"
May 28 09:31:27.928970 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924291    2578 flags.go:64] FLAG: --hostname-override="ip-10-0-138-49.ec2.internal"
May 28 09:31:27.928970 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924295    2578 flags.go:64] FLAG: --housekeeping-interval="10s"
May 28 09:31:27.928970 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924298    2578 flags.go:64] FLAG: --http-check-frequency="20s"
May 28 09:31:27.928970 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924300    2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 28 09:31:27.928970 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924304    2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 28 09:31:27.928970 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924307    2578 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 28 09:31:27.928970 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924310    2578 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 28 09:31:27.928970 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924314    2578 flags.go:64] FLAG: --image-service-endpoint=""
May 28 09:31:27.928970 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924317    2578 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 28 09:31:27.928970 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924320    2578 flags.go:64] FLAG: --kube-api-burst="100"
May 28 09:31:27.928970 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924323    2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 28 09:31:27.928970 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924326    2578 flags.go:64] FLAG: --kube-api-qps="50"
May 28 09:31:27.928970 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924328    2578 flags.go:64] FLAG: --kube-reserved=""
May 28 09:31:27.928970 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924331    2578 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 28 09:31:27.928970 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924334    2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 28 09:31:27.928970 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924337    2578 flags.go:64] FLAG: --kubelet-cgroups=""
May 28 09:31:27.928970 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924339    2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 28 09:31:27.928970 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924342    2578 flags.go:64] FLAG: --lock-file=""
May 28 09:31:27.928970 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924345    2578 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 28 09:31:27.928970 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924348    2578 flags.go:64] FLAG: --log-flush-frequency="5s"
May 28 09:31:27.928970 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924351    2578 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 28 09:31:27.928970 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924356    2578 flags.go:64] FLAG: --log-json-split-stream="false"
May 28 09:31:27.929560 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924358    2578 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 28 09:31:27.929560 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924361    2578 flags.go:64] FLAG: --log-text-split-stream="false"
May 28 09:31:27.929560 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924366    2578 flags.go:64] FLAG: --logging-format="text"
May 28 09:31:27.929560 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924368    2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 28 09:31:27.929560 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924372    2578 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 28 09:31:27.929560 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924374    2578 flags.go:64] FLAG: --manifest-url=""
May 28 09:31:27.929560 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924377    2578 flags.go:64] FLAG: --manifest-url-header=""
May 28 09:31:27.929560 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924381    2578 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 28 09:31:27.929560 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924384    2578 flags.go:64] FLAG: --max-open-files="1000000"
May 28 09:31:27.929560 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924388    2578 flags.go:64] FLAG: --max-pods="110"
May 28 09:31:27.929560 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924391    2578 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 28 09:31:27.929560 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924394    2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 28 09:31:27.929560 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924397    2578 flags.go:64] FLAG: --memory-manager-policy="None"
May 28 09:31:27.929560 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924400    2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 28 09:31:27.929560 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924403    2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 28 09:31:27.929560 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924406    2578 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 28 09:31:27.929560 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924408    2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 28 09:31:27.929560 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924416    2578 flags.go:64] FLAG: --node-status-max-images="50"
May 28 09:31:27.929560 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924419    2578 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 28 09:31:27.929560 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924423    2578 flags.go:64] FLAG: --oom-score-adj="-999"
May 28 09:31:27.929560 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924426    2578 flags.go:64] FLAG: --pod-cidr=""
May 28 09:31:27.929560 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924428    2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 28 09:31:27.929560 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924434    2578 flags.go:64] FLAG: --pod-manifest-path=""
May 28 09:31:27.930108 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924437    2578 flags.go:64] FLAG: --pod-max-pids="-1"
May 28 09:31:27.930108 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924440    2578 flags.go:64] FLAG: --pods-per-core="0"
May 28 09:31:27.930108 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924443    2578 flags.go:64] FLAG: --port="10250"
May 28 09:31:27.930108 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924446    2578 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 28 09:31:27.930108 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924449    2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0cd13ed83742cf1fc"
May 28 09:31:27.930108 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924452    2578 flags.go:64] FLAG: --qos-reserved=""
May 28 09:31:27.930108 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924455    2578 flags.go:64] FLAG: --read-only-port="10255"
May 28 09:31:27.930108 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924458    2578 flags.go:64] FLAG: --register-node="true"
May 28 09:31:27.930108 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924461    2578 flags.go:64] FLAG: --register-schedulable="true"
May 28 09:31:27.930108 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924464    2578 flags.go:64] FLAG: --register-with-taints=""
May 28 09:31:27.930108 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924467    2578 flags.go:64] FLAG: --registry-burst="10"
May 28 09:31:27.930108 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924472    2578 flags.go:64] FLAG: --registry-qps="5"
May 28 09:31:27.930108 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924475    2578 flags.go:64] FLAG: --reserved-cpus=""
May 28 09:31:27.930108 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924478    2578 flags.go:64] FLAG: --reserved-memory=""
May 28 09:31:27.930108 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924482    2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 28 09:31:27.930108 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924485    2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 28 09:31:27.930108 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924488    2578 flags.go:64] FLAG: --rotate-certificates="false"
May 28 09:31:27.930108 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924491    2578 flags.go:64] FLAG: --rotate-server-certificates="false"
May 28 09:31:27.930108 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924494    2578 flags.go:64] FLAG: --runonce="false"
May 28 09:31:27.930108 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924497    2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 28 09:31:27.930108 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924500    2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 28 09:31:27.930108 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924503    2578 flags.go:64] FLAG: --seccomp-default="false"
May 28 09:31:27.930108 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924506    2578 flags.go:64] FLAG: --serialize-image-pulls="true"
May 28 09:31:27.930108 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924509    2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 28 09:31:27.930108 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924512    2578 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 28 09:31:27.930108 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924515    2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 28 09:31:27.930728 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924518    2578 flags.go:64] FLAG: --storage-driver-password="root"
May 28 09:31:27.930728 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924521    2578 flags.go:64] FLAG: --storage-driver-secure="false"
May 28 09:31:27.930728 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924524    2578 flags.go:64] FLAG: --storage-driver-table="stats"
May 28 09:31:27.930728 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924527    2578 flags.go:64] FLAG: --storage-driver-user="root"
May 28 09:31:27.930728 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924530    2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 28 09:31:27.930728 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924533    2578 flags.go:64] FLAG: --sync-frequency="1m0s"
May 28 09:31:27.930728 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924536    2578 flags.go:64] FLAG: --system-cgroups=""
May 28 09:31:27.930728 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924539    2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 28 09:31:27.930728 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924544    2578 flags.go:64] FLAG: --system-reserved-cgroup=""
May 28 09:31:27.930728 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924547    2578 flags.go:64] FLAG: --tls-cert-file=""
May 28 09:31:27.930728 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924550    2578 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 28 09:31:27.930728 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924554    2578 flags.go:64] FLAG: --tls-min-version=""
May 28 09:31:27.930728 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924556    2578 flags.go:64] FLAG: --tls-private-key-file=""
May 28 09:31:27.930728 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924559    2578 flags.go:64] FLAG: --topology-manager-policy="none"
May 28 09:31:27.930728 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924562    2578 flags.go:64] FLAG: --topology-manager-policy-options=""
May 28 09:31:27.930728 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924565    2578 flags.go:64] FLAG: --topology-manager-scope="container"
May 28 09:31:27.930728 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924567    2578 flags.go:64] FLAG: --v="2"
May 28 09:31:27.930728 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924574    2578 flags.go:64] FLAG: --version="false"
May 28 09:31:27.930728 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924578    2578 flags.go:64] FLAG: --vmodule=""
May 28 09:31:27.930728 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924582    2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 28 09:31:27.930728 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924585    2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 28 09:31:27.930728 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924668    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 09:31:27.930728 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924671    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 09:31:27.930728 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924674    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 09:31:27.931324 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924676    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 09:31:27.931324 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924679    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 09:31:27.931324 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924681    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 09:31:27.931324 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924683    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 09:31:27.931324 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924686    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 09:31:27.931324 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924688    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 09:31:27.931324 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924691    2578 feature_gate.go:328] unrecognized feature gate: Example
May 28 09:31:27.931324 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924694    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 09:31:27.931324 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924696    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 09:31:27.931324 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924698    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 09:31:27.931324 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924703    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 09:31:27.931324 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924707    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 09:31:27.931324 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924711    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 09:31:27.931324 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924714    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 09:31:27.931324 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924717    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 09:31:27.931324 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924720    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 09:31:27.931324 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924723    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 09:31:27.931324 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924726    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 09:31:27.931324 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924729    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 09:31:27.931824 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924731    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 09:31:27.931824 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924734    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 09:31:27.931824 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924737    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 09:31:27.931824 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924739    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 09:31:27.931824 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924742    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 09:31:27.931824 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924745    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 09:31:27.931824 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924753    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 09:31:27.931824 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924757    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 09:31:27.931824 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924760    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 09:31:27.931824 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924763    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 09:31:27.931824 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924765    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 09:31:27.931824 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924768    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 09:31:27.931824 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924771    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 09:31:27.931824 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924774    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 09:31:27.931824 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924777    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 09:31:27.931824 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924779    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 09:31:27.931824 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924782    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 09:31:27.931824 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924785    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 09:31:27.931824 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924788    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 09:31:27.932305 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924790    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 09:31:27.932305 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924793    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 09:31:27.932305 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924796    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 09:31:27.932305 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924799    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 09:31:27.932305 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924801    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 09:31:27.932305 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924812    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 09:31:27.932305 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924815    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 09:31:27.932305 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924818    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 09:31:27.932305 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924820    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 09:31:27.932305 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924823    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 09:31:27.932305 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924825    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 09:31:27.932305 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924828    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 09:31:27.932305 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924830    2578 feature_gate.go:328] unrecognized feature gate: Example2
May 28 09:31:27.932305 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924834    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 09:31:27.932305 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924837    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 09:31:27.932305 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924841    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 09:31:27.932305 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924844    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 09:31:27.932305 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924846    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 09:31:27.932305 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924849    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 09:31:27.932305 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924852    2578 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 09:31:27.932800 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924855    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 09:31:27.932800 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924857    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 09:31:27.932800 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924860    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 09:31:27.932800 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924863    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 09:31:27.932800 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924865    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 09:31:27.932800 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924868    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 09:31:27.932800 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924870    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 09:31:27.932800 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924873    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 09:31:27.932800 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924875    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 09:31:27.932800 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924878    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 09:31:27.932800 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924881    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 09:31:27.932800 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924884    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 09:31:27.932800 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924886    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 09:31:27.932800 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924889    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 09:31:27.932800 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924891    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 09:31:27.932800 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924894    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 09:31:27.932800 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924909    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 09:31:27.932800 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924914    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 09:31:27.932800 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924918    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 09:31:27.932800 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924920    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 09:31:27.933329 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924923    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 09:31:27.933329 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924925    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 09:31:27.933329 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924928    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 09:31:27.933329 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924930    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 09:31:27.933329 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.924933    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 09:31:27.933329 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.924938    2578 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 09:31:27.933329 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.932212    2578 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 28 09:31:27.933329 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.932244    2578 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 28 09:31:27.933329 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932297    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 09:31:27.933329 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932302    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 09:31:27.933329 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932305    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 09:31:27.933329 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932308    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 09:31:27.933329 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932312    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 09:31:27.933329 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932314    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 09:31:27.933329 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932317    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 09:31:27.933730 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932321    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 09:31:27.933730 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932323    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 09:31:27.933730 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932326    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 09:31:27.933730 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932329    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 09:31:27.933730 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932332    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 09:31:27.933730 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932334    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 09:31:27.933730 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932337    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 09:31:27.933730 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932339    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 09:31:27.933730 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932342    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 09:31:27.933730 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932344    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 09:31:27.933730 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932347    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 09:31:27.933730 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932351    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 09:31:27.933730 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932353    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 09:31:27.933730 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932357    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 09:31:27.933730 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932361    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 09:31:27.933730 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932364    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 09:31:27.933730 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932367    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 09:31:27.933730 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932370    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 09:31:27.933730 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932372    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 09:31:27.934181 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932375    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 09:31:27.934181 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932378    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 09:31:27.934181 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932381    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 09:31:27.934181 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932385    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 09:31:27.934181 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932387    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 09:31:27.934181 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932391    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 09:31:27.934181 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932394    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 09:31:27.934181 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932397    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 09:31:27.934181 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932399    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 09:31:27.934181 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932402    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 09:31:27.934181 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932404    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 09:31:27.934181 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932407    2578 feature_gate.go:328] unrecognized feature gate: Example2
May 28 09:31:27.934181 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932410    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 09:31:27.934181 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932413    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 09:31:27.934181 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932415    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 09:31:27.934181 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932418    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 09:31:27.934181 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932420    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 09:31:27.934181 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932423    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 09:31:27.934181 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932425    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 09:31:27.934181 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932428    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 09:31:27.934672 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932430    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 09:31:27.934672 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932432    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 09:31:27.934672 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932435    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 09:31:27.934672 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932438    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 09:31:27.934672 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932440    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 09:31:27.934672 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932443    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 09:31:27.934672 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932445    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 09:31:27.934672 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932448    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 09:31:27.934672 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932450    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 09:31:27.934672 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932452    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 09:31:27.934672 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932455    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 09:31:27.934672 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932457    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 09:31:27.934672 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932460    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 09:31:27.934672 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932462    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 09:31:27.934672 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932465    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 09:31:27.934672 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932467    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 09:31:27.934672 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932469    2578 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 09:31:27.934672 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932473    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 09:31:27.934672 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932476    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 09:31:27.935129 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932479    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 09:31:27.935129 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932481    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 09:31:27.935129 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932484    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 09:31:27.935129 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932486    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 09:31:27.935129 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932489    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 09:31:27.935129 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932491    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 09:31:27.935129 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932494    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 09:31:27.935129 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932496    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 09:31:27.935129 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932498    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 09:31:27.935129 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932501    2578 feature_gate.go:328] unrecognized feature gate: Example
May 28 09:31:27.935129 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932503    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 09:31:27.935129 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932506    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 09:31:27.935129 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932508    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 09:31:27.935129 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932510    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 09:31:27.935129 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932513    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 09:31:27.935129 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932516    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 09:31:27.935129 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932518    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 09:31:27.935129 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932521    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 09:31:27.935129 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932523    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 09:31:27.935129 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932526    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 09:31:27.935645 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932528    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 09:31:27.935645 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.932533    2578 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 09:31:27.935645 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932631    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 09:31:27.935645 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932636    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 09:31:27.935645 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932639    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 09:31:27.935645 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932642    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 09:31:27.935645 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932644    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 09:31:27.935645 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932647    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 09:31:27.935645 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932649    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 09:31:27.935645 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932652    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 09:31:27.935645 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932655    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 09:31:27.935645 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932658    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 09:31:27.935645 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932661    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 09:31:27.935645 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932664    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 09:31:27.935645 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932666    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 09:31:27.936040 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932669    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 09:31:27.936040 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932671    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 09:31:27.936040 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932674    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 09:31:27.936040 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932677    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 09:31:27.936040 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932679    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 09:31:27.936040 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932681    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 09:31:27.936040 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932684    2578 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 09:31:27.936040 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932686    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 09:31:27.936040 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932689    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 09:31:27.936040 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932691    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 09:31:27.936040 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932694    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 09:31:27.936040 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932698    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 09:31:27.936040 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932701    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 09:31:27.936040 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932704    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 09:31:27.936040 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932707    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 09:31:27.936040 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932710    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 09:31:27.936040 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932713    2578 feature_gate.go:328] unrecognized feature gate: Example
May 28 09:31:27.936040 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932715    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 09:31:27.936040 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932718    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 09:31:27.936520 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932721    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 09:31:27.936520 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932723    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 09:31:27.936520 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932725    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 09:31:27.936520 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932728    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 09:31:27.936520 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932730    2578 feature_gate.go:328] unrecognized feature gate: Example2
May 28 09:31:27.936520 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932733    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 09:31:27.936520 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932736    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 09:31:27.936520 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932738    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 09:31:27.936520 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932741    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 09:31:27.936520 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932743    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 09:31:27.936520 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932746    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 09:31:27.936520 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932749    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 09:31:27.936520 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932751    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 09:31:27.936520 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932754    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 09:31:27.936520 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932756    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 09:31:27.936520 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932759    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 09:31:27.936520 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932761    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 09:31:27.936520 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932763    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 09:31:27.936520 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932766    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 09:31:27.936520 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932768    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 09:31:27.937006 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932771    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 09:31:27.937006 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932773    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 09:31:27.937006 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932776    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 09:31:27.937006 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932778    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 09:31:27.937006 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932781    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 09:31:27.937006 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932783    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 09:31:27.937006 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932786    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 09:31:27.937006 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932788    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 09:31:27.937006 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932791    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 09:31:27.937006 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932793    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 09:31:27.937006 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932796    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 09:31:27.937006 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932798    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 09:31:27.937006 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932801    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 09:31:27.937006 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932803    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 09:31:27.937006 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932806    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 09:31:27.937006 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932809    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 09:31:27.937006 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932813    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 09:31:27.937006 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932816    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 09:31:27.937006 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932819    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 09:31:27.937006 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932821    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 09:31:27.937581 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932824    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 09:31:27.937581 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932826    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 09:31:27.937581 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932829    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 09:31:27.937581 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932831    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 09:31:27.937581 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932835    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 09:31:27.937581 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932837    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 09:31:27.937581 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932840    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 09:31:27.937581 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932842    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 09:31:27.937581 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932844    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 09:31:27.937581 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932847    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 09:31:27.937581 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932849    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 09:31:27.937581 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932852    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 09:31:27.937581 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932854    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 09:31:27.937581 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:27.932857    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 09:31:27.937581 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.932862    2578 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 09:31:27.937933 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.933570    2578 server.go:962] "Client rotation is on, will bootstrap in background"
May 28 09:31:27.938361 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.938347    2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 28 09:31:27.939343 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.939332    2578 server.go:1019] "Starting client certificate rotation"
May 28 09:31:27.939446 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.939429    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 28 09:31:27.939479 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.939461    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 28 09:31:27.965931 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.965915    2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 28 09:31:27.967719 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.967684    2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 28 09:31:27.985695 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.985672    2578 log.go:25] "Validated CRI v1 runtime API"
May 28 09:31:27.990718 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.990704    2578 log.go:25] "Validated CRI v1 image API"
May 28 09:31:27.992780 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.992758    2578 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 28 09:31:27.995614 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.995593    2578 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8b776dac-ff3b-48a6-89df-34ea925408ce:/dev/nvme0n1p3 b4e6e020-cd8e-482f-b74d-bacb606df326:/dev/nvme0n1p4]
May 28 09:31:27.995691 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.995612    2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 28 09:31:28.000052 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:27.999944    2578 manager.go:217] Machine: {Timestamp:2026-05-28 09:31:27.999427753 +0000 UTC m=+0.459173390 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3079356 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2d9503f45a47f30547c13f93bc4807 SystemUUID:ec2d9503-f45a-47f3-0547-c13f93bc4807 BootID:476451fd-15f8-4bcc-92f8-476782bdd6ed Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:69:b3:4b:4d:67 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:69:b3:4b:4d:67 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8e:4c:47:22:da:d8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 28 09:31:28.000712 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.000701    2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 28 09:31:28.000799 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.000786    2578 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 28 09:31:28.002726 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.002711    2578 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 28 09:31:28.004416 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.004394    2578 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 28 09:31:28.004553 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.004419    2578 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-49.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 28 09:31:28.004601 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.004562    2578 topology_manager.go:138] "Creating topology manager with none policy"
May 28 09:31:28.004601 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.004571    2578 container_manager_linux.go:306] "Creating device plugin manager"
May 28 09:31:28.004601 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.004578    2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 28 09:31:28.005467 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.005458    2578 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 28 09:31:28.008161 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.008150    2578 state_mem.go:36] "Initialized new in-memory state store"
May 28 09:31:28.008274 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.008265    2578 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 28 09:31:28.012666 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.012656    2578 kubelet.go:491] "Attempting to sync node with API server"
May 28 09:31:28.012709 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.012669    2578 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 28 09:31:28.012709 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.012683    2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 28 09:31:28.012709 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.012692    2578 kubelet.go:397] "Adding apiserver pod source"
May 28 09:31:28.012709 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.012700    2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 28 09:31:28.013747 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.013730    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 28 09:31:28.013817 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.013759    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 28 09:31:28.016955 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.016941    2578 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 28 09:31:28.019002 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.018985    2578 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 28 09:31:28.019882 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.019867    2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 28 09:31:28.019953 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.019887    2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 28 09:31:28.019953 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.019897    2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 28 09:31:28.019953 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.019905    2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 28 09:31:28.019953 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.019918    2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 28 09:31:28.019953 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.019928    2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 28 09:31:28.019953 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.019937    2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 28 09:31:28.019953 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.019945    2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 28 09:31:28.019953 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.019955    2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 28 09:31:28.020174 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.019965    2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 28 09:31:28.020174 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.019978    2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 28 09:31:28.020274 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.020263    2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 28 09:31:28.021076 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.021065    2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 28 09:31:28.021130 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.021078    2578 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 28 09:31:28.023777 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:28.023749    2578 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 28 09:31:28.023777 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:28.023750    2578 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-49.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 28 09:31:28.024103 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.024087    2578 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 28 09:31:28.024181 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.024130    2578 server.go:1295] "Started kubelet"
May 28 09:31:28.026487 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.026431    2578 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 28 09:31:28.026599 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.026584    2578 server_v1.go:47] "podresources" method="list" useActivePods=true
May 28 09:31:28.026786 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.024329    2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 28 09:31:28.026960 ip-10-0-138-49 systemd[1]: Started Kubernetes Kubelet.
May 28 09:31:28.028452 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.028434    2578 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 28 09:31:28.030325 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.030311    2578 server.go:317] "Adding debug handlers to kubelet server"
May 28 09:31:28.036019 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.036006    2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 28 09:31:28.036108 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.036020    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 28 09:31:28.036194 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.036178    2578 volume_manager.go:295] "The desired_state_of_world populator starts"
May 28 09:31:28.036194 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.036192    2578 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 28 09:31:28.036316 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.036304    2578 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 28 09:31:28.036394 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.036379    2578 reconstruct.go:97] "Volume reconstruction finished"
May 28 09:31:28.036394 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.036390    2578 reconciler.go:26] "Reconciler: start to sync state"
May 28 09:31:28.037031 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:28.037014    2578 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 28 09:31:28.037193 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:28.037173    2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-49.ec2.internal\" not found"
May 28 09:31:28.038485 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.038465    2578 factory.go:55] Registering systemd factory
May 28 09:31:28.038563 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.038511    2578 factory.go:223] Registration of the systemd container factory successfully
May 28 09:31:28.038714 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.038698    2578 factory.go:153] Registering CRI-O factory
May 28 09:31:28.038714 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.038713    2578 factory.go:223] Registration of the crio container factory successfully
May 28 09:31:28.038853 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.038758    2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 28 09:31:28.038853 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.038778    2578 factory.go:103] Registering Raw factory
May 28 09:31:28.038853 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.038792    2578 manager.go:1196] Started watching for new ooms in manager
May 28 09:31:28.039295 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.039281    2578 manager.go:319] Starting recovery of all containers
May 28 09:31:28.039295 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:28.039281    2578 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
May 28 09:31:28.039671 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:28.039620    2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-49.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
May 28 09:31:28.039779 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.039765    2578 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-49.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 28 09:31:28.040400 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:28.039304    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-49.ec2.internal.18b3b0d0abd61e85  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-49.ec2.internal,UID:ip-10-0-138-49.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-49.ec2.internal,},FirstTimestamp:2026-05-28 09:31:28.024100485 +0000 UTC m=+0.483846123,LastTimestamp:2026-05-28 09:31:28.024100485 +0000 UTC m=+0.483846123,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-49.ec2.internal,}"
May 28 09:31:28.048797 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.048693    2578 manager.go:324] Recovery completed
May 28 09:31:28.052638 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.052626    2578 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 09:31:28.054332 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.054315    2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-49.ec2.internal" event="NodeHasSufficientMemory"
May 28 09:31:28.054383 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.054345    2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-49.ec2.internal" event="NodeHasNoDiskPressure"
May 28 09:31:28.054383 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.054356    2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-49.ec2.internal" event="NodeHasSufficientPID"
May 28 09:31:28.055159 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.055147    2578 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 28 09:31:28.055159 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.055159    2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 28 09:31:28.055246 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.055173    2578 state_mem.go:36] "Initialized new in-memory state store"
May 28 09:31:28.056623 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:28.056570    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-49.ec2.internal.18b3b0d0ada36cb6  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-49.ec2.internal,UID:ip-10-0-138-49.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-138-49.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-138-49.ec2.internal,},FirstTimestamp:2026-05-28 09:31:28.054332598 +0000 UTC m=+0.514078234,LastTimestamp:2026-05-28 09:31:28.054332598 +0000 UTC m=+0.514078234,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-49.ec2.internal,}"
May 28 09:31:28.058632 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.058619    2578 policy_none.go:49] "None policy: Start"
May 28 09:31:28.058691 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.058636    2578 memory_manager.go:186] "Starting memorymanager" policy="None"
May 28 09:31:28.058691 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.058647    2578 state_mem.go:35] "Initializing new in-memory state store"
May 28 09:31:28.065394 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:28.065336    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-49.ec2.internal.18b3b0d0ada3af0e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-49.ec2.internal,UID:ip-10-0-138-49.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-138-49.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-138-49.ec2.internal,},FirstTimestamp:2026-05-28 09:31:28.054349582 +0000 UTC m=+0.514095217,LastTimestamp:2026-05-28 09:31:28.054349582 +0000 UTC m=+0.514095217,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-49.ec2.internal,}"
May 28 09:31:28.075921 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:28.075833    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-49.ec2.internal.18b3b0d0ada3d8a7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-49.ec2.internal,UID:ip-10-0-138-49.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-138-49.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-138-49.ec2.internal,},FirstTimestamp:2026-05-28 09:31:28.054360231 +0000 UTC m=+0.514105867,LastTimestamp:2026-05-28 09:31:28.054360231 +0000 UTC m=+0.514105867,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-49.ec2.internal,}"
May 28 09:31:28.085736 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.085717    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d7kbw"
May 28 09:31:28.092754 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.092736    2578 manager.go:341] "Starting Device Plugin manager"
May 28 09:31:28.114332 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:28.092772    2578 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 28 09:31:28.114332 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.092786    2578 server.go:85] "Starting device plugin registration server"
May 28 09:31:28.114332 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.093000    2578 eviction_manager.go:189] "Eviction manager: starting control loop"
May 28 09:31:28.114332 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.093010    2578 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 28 09:31:28.114332 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.093104    2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 28 09:31:28.114332 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.093187    2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 28 09:31:28.114332 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.093195    2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 28 09:31:28.114332 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:28.093699    2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 28 09:31:28.114332 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:28.093727    2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-49.ec2.internal\" not found"
May 28 09:31:28.114332 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.097550    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-d7kbw"
May 28 09:31:28.114332 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.099472    2578 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 28 09:31:28.114332 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.100575    2578 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 28 09:31:28.114332 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.100597    2578 status_manager.go:230] "Starting to sync pod status with apiserver"
May 28 09:31:28.114332 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.100614    2578 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 28 09:31:28.114332 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.100621    2578 kubelet.go:2451] "Starting kubelet main sync loop"
May 28 09:31:28.114332 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:28.100659    2578 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 28 09:31:28.114332 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.111138    2578 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 09:31:28.193790 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.193775    2578 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 09:31:28.194622 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.194607    2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-49.ec2.internal" event="NodeHasSufficientMemory"
May 28 09:31:28.194684 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.194635    2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-49.ec2.internal" event="NodeHasNoDiskPressure"
May 28 09:31:28.194684 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.194645    2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-49.ec2.internal" event="NodeHasSufficientPID"
May 28 09:31:28.194684 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.194665    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-49.ec2.internal"
May 28 09:31:28.201674 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.201646    2578 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-49.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-49.ec2.internal"]
May 28 09:31:28.201745 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.201717    2578 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 09:31:28.202425 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.202412    2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-49.ec2.internal" event="NodeHasSufficientMemory"
May 28 09:31:28.202492 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.202435    2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-49.ec2.internal" event="NodeHasNoDiskPressure"
May 28 09:31:28.202492 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.202447    2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-49.ec2.internal" event="NodeHasSufficientPID"
May 28 09:31:28.204292 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.204278    2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-49.ec2.internal"
May 28 09:31:28.204368 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:28.204296    2578 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-49.ec2.internal\": node \"ip-10-0-138-49.ec2.internal\" not found"
May 28 09:31:28.205009 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.204997    2578 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 09:31:28.205167 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.205153    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-49.ec2.internal"
May 28 09:31:28.205238 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.205187    2578 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 09:31:28.205740 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.205722    2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-49.ec2.internal" event="NodeHasSufficientMemory"
May 28 09:31:28.205814 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.205728    2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-49.ec2.internal" event="NodeHasSufficientMemory"
May 28 09:31:28.205814 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.205754    2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-49.ec2.internal" event="NodeHasNoDiskPressure"
May 28 09:31:28.205814 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.205766    2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-49.ec2.internal" event="NodeHasNoDiskPressure"
May 28 09:31:28.205814 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.205767    2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-49.ec2.internal" event="NodeHasSufficientPID"
May 28 09:31:28.205814 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.205782    2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-49.ec2.internal" event="NodeHasSufficientPID"
May 28 09:31:28.208062 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.208048    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-49.ec2.internal"
May 28 09:31:28.208136 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.208073    2578 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 09:31:28.208771 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.208754    2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-49.ec2.internal" event="NodeHasSufficientMemory"
May 28 09:31:28.208861 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.208780    2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-49.ec2.internal" event="NodeHasNoDiskPressure"
May 28 09:31:28.208861 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.208789    2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-49.ec2.internal" event="NodeHasSufficientPID"
May 28 09:31:28.217634 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:28.217612    2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-49.ec2.internal\" not found"
May 28 09:31:28.229697 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:28.229681    2578 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-49.ec2.internal\" not found" node="ip-10-0-138-49.ec2.internal"
May 28 09:31:28.233866 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:28.233853    2578 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-49.ec2.internal\" not found" node="ip-10-0-138-49.ec2.internal"
May 28 09:31:28.317896 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:28.317875    2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-49.ec2.internal\" not found"
May 28 09:31:28.336985 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.336964    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/43e1caf191e8432918e21aec4ad05186-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-49.ec2.internal\" (UID: \"43e1caf191e8432918e21aec4ad05186\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-49.ec2.internal"
May 28 09:31:28.337043 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.336988    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/43e1caf191e8432918e21aec4ad05186-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-49.ec2.internal\" (UID: \"43e1caf191e8432918e21aec4ad05186\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-49.ec2.internal"
May 28 09:31:28.337043 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.337006    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1f961dde9f6169a438d2aee717de7ec2-config\") pod \"kube-apiserver-proxy-ip-10-0-138-49.ec2.internal\" (UID: \"1f961dde9f6169a438d2aee717de7ec2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-49.ec2.internal"
May 28 09:31:28.418475 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:28.418449    2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-49.ec2.internal\" not found"
May 28 09:31:28.437745 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.437724    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/43e1caf191e8432918e21aec4ad05186-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-49.ec2.internal\" (UID: \"43e1caf191e8432918e21aec4ad05186\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-49.ec2.internal"
May 28 09:31:28.437809 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.437754    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/43e1caf191e8432918e21aec4ad05186-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-49.ec2.internal\" (UID: \"43e1caf191e8432918e21aec4ad05186\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-49.ec2.internal"
May 28 09:31:28.437809 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.437777    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1f961dde9f6169a438d2aee717de7ec2-config\") pod \"kube-apiserver-proxy-ip-10-0-138-49.ec2.internal\" (UID: \"1f961dde9f6169a438d2aee717de7ec2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-49.ec2.internal"
May 28 09:31:28.437875 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.437816    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/43e1caf191e8432918e21aec4ad05186-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-49.ec2.internal\" (UID: \"43e1caf191e8432918e21aec4ad05186\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-49.ec2.internal"
May 28 09:31:28.437875 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.437823    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/1f961dde9f6169a438d2aee717de7ec2-config\") pod \"kube-apiserver-proxy-ip-10-0-138-49.ec2.internal\" (UID: \"1f961dde9f6169a438d2aee717de7ec2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-49.ec2.internal"
May 28 09:31:28.437875 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.437820    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/43e1caf191e8432918e21aec4ad05186-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-49.ec2.internal\" (UID: \"43e1caf191e8432918e21aec4ad05186\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-49.ec2.internal"
May 28 09:31:28.519189 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:28.519109    2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-49.ec2.internal\" not found"
May 28 09:31:28.534303 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.534281    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-49.ec2.internal"
May 28 09:31:28.538049 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.538032    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-49.ec2.internal"
May 28 09:31:28.619560 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:28.619531    2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-49.ec2.internal\" not found"
May 28 09:31:28.720021 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:28.719991    2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-49.ec2.internal\" not found"
May 28 09:31:28.820535 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:28.820460    2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-49.ec2.internal\" not found"
May 28 09:31:28.920957 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:28.920932    2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-49.ec2.internal\" not found"
May 28 09:31:28.939263 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.939247    2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 28 09:31:28.939418 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:28.939400    2578 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 28 09:31:29.021905 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:29.021870    2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-49.ec2.internal\" not found"
May 28 09:31:29.037138 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:29.037107    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 28 09:31:29.055771 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:29.055755    2578 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 28 09:31:29.067406 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:29.067380    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43e1caf191e8432918e21aec4ad05186.slice/crio-bdc42c6c14b7d3f02d9f0b2cf726815e898f52274aea1c93c4ee6b1f5098ad6a WatchSource:0}: Error finding container bdc42c6c14b7d3f02d9f0b2cf726815e898f52274aea1c93c4ee6b1f5098ad6a: Status 404 returned error can't find the container with id bdc42c6c14b7d3f02d9f0b2cf726815e898f52274aea1c93c4ee6b1f5098ad6a
May 28 09:31:29.067632 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:29.067615    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f961dde9f6169a438d2aee717de7ec2.slice/crio-2716a409f62b43fc9645886fdc76cb91e2e89fb5f65a8ff9c5836ee74c809cf4 WatchSource:0}: Error finding container 2716a409f62b43fc9645886fdc76cb91e2e89fb5f65a8ff9c5836ee74c809cf4: Status 404 returned error can't find the container with id 2716a409f62b43fc9645886fdc76cb91e2e89fb5f65a8ff9c5836ee74c809cf4
May 28 09:31:29.071020 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:29.071007    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 09:31:29.100101 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:29.100063    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-27 09:26:28 +0000 UTC" deadline="2028-02-22 10:34:32.47590346 +0000 UTC"
May 28 09:31:29.100101 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:29.100096    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15241h3m3.375810623s"
May 28 09:31:29.103812 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:29.103771    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-49.ec2.internal" event={"ID":"1f961dde9f6169a438d2aee717de7ec2","Type":"ContainerStarted","Data":"2716a409f62b43fc9645886fdc76cb91e2e89fb5f65a8ff9c5836ee74c809cf4"}
May 28 09:31:29.104832 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:29.104814    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-49.ec2.internal" event={"ID":"43e1caf191e8432918e21aec4ad05186","Type":"ContainerStarted","Data":"bdc42c6c14b7d3f02d9f0b2cf726815e898f52274aea1c93c4ee6b1f5098ad6a"}
May 28 09:31:29.106714 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:29.106697    2578 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 09:31:29.122685 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:29.122666    2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-49.ec2.internal\" not found"
May 28 09:31:29.130173 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:29.130152    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-fcch7"
May 28 09:31:29.138584 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:29.138568    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-fcch7"
May 28 09:31:29.222801 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:29.222776    2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-49.ec2.internal\" not found"
May 28 09:31:29.323101 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:29.323004    2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-49.ec2.internal\" not found"
May 28 09:31:29.423465 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:29.423435    2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-49.ec2.internal\" not found"
May 28 09:31:29.524282 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:29.524248    2578 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-138-49.ec2.internal\" not found"
May 28 09:31:29.602467 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:29.602396    2578 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 09:31:29.608942 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:29.608921    2578 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 09:31:29.636465 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:29.636446    2578 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-49.ec2.internal"
May 28 09:31:29.654000 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:29.653976    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 28 09:31:29.655267 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:29.655251    2578 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-49.ec2.internal"
May 28 09:31:29.664332 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:29.664314    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 28 09:31:30.014638 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.014609    2578 apiserver.go:52] "Watching apiserver"
May 28 09:31:30.022699 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.022674    2578 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 28 09:31:30.025450 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.025421    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-49.ec2.internal","openshift-network-diagnostics/network-check-target-n442c","openshift-network-operator/iptables-alerter-x49m9","openshift-ovn-kubernetes/ovnkube-node-wqcwd","kube-system/konnectivity-agent-fswqv","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f44r4","openshift-cluster-node-tuning-operator/tuned-rrxw4","openshift-image-registry/node-ca-nvjjz","openshift-multus/multus-9qvc7","openshift-multus/multus-additional-cni-plugins-pcp25","openshift-multus/network-metrics-daemon-4jgb2","kube-system/kube-apiserver-proxy-ip-10-0-138-49.ec2.internal","openshift-dns/node-resolver-zg2lk"]
May 28 09:31:30.027961 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.027939    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rrxw4"
May 28 09:31:30.030145 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.030120    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n442c"
May 28 09:31:30.030272 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:30.030198    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n442c" podUID="36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74"
May 28 09:31:30.030687 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.030476    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 28 09:31:30.030687 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.030529    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 28 09:31:30.030687 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.030568    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4l2pt\""
May 28 09:31:30.032210 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.032191    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x49m9"
May 28 09:31:30.034331 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.034312    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.034604 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.034548    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 28 09:31:30.034901 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.034882    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-rcc6h\""
May 28 09:31:30.035003 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.034937    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 28 09:31:30.036458 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.036440    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fswqv"
May 28 09:31:30.036762 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.036743    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 28 09:31:30.036865 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.036792    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 28 09:31:30.036946 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.036861    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 28 09:31:30.037172 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.037147    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 28 09:31:30.038289 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.038271    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 28 09:31:30.038395 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.038290    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 28 09:31:30.038395 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.038323    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 28 09:31:30.038501 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.038396    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-222xt\""
May 28 09:31:30.039043 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.038745    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 28 09:31:30.039043 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.038899    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-q4qd9\""
May 28 09:31:30.039043 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.038941    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 28 09:31:30.040935 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.040917    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f44r4"
May 28 09:31:30.041027 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.040996    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nvjjz"
May 28 09:31:30.045072 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.045002    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f12d790e-dc2c-4dec-b3a1-04e48182ae83-var-lib-kubelet\") pod \"tuned-rrxw4\" (UID: \"f12d790e-dc2c-4dec-b3a1-04e48182ae83\") " pod="openshift-cluster-node-tuning-operator/tuned-rrxw4"
May 28 09:31:30.045072 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.045052    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f12d790e-dc2c-4dec-b3a1-04e48182ae83-etc-sysctl-d\") pod \"tuned-rrxw4\" (UID: \"f12d790e-dc2c-4dec-b3a1-04e48182ae83\") " pod="openshift-cluster-node-tuning-operator/tuned-rrxw4"
May 28 09:31:30.045212 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.045085    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f12d790e-dc2c-4dec-b3a1-04e48182ae83-etc-systemd\") pod \"tuned-rrxw4\" (UID: \"f12d790e-dc2c-4dec-b3a1-04e48182ae83\") " pod="openshift-cluster-node-tuning-operator/tuned-rrxw4"
May 28 09:31:30.045212 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.045120    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f12d790e-dc2c-4dec-b3a1-04e48182ae83-sys\") pod \"tuned-rrxw4\" (UID: \"f12d790e-dc2c-4dec-b3a1-04e48182ae83\") " pod="openshift-cluster-node-tuning-operator/tuned-rrxw4"
May 28 09:31:30.045212 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.045154    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f12d790e-dc2c-4dec-b3a1-04e48182ae83-tmp\") pod \"tuned-rrxw4\" (UID: \"f12d790e-dc2c-4dec-b3a1-04e48182ae83\") " pod="openshift-cluster-node-tuning-operator/tuned-rrxw4"
May 28 09:31:30.045212 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.045190    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/50480aff-36b8-40f0-b169-d1b8a3c6d70d-etc-selinux\") pod \"aws-ebs-csi-driver-node-f44r4\" (UID: \"50480aff-36b8-40f0-b169-d1b8a3c6d70d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f44r4"
May 28 09:31:30.045419 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.045231    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/50480aff-36b8-40f0-b169-d1b8a3c6d70d-sys-fs\") pod \"aws-ebs-csi-driver-node-f44r4\" (UID: \"50480aff-36b8-40f0-b169-d1b8a3c6d70d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f44r4"
May 28 09:31:30.045419 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.045276    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f12d790e-dc2c-4dec-b3a1-04e48182ae83-etc-sysctl-conf\") pod \"tuned-rrxw4\" (UID: \"f12d790e-dc2c-4dec-b3a1-04e48182ae83\") " pod="openshift-cluster-node-tuning-operator/tuned-rrxw4"
May 28 09:31:30.045419 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.045314    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snvgh\" (UniqueName: \"kubernetes.io/projected/36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74-kube-api-access-snvgh\") pod \"network-check-target-n442c\" (UID: \"36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74\") " pod="openshift-network-diagnostics/network-check-target-n442c"
May 28 09:31:30.045419 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.045346    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/397304a8-87ab-49c0-9fc0-a3ca99f04032-run-ovn\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.045419 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.045378    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/397304a8-87ab-49c0-9fc0-a3ca99f04032-node-log\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.045419 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.045416    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/397304a8-87ab-49c0-9fc0-a3ca99f04032-host-cni-bin\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.045602 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.045443    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/397304a8-87ab-49c0-9fc0-a3ca99f04032-env-overrides\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.045602 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.045449    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 28 09:31:30.045602 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.045470    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 28 09:31:30.045685 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.045471    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f12d790e-dc2c-4dec-b3a1-04e48182ae83-run\") pod \"tuned-rrxw4\" (UID: \"f12d790e-dc2c-4dec-b3a1-04e48182ae83\") " pod="openshift-cluster-node-tuning-operator/tuned-rrxw4"
May 28 09:31:30.045685 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.045671    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 28 09:31:30.045742 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.045696    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 28 09:31:30.045742 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.045705    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f12d790e-dc2c-4dec-b3a1-04e48182ae83-lib-modules\") pod \"tuned-rrxw4\" (UID: \"f12d790e-dc2c-4dec-b3a1-04e48182ae83\") " pod="openshift-cluster-node-tuning-operator/tuned-rrxw4"
May 28 09:31:30.045800 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.045741    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/397304a8-87ab-49c0-9fc0-a3ca99f04032-etc-openvswitch\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.045800 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.045774    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/397304a8-87ab-49c0-9fc0-a3ca99f04032-run-openvswitch\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.045800 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.045794    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 28 09:31:30.045877 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.045805    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/397304a8-87ab-49c0-9fc0-a3ca99f04032-ovn-node-metrics-cert\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.045877 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.045834    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhn4h\" (UniqueName: \"kubernetes.io/projected/397304a8-87ab-49c0-9fc0-a3ca99f04032-kube-api-access-dhn4h\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.045877 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.045865    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a9e39b1c-78f9-4176-9dda-9464da6c6d4d-konnectivity-ca\") pod \"konnectivity-agent-fswqv\" (UID: \"a9e39b1c-78f9-4176-9dda-9464da6c6d4d\") " pod="kube-system/konnectivity-agent-fswqv"
May 28 09:31:30.045964 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.045895    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f12d790e-dc2c-4dec-b3a1-04e48182ae83-etc-sysconfig\") pod \"tuned-rrxw4\" (UID: \"f12d790e-dc2c-4dec-b3a1-04e48182ae83\") " pod="openshift-cluster-node-tuning-operator/tuned-rrxw4"
May 28 09:31:30.045964 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.045923    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f12d790e-dc2c-4dec-b3a1-04e48182ae83-host\") pod \"tuned-rrxw4\" (UID: \"f12d790e-dc2c-4dec-b3a1-04e48182ae83\") " pod="openshift-cluster-node-tuning-operator/tuned-rrxw4"
May 28 09:31:30.045964 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.045953    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bm5h8\" (UniqueName: \"kubernetes.io/projected/f12d790e-dc2c-4dec-b3a1-04e48182ae83-kube-api-access-bm5h8\") pod \"tuned-rrxw4\" (UID: \"f12d790e-dc2c-4dec-b3a1-04e48182ae83\") " pod="openshift-cluster-node-tuning-operator/tuned-rrxw4"
May 28 09:31:30.046059 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.045974    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-wh4zd\""
May 28 09:31:30.046059 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.045977    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/50480aff-36b8-40f0-b169-d1b8a3c6d70d-registration-dir\") pod \"aws-ebs-csi-driver-node-f44r4\" (UID: \"50480aff-36b8-40f0-b169-d1b8a3c6d70d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f44r4"
May 28 09:31:30.046059 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.045998    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 28 09:31:30.046059 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.046009    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/50480aff-36b8-40f0-b169-d1b8a3c6d70d-device-dir\") pod \"aws-ebs-csi-driver-node-f44r4\" (UID: \"50480aff-36b8-40f0-b169-d1b8a3c6d70d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f44r4"
May 28 09:31:30.046252 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.046060    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/70d16a61-6335-4394-aebd-18e43cbd22a8-iptables-alerter-script\") pod \"iptables-alerter-x49m9\" (UID: \"70d16a61-6335-4394-aebd-18e43cbd22a8\") " pod="openshift-network-operator/iptables-alerter-x49m9"
May 28 09:31:30.046252 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.046136    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhpr9\" (UniqueName: \"kubernetes.io/projected/70d16a61-6335-4394-aebd-18e43cbd22a8-kube-api-access-xhpr9\") pod \"iptables-alerter-x49m9\" (UID: \"70d16a61-6335-4394-aebd-18e43cbd22a8\") " pod="openshift-network-operator/iptables-alerter-x49m9"
May 28 09:31:30.046252 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.046193    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/397304a8-87ab-49c0-9fc0-a3ca99f04032-run-systemd\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.046392 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.046265    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wg94z\""
May 28 09:31:30.046392 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.046336    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/397304a8-87ab-49c0-9fc0-a3ca99f04032-var-lib-openvswitch\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.046392 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.046381    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f12d790e-dc2c-4dec-b3a1-04e48182ae83-etc-modprobe-d\") pod \"tuned-rrxw4\" (UID: \"f12d790e-dc2c-4dec-b3a1-04e48182ae83\") " pod="openshift-cluster-node-tuning-operator/tuned-rrxw4"
May 28 09:31:30.046531 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.046405    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f12d790e-dc2c-4dec-b3a1-04e48182ae83-etc-kubernetes\") pod \"tuned-rrxw4\" (UID: \"f12d790e-dc2c-4dec-b3a1-04e48182ae83\") " pod="openshift-cluster-node-tuning-operator/tuned-rrxw4"
May 28 09:31:30.046531 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.046435    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/397304a8-87ab-49c0-9fc0-a3ca99f04032-log-socket\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.046531 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.046484    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/70d16a61-6335-4394-aebd-18e43cbd22a8-host-slash\") pod \"iptables-alerter-x49m9\" (UID: \"70d16a61-6335-4394-aebd-18e43cbd22a8\") " pod="openshift-network-operator/iptables-alerter-x49m9"
May 28 09:31:30.046531 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.046523    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/397304a8-87ab-49c0-9fc0-a3ca99f04032-systemd-units\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.046718 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.046554    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/397304a8-87ab-49c0-9fc0-a3ca99f04032-host-cni-netd\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.046966 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.046946    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/397304a8-87ab-49c0-9fc0-a3ca99f04032-ovnkube-config\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.047033 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.046983    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/397304a8-87ab-49c0-9fc0-a3ca99f04032-ovnkube-script-lib\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.047033 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.047005    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/50480aff-36b8-40f0-b169-d1b8a3c6d70d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f44r4\" (UID: \"50480aff-36b8-40f0-b169-d1b8a3c6d70d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f44r4"
May 28 09:31:30.047033 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.047025    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/50480aff-36b8-40f0-b169-d1b8a3c6d70d-socket-dir\") pod \"aws-ebs-csi-driver-node-f44r4\" (UID: \"50480aff-36b8-40f0-b169-d1b8a3c6d70d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f44r4"
May 28 09:31:30.047174 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.047044    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f12d790e-dc2c-4dec-b3a1-04e48182ae83-etc-tuned\") pod \"tuned-rrxw4\" (UID: \"f12d790e-dc2c-4dec-b3a1-04e48182ae83\") " pod="openshift-cluster-node-tuning-operator/tuned-rrxw4"
May 28 09:31:30.047174 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.047071    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/397304a8-87ab-49c0-9fc0-a3ca99f04032-host-kubelet\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.047174 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.047110    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/397304a8-87ab-49c0-9fc0-a3ca99f04032-host-slash\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.047174 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.047143    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/397304a8-87ab-49c0-9fc0-a3ca99f04032-host-run-ovn-kubernetes\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.047370 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.047172    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/397304a8-87ab-49c0-9fc0-a3ca99f04032-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.047370 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.047197    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a9e39b1c-78f9-4176-9dda-9464da6c6d4d-agent-certs\") pod \"konnectivity-agent-fswqv\" (UID: \"a9e39b1c-78f9-4176-9dda-9464da6c6d4d\") " pod="kube-system/konnectivity-agent-fswqv"
May 28 09:31:30.047370 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.047240    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/397304a8-87ab-49c0-9fc0-a3ca99f04032-host-run-netns\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.047370 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.047265    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8vtk\" (UniqueName: \"kubernetes.io/projected/50480aff-36b8-40f0-b169-d1b8a3c6d70d-kube-api-access-d8vtk\") pod \"aws-ebs-csi-driver-node-f44r4\" (UID: \"50480aff-36b8-40f0-b169-d1b8a3c6d70d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f44r4"
May 28 09:31:30.047646 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.047623    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.047774 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.047748    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pcp25"
May 28 09:31:30.050040 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.049959    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jgb2"
May 28 09:31:30.050040 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:30.050029    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jgb2" podUID="36d6c59d-f6ef-439d-8a97-58441ccdb9de"
May 28 09:31:30.050179 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.050046    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mx7gz\""
May 28 09:31:30.050399 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.050372    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 28 09:31:30.050481 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.050402    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 28 09:31:30.050481 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.050406    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 28 09:31:30.050481 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.050450    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-twwjm\""
May 28 09:31:30.050481 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.050473    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 28 09:31:30.051550 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.051503    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 28 09:31:30.051642 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.051506    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 28 09:31:30.052324 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.052304    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zg2lk"
May 28 09:31:30.054832 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.054814    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 28 09:31:30.054970 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.054954    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-kcs4p\""
May 28 09:31:30.055034 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.054954    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 28 09:31:30.137093 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.137074    2578 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 28 09:31:30.140115 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.140093    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 09:26:29 +0000 UTC" deadline="2028-02-14 18:35:13.435053266 +0000 UTC"
May 28 09:31:30.140115 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.140115    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15057h3m43.294940336s"
May 28 09:31:30.148340 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.148317    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f12d790e-dc2c-4dec-b3a1-04e48182ae83-etc-sysctl-conf\") pod \"tuned-rrxw4\" (UID: \"f12d790e-dc2c-4dec-b3a1-04e48182ae83\") " pod="openshift-cluster-node-tuning-operator/tuned-rrxw4"
May 28 09:31:30.148431 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.148355    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-snvgh\" (UniqueName: \"kubernetes.io/projected/36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74-kube-api-access-snvgh\") pod \"network-check-target-n442c\" (UID: \"36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74\") " pod="openshift-network-diagnostics/network-check-target-n442c"
May 28 09:31:30.148431 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.148375    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14998e85-5fb9-4268-8bfd-666f8ea4e771-etc-kubernetes\") pod \"multus-9qvc7\" (UID: \"14998e85-5fb9-4268-8bfd-666f8ea4e771\") " pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.148431 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.148393    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9b7b650a-16c7-4711-b774-2618ab6d17fd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pcp25\" (UID: \"9b7b650a-16c7-4711-b774-2618ab6d17fd\") " pod="openshift-multus/multus-additional-cni-plugins-pcp25"
May 28 09:31:30.148431 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.148415    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/397304a8-87ab-49c0-9fc0-a3ca99f04032-run-openvswitch\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.148611 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.148473    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/14998e85-5fb9-4268-8bfd-666f8ea4e771-host-var-lib-cni-bin\") pod \"multus-9qvc7\" (UID: \"14998e85-5fb9-4268-8bfd-666f8ea4e771\") " pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.148611 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.148501    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/397304a8-87ab-49c0-9fc0-a3ca99f04032-run-openvswitch\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.148611 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.148513    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9b7b650a-16c7-4711-b774-2618ab6d17fd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pcp25\" (UID: \"9b7b650a-16c7-4711-b774-2618ab6d17fd\") " pod="openshift-multus/multus-additional-cni-plugins-pcp25"
May 28 09:31:30.148611 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.148534    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f12d790e-dc2c-4dec-b3a1-04e48182ae83-etc-sysctl-conf\") pod \"tuned-rrxw4\" (UID: \"f12d790e-dc2c-4dec-b3a1-04e48182ae83\") " pod="openshift-cluster-node-tuning-operator/tuned-rrxw4"
May 28 09:31:30.148611 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.148547    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bm5h8\" (UniqueName: \"kubernetes.io/projected/f12d790e-dc2c-4dec-b3a1-04e48182ae83-kube-api-access-bm5h8\") pod \"tuned-rrxw4\" (UID: \"f12d790e-dc2c-4dec-b3a1-04e48182ae83\") " pod="openshift-cluster-node-tuning-operator/tuned-rrxw4"
May 28 09:31:30.148611 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.148576    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/50480aff-36b8-40f0-b169-d1b8a3c6d70d-registration-dir\") pod \"aws-ebs-csi-driver-node-f44r4\" (UID: \"50480aff-36b8-40f0-b169-d1b8a3c6d70d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f44r4"
May 28 09:31:30.148611 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.148603    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/50480aff-36b8-40f0-b169-d1b8a3c6d70d-device-dir\") pod \"aws-ebs-csi-driver-node-f44r4\" (UID: \"50480aff-36b8-40f0-b169-d1b8a3c6d70d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f44r4"
May 28 09:31:30.148952 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.148618    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/50480aff-36b8-40f0-b169-d1b8a3c6d70d-registration-dir\") pod \"aws-ebs-csi-driver-node-f44r4\" (UID: \"50480aff-36b8-40f0-b169-d1b8a3c6d70d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f44r4"
May 28 09:31:30.148952 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.148629    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e77da112-3527-431e-b09e-a5e7b1e6237a-host\") pod \"node-ca-nvjjz\" (UID: \"e77da112-3527-431e-b09e-a5e7b1e6237a\") " pod="openshift-image-registry/node-ca-nvjjz"
May 28 09:31:30.148952 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.148653    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/14998e85-5fb9-4268-8bfd-666f8ea4e771-multus-daemon-config\") pod \"multus-9qvc7\" (UID: \"14998e85-5fb9-4268-8bfd-666f8ea4e771\") " pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.148952 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.148660    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/50480aff-36b8-40f0-b169-d1b8a3c6d70d-device-dir\") pod \"aws-ebs-csi-driver-node-f44r4\" (UID: \"50480aff-36b8-40f0-b169-d1b8a3c6d70d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f44r4"
May 28 09:31:30.148952 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.148677    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/50480aff-36b8-40f0-b169-d1b8a3c6d70d-socket-dir\") pod \"aws-ebs-csi-driver-node-f44r4\" (UID: \"50480aff-36b8-40f0-b169-d1b8a3c6d70d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f44r4"
May 28 09:31:30.148952 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.148701    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xhpr9\" (UniqueName: \"kubernetes.io/projected/70d16a61-6335-4394-aebd-18e43cbd22a8-kube-api-access-xhpr9\") pod \"iptables-alerter-x49m9\" (UID: \"70d16a61-6335-4394-aebd-18e43cbd22a8\") " pod="openshift-network-operator/iptables-alerter-x49m9"
May 28 09:31:30.148952 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.148728    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/397304a8-87ab-49c0-9fc0-a3ca99f04032-var-lib-openvswitch\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.148952 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.148753    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/14998e85-5fb9-4268-8bfd-666f8ea4e771-host-run-netns\") pod \"multus-9qvc7\" (UID: \"14998e85-5fb9-4268-8bfd-666f8ea4e771\") " pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.148952 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.148769    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/50480aff-36b8-40f0-b169-d1b8a3c6d70d-socket-dir\") pod \"aws-ebs-csi-driver-node-f44r4\" (UID: \"50480aff-36b8-40f0-b169-d1b8a3c6d70d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f44r4"
May 28 09:31:30.148952 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.148776    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4ff7\" (UniqueName: \"kubernetes.io/projected/14998e85-5fb9-4268-8bfd-666f8ea4e771-kube-api-access-q4ff7\") pod \"multus-9qvc7\" (UID: \"14998e85-5fb9-4268-8bfd-666f8ea4e771\") " pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.148952 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.148809    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/397304a8-87ab-49c0-9fc0-a3ca99f04032-var-lib-openvswitch\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.148952 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.148816    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/70d16a61-6335-4394-aebd-18e43cbd22a8-host-slash\") pod \"iptables-alerter-x49m9\" (UID: \"70d16a61-6335-4394-aebd-18e43cbd22a8\") " pod="openshift-network-operator/iptables-alerter-x49m9"
May 28 09:31:30.148952 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.148847    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/397304a8-87ab-49c0-9fc0-a3ca99f04032-systemd-units\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.148952 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.148880    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/50480aff-36b8-40f0-b169-d1b8a3c6d70d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f44r4\" (UID: \"50480aff-36b8-40f0-b169-d1b8a3c6d70d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f44r4"
May 28 09:31:30.148952 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.148915    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r9vzg\" (UniqueName: \"kubernetes.io/projected/e77da112-3527-431e-b09e-a5e7b1e6237a-kube-api-access-r9vzg\") pod \"node-ca-nvjjz\" (UID: \"e77da112-3527-431e-b09e-a5e7b1e6237a\") " pod="openshift-image-registry/node-ca-nvjjz"
May 28 09:31:30.148952 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.148940    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/14998e85-5fb9-4268-8bfd-666f8ea4e771-host-run-k8s-cni-cncf-io\") pod \"multus-9qvc7\" (UID: \"14998e85-5fb9-4268-8bfd-666f8ea4e771\") " pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.148952 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.148945    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/397304a8-87ab-49c0-9fc0-a3ca99f04032-systemd-units\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.149685 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.148944    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/70d16a61-6335-4394-aebd-18e43cbd22a8-host-slash\") pod \"iptables-alerter-x49m9\" (UID: \"70d16a61-6335-4394-aebd-18e43cbd22a8\") " pod="openshift-network-operator/iptables-alerter-x49m9"
May 28 09:31:30.149685 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.148965    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14998e85-5fb9-4268-8bfd-666f8ea4e771-host-var-lib-kubelet\") pod \"multus-9qvc7\" (UID: \"14998e85-5fb9-4268-8bfd-666f8ea4e771\") " pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.149685 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.149003    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9g6s\" (UniqueName: \"kubernetes.io/projected/17ebbce7-58aa-49ef-8367-03b9d9f52618-kube-api-access-l9g6s\") pod \"node-resolver-zg2lk\" (UID: \"17ebbce7-58aa-49ef-8367-03b9d9f52618\") " pod="openshift-dns/node-resolver-zg2lk"
May 28 09:31:30.149685 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.149017    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/50480aff-36b8-40f0-b169-d1b8a3c6d70d-kubelet-dir\") pod \"aws-ebs-csi-driver-node-f44r4\" (UID: \"50480aff-36b8-40f0-b169-d1b8a3c6d70d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f44r4"
May 28 09:31:30.149685 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.149029    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/397304a8-87ab-49c0-9fc0-a3ca99f04032-host-kubelet\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.149685 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.149047    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a9e39b1c-78f9-4176-9dda-9464da6c6d4d-agent-certs\") pod \"konnectivity-agent-fswqv\" (UID: \"a9e39b1c-78f9-4176-9dda-9464da6c6d4d\") " pod="kube-system/konnectivity-agent-fswqv"
May 28 09:31:30.149685 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.149067    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14998e85-5fb9-4268-8bfd-666f8ea4e771-system-cni-dir\") pod \"multus-9qvc7\" (UID: \"14998e85-5fb9-4268-8bfd-666f8ea4e771\") " pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.149685 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.149067    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/397304a8-87ab-49c0-9fc0-a3ca99f04032-host-kubelet\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.149685 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.149081    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/14998e85-5fb9-4268-8bfd-666f8ea4e771-os-release\") pod \"multus-9qvc7\" (UID: \"14998e85-5fb9-4268-8bfd-666f8ea4e771\") " pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.149685 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.149095    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9b7b650a-16c7-4711-b774-2618ab6d17fd-os-release\") pod \"multus-additional-cni-plugins-pcp25\" (UID: \"9b7b650a-16c7-4711-b774-2618ab6d17fd\") " pod="openshift-multus/multus-additional-cni-plugins-pcp25"
May 28 09:31:30.149685 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.149112    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17ebbce7-58aa-49ef-8367-03b9d9f52618-tmp-dir\") pod \"node-resolver-zg2lk\" (UID: \"17ebbce7-58aa-49ef-8367-03b9d9f52618\") " pod="openshift-dns/node-resolver-zg2lk"
May 28 09:31:30.149685 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.149139    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f12d790e-dc2c-4dec-b3a1-04e48182ae83-etc-sysctl-d\") pod \"tuned-rrxw4\" (UID: \"f12d790e-dc2c-4dec-b3a1-04e48182ae83\") " pod="openshift-cluster-node-tuning-operator/tuned-rrxw4"
May 28 09:31:30.149685 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.149259    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f12d790e-dc2c-4dec-b3a1-04e48182ae83-etc-sysctl-d\") pod \"tuned-rrxw4\" (UID: \"f12d790e-dc2c-4dec-b3a1-04e48182ae83\") " pod="openshift-cluster-node-tuning-operator/tuned-rrxw4"
May 28 09:31:30.149685 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.149259    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f12d790e-dc2c-4dec-b3a1-04e48182ae83-tmp\") pod \"tuned-rrxw4\" (UID: \"f12d790e-dc2c-4dec-b3a1-04e48182ae83\") " pod="openshift-cluster-node-tuning-operator/tuned-rrxw4"
May 28 09:31:30.149685 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.149289    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/50480aff-36b8-40f0-b169-d1b8a3c6d70d-sys-fs\") pod \"aws-ebs-csi-driver-node-f44r4\" (UID: \"50480aff-36b8-40f0-b169-d1b8a3c6d70d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f44r4"
May 28 09:31:30.149685 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.149317    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/14998e85-5fb9-4268-8bfd-666f8ea4e771-multus-conf-dir\") pod \"multus-9qvc7\" (UID: \"14998e85-5fb9-4268-8bfd-666f8ea4e771\") " pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.149685 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.149342    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9b7b650a-16c7-4711-b774-2618ab6d17fd-cnibin\") pod \"multus-additional-cni-plugins-pcp25\" (UID: \"9b7b650a-16c7-4711-b774-2618ab6d17fd\") " pod="openshift-multus/multus-additional-cni-plugins-pcp25"
May 28 09:31:30.150361 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.149361    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/50480aff-36b8-40f0-b169-d1b8a3c6d70d-sys-fs\") pod \"aws-ebs-csi-driver-node-f44r4\" (UID: \"50480aff-36b8-40f0-b169-d1b8a3c6d70d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f44r4"
May 28 09:31:30.150361 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.149387    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/397304a8-87ab-49c0-9fc0-a3ca99f04032-run-ovn\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.150361 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.149414    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/397304a8-87ab-49c0-9fc0-a3ca99f04032-node-log\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.150361 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.149447    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/397304a8-87ab-49c0-9fc0-a3ca99f04032-run-ovn\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.150361 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.149440    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/397304a8-87ab-49c0-9fc0-a3ca99f04032-host-cni-bin\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.150361 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.149477    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/397304a8-87ab-49c0-9fc0-a3ca99f04032-node-log\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.150361 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.149486    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/397304a8-87ab-49c0-9fc0-a3ca99f04032-env-overrides\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.150361 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.149503    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/397304a8-87ab-49c0-9fc0-a3ca99f04032-host-cni-bin\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.150361 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.149443    2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 28 09:31:30.150361 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.149519    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dhn4h\" (UniqueName: \"kubernetes.io/projected/397304a8-87ab-49c0-9fc0-a3ca99f04032-kube-api-access-dhn4h\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.150361 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.149549    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a9e39b1c-78f9-4176-9dda-9464da6c6d4d-konnectivity-ca\") pod \"konnectivity-agent-fswqv\" (UID: \"a9e39b1c-78f9-4176-9dda-9464da6c6d4d\") " pod="kube-system/konnectivity-agent-fswqv"
May 28 09:31:30.150361 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.149572    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f12d790e-dc2c-4dec-b3a1-04e48182ae83-run\") pod \"tuned-rrxw4\" (UID: \"f12d790e-dc2c-4dec-b3a1-04e48182ae83\") " pod="openshift-cluster-node-tuning-operator/tuned-rrxw4"
May 28 09:31:30.150361 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.149599    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f12d790e-dc2c-4dec-b3a1-04e48182ae83-lib-modules\") pod \"tuned-rrxw4\" (UID: \"f12d790e-dc2c-4dec-b3a1-04e48182ae83\") " pod="openshift-cluster-node-tuning-operator/tuned-rrxw4"
May 28 09:31:30.150361 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.149626    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/397304a8-87ab-49c0-9fc0-a3ca99f04032-etc-openvswitch\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.150361 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.149658    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/397304a8-87ab-49c0-9fc0-a3ca99f04032-ovn-node-metrics-cert\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.150361 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.149689    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/14998e85-5fb9-4268-8bfd-666f8ea4e771-hostroot\") pod \"multus-9qvc7\" (UID: \"14998e85-5fb9-4268-8bfd-666f8ea4e771\") " pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.150361 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.149724    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jkck\" (UniqueName: \"kubernetes.io/projected/36d6c59d-f6ef-439d-8a97-58441ccdb9de-kube-api-access-9jkck\") pod \"network-metrics-daemon-4jgb2\" (UID: \"36d6c59d-f6ef-439d-8a97-58441ccdb9de\") " pod="openshift-multus/network-metrics-daemon-4jgb2"
May 28 09:31:30.150361 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.149750    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f12d790e-dc2c-4dec-b3a1-04e48182ae83-etc-sysconfig\") pod \"tuned-rrxw4\" (UID: \"f12d790e-dc2c-4dec-b3a1-04e48182ae83\") " pod="openshift-cluster-node-tuning-operator/tuned-rrxw4"
May 28 09:31:30.151150 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.149803    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f12d790e-dc2c-4dec-b3a1-04e48182ae83-host\") pod \"tuned-rrxw4\" (UID: \"f12d790e-dc2c-4dec-b3a1-04e48182ae83\") " pod="openshift-cluster-node-tuning-operator/tuned-rrxw4"
May 28 09:31:30.151150 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.149831    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9b7b650a-16c7-4711-b774-2618ab6d17fd-cni-binary-copy\") pod \"multus-additional-cni-plugins-pcp25\" (UID: \"9b7b650a-16c7-4711-b774-2618ab6d17fd\") " pod="openshift-multus/multus-additional-cni-plugins-pcp25"
May 28 09:31:30.151150 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.149839    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f12d790e-dc2c-4dec-b3a1-04e48182ae83-lib-modules\") pod \"tuned-rrxw4\" (UID: \"f12d790e-dc2c-4dec-b3a1-04e48182ae83\") " pod="openshift-cluster-node-tuning-operator/tuned-rrxw4"
May 28 09:31:30.151150 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.149859    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/397304a8-87ab-49c0-9fc0-a3ca99f04032-ovnkube-config\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.151150 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.149882    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e77da112-3527-431e-b09e-a5e7b1e6237a-serviceca\") pod \"node-ca-nvjjz\" (UID: \"e77da112-3527-431e-b09e-a5e7b1e6237a\") " pod="openshift-image-registry/node-ca-nvjjz"
May 28 09:31:30.151150 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.149911    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14998e85-5fb9-4268-8bfd-666f8ea4e771-multus-cni-dir\") pod \"multus-9qvc7\" (UID: \"14998e85-5fb9-4268-8bfd-666f8ea4e771\") " pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.151150 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.149932    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/14998e85-5fb9-4268-8bfd-666f8ea4e771-cnibin\") pod \"multus-9qvc7\" (UID: \"14998e85-5fb9-4268-8bfd-666f8ea4e771\") " pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.151150 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.150030    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/397304a8-87ab-49c0-9fc0-a3ca99f04032-env-overrides\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.151150 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.150053    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f12d790e-dc2c-4dec-b3a1-04e48182ae83-run\") pod \"tuned-rrxw4\" (UID: \"f12d790e-dc2c-4dec-b3a1-04e48182ae83\") " pod="openshift-cluster-node-tuning-operator/tuned-rrxw4"
May 28 09:31:30.151150 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.150062    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/70d16a61-6335-4394-aebd-18e43cbd22a8-iptables-alerter-script\") pod \"iptables-alerter-x49m9\" (UID: \"70d16a61-6335-4394-aebd-18e43cbd22a8\") " pod="openshift-network-operator/iptables-alerter-x49m9"
May 28 09:31:30.151150 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.150110    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f12d790e-dc2c-4dec-b3a1-04e48182ae83-host\") pod \"tuned-rrxw4\" (UID: \"f12d790e-dc2c-4dec-b3a1-04e48182ae83\") " pod="openshift-cluster-node-tuning-operator/tuned-rrxw4"
May 28 09:31:30.151150 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.150143    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/397304a8-87ab-49c0-9fc0-a3ca99f04032-run-systemd\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.151150 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.150191    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/397304a8-87ab-49c0-9fc0-a3ca99f04032-run-systemd\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.151150 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.150194    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/397304a8-87ab-49c0-9fc0-a3ca99f04032-etc-openvswitch\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.151150 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.150267    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f12d790e-dc2c-4dec-b3a1-04e48182ae83-etc-sysconfig\") pod \"tuned-rrxw4\" (UID: \"f12d790e-dc2c-4dec-b3a1-04e48182ae83\") " pod="openshift-cluster-node-tuning-operator/tuned-rrxw4"
May 28 09:31:30.151150 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.150268    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f12d790e-dc2c-4dec-b3a1-04e48182ae83-etc-modprobe-d\") pod \"tuned-rrxw4\" (UID: \"f12d790e-dc2c-4dec-b3a1-04e48182ae83\") " pod="openshift-cluster-node-tuning-operator/tuned-rrxw4"
May 28 09:31:30.151150 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.150387    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/397304a8-87ab-49c0-9fc0-a3ca99f04032-host-cni-netd\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.151150 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.150411    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a9e39b1c-78f9-4176-9dda-9464da6c6d4d-konnectivity-ca\") pod \"konnectivity-agent-fswqv\" (UID: \"a9e39b1c-78f9-4176-9dda-9464da6c6d4d\") " pod="kube-system/konnectivity-agent-fswqv"
May 28 09:31:30.151952 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.150462    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f12d790e-dc2c-4dec-b3a1-04e48182ae83-etc-modprobe-d\") pod \"tuned-rrxw4\" (UID: \"f12d790e-dc2c-4dec-b3a1-04e48182ae83\") " pod="openshift-cluster-node-tuning-operator/tuned-rrxw4"
May 28 09:31:30.151952 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.150575    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/397304a8-87ab-49c0-9fc0-a3ca99f04032-ovnkube-script-lib\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.151952 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.150627    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f12d790e-dc2c-4dec-b3a1-04e48182ae83-etc-kubernetes\") pod \"tuned-rrxw4\" (UID: \"f12d790e-dc2c-4dec-b3a1-04e48182ae83\") " pod="openshift-cluster-node-tuning-operator/tuned-rrxw4"
May 28 09:31:30.151952 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.150672    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/397304a8-87ab-49c0-9fc0-a3ca99f04032-log-socket\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.151952 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.150691    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/70d16a61-6335-4394-aebd-18e43cbd22a8-iptables-alerter-script\") pod \"iptables-alerter-x49m9\" (UID: \"70d16a61-6335-4394-aebd-18e43cbd22a8\") " pod="openshift-network-operator/iptables-alerter-x49m9"
May 28 09:31:30.151952 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.150716    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/14998e85-5fb9-4268-8bfd-666f8ea4e771-multus-socket-dir-parent\") pod \"multus-9qvc7\" (UID: \"14998e85-5fb9-4268-8bfd-666f8ea4e771\") " pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.151952 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.151418    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/397304a8-87ab-49c0-9fc0-a3ca99f04032-ovnkube-config\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.151952 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.151626    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/397304a8-87ab-49c0-9fc0-a3ca99f04032-ovnkube-script-lib\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.151952 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.151672    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/14998e85-5fb9-4268-8bfd-666f8ea4e771-host-run-multus-certs\") pod \"multus-9qvc7\" (UID: \"14998e85-5fb9-4268-8bfd-666f8ea4e771\") " pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.153155 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.152636    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/397304a8-87ab-49c0-9fc0-a3ca99f04032-host-cni-netd\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.153155 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.152655    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/397304a8-87ab-49c0-9fc0-a3ca99f04032-log-socket\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.153155 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.152646    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36d6c59d-f6ef-439d-8a97-58441ccdb9de-metrics-certs\") pod \"network-metrics-daemon-4jgb2\" (UID: \"36d6c59d-f6ef-439d-8a97-58441ccdb9de\") " pod="openshift-multus/network-metrics-daemon-4jgb2"
May 28 09:31:30.153155 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.152727    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f12d790e-dc2c-4dec-b3a1-04e48182ae83-etc-kubernetes\") pod \"tuned-rrxw4\" (UID: \"f12d790e-dc2c-4dec-b3a1-04e48182ae83\") " pod="openshift-cluster-node-tuning-operator/tuned-rrxw4"
May 28 09:31:30.153155 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.152782    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f12d790e-dc2c-4dec-b3a1-04e48182ae83-etc-tuned\") pod \"tuned-rrxw4\" (UID: \"f12d790e-dc2c-4dec-b3a1-04e48182ae83\") " pod="openshift-cluster-node-tuning-operator/tuned-rrxw4"
May 28 09:31:30.153155 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.152821    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/397304a8-87ab-49c0-9fc0-a3ca99f04032-host-slash\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.153155 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.152875    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/397304a8-87ab-49c0-9fc0-a3ca99f04032-host-run-ovn-kubernetes\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.153155 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.152919    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/397304a8-87ab-49c0-9fc0-a3ca99f04032-host-slash\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.153155 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.152938    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/397304a8-87ab-49c0-9fc0-a3ca99f04032-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.153155 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.152975    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/397304a8-87ab-49c0-9fc0-a3ca99f04032-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.153155 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.152988    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/14998e85-5fb9-4268-8bfd-666f8ea4e771-host-var-lib-cni-multus\") pod \"multus-9qvc7\" (UID: \"14998e85-5fb9-4268-8bfd-666f8ea4e771\") " pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.153155 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.153035    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9b7b650a-16c7-4711-b774-2618ab6d17fd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pcp25\" (UID: \"9b7b650a-16c7-4711-b774-2618ab6d17fd\") " pod="openshift-multus/multus-additional-cni-plugins-pcp25"
May 28 09:31:30.153155 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.153068    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4rhc\" (UniqueName: \"kubernetes.io/projected/9b7b650a-16c7-4711-b774-2618ab6d17fd-kube-api-access-f4rhc\") pod \"multus-additional-cni-plugins-pcp25\" (UID: \"9b7b650a-16c7-4711-b774-2618ab6d17fd\") " pod="openshift-multus/multus-additional-cni-plugins-pcp25"
May 28 09:31:30.153155 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.153120    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/397304a8-87ab-49c0-9fc0-a3ca99f04032-host-run-netns\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.153155 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.153121    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/397304a8-87ab-49c0-9fc0-a3ca99f04032-ovn-node-metrics-cert\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.153155 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.153159    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/397304a8-87ab-49c0-9fc0-a3ca99f04032-host-run-netns\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.153932 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.153212    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d8vtk\" (UniqueName: \"kubernetes.io/projected/50480aff-36b8-40f0-b169-d1b8a3c6d70d-kube-api-access-d8vtk\") pod \"aws-ebs-csi-driver-node-f44r4\" (UID: \"50480aff-36b8-40f0-b169-d1b8a3c6d70d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f44r4"
May 28 09:31:30.153932 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.153288    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/397304a8-87ab-49c0-9fc0-a3ca99f04032-host-run-ovn-kubernetes\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.153932 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.153300    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/14998e85-5fb9-4268-8bfd-666f8ea4e771-cni-binary-copy\") pod \"multus-9qvc7\" (UID: \"14998e85-5fb9-4268-8bfd-666f8ea4e771\") " pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.153932 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.153332    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9b7b650a-16c7-4711-b774-2618ab6d17fd-system-cni-dir\") pod \"multus-additional-cni-plugins-pcp25\" (UID: \"9b7b650a-16c7-4711-b774-2618ab6d17fd\") " pod="openshift-multus/multus-additional-cni-plugins-pcp25"
May 28 09:31:30.153932 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.153333    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f12d790e-dc2c-4dec-b3a1-04e48182ae83-tmp\") pod \"tuned-rrxw4\" (UID: \"f12d790e-dc2c-4dec-b3a1-04e48182ae83\") " pod="openshift-cluster-node-tuning-operator/tuned-rrxw4"
May 28 09:31:30.153932 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.153406    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/17ebbce7-58aa-49ef-8367-03b9d9f52618-hosts-file\") pod \"node-resolver-zg2lk\" (UID: \"17ebbce7-58aa-49ef-8367-03b9d9f52618\") " pod="openshift-dns/node-resolver-zg2lk"
May 28 09:31:30.153932 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.153477    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f12d790e-dc2c-4dec-b3a1-04e48182ae83-var-lib-kubelet\") pod \"tuned-rrxw4\" (UID: \"f12d790e-dc2c-4dec-b3a1-04e48182ae83\") " pod="openshift-cluster-node-tuning-operator/tuned-rrxw4"
May 28 09:31:30.153932 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.153505    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f12d790e-dc2c-4dec-b3a1-04e48182ae83-etc-systemd\") pod \"tuned-rrxw4\" (UID: \"f12d790e-dc2c-4dec-b3a1-04e48182ae83\") " pod="openshift-cluster-node-tuning-operator/tuned-rrxw4"
May 28 09:31:30.153932 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.153559    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f12d790e-dc2c-4dec-b3a1-04e48182ae83-sys\") pod \"tuned-rrxw4\" (UID: \"f12d790e-dc2c-4dec-b3a1-04e48182ae83\") " pod="openshift-cluster-node-tuning-operator/tuned-rrxw4"
May 28 09:31:30.153932 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.153597    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/50480aff-36b8-40f0-b169-d1b8a3c6d70d-etc-selinux\") pod \"aws-ebs-csi-driver-node-f44r4\" (UID: \"50480aff-36b8-40f0-b169-d1b8a3c6d70d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f44r4"
May 28 09:31:30.153932 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.153604    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a9e39b1c-78f9-4176-9dda-9464da6c6d4d-agent-certs\") pod \"konnectivity-agent-fswqv\" (UID: \"a9e39b1c-78f9-4176-9dda-9464da6c6d4d\") " pod="kube-system/konnectivity-agent-fswqv"
May 28 09:31:30.153932 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.153712    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f12d790e-dc2c-4dec-b3a1-04e48182ae83-etc-systemd\") pod \"tuned-rrxw4\" (UID: \"f12d790e-dc2c-4dec-b3a1-04e48182ae83\") " pod="openshift-cluster-node-tuning-operator/tuned-rrxw4"
May 28 09:31:30.153932 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.153764    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f12d790e-dc2c-4dec-b3a1-04e48182ae83-var-lib-kubelet\") pod \"tuned-rrxw4\" (UID: \"f12d790e-dc2c-4dec-b3a1-04e48182ae83\") " pod="openshift-cluster-node-tuning-operator/tuned-rrxw4"
May 28 09:31:30.153932 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.153792    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/50480aff-36b8-40f0-b169-d1b8a3c6d70d-etc-selinux\") pod \"aws-ebs-csi-driver-node-f44r4\" (UID: \"50480aff-36b8-40f0-b169-d1b8a3c6d70d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f44r4"
May 28 09:31:30.153932 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.153812    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f12d790e-dc2c-4dec-b3a1-04e48182ae83-sys\") pod \"tuned-rrxw4\" (UID: \"f12d790e-dc2c-4dec-b3a1-04e48182ae83\") " pod="openshift-cluster-node-tuning-operator/tuned-rrxw4"
May 28 09:31:30.155325 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.155272    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f12d790e-dc2c-4dec-b3a1-04e48182ae83-etc-tuned\") pod \"tuned-rrxw4\" (UID: \"f12d790e-dc2c-4dec-b3a1-04e48182ae83\") " pod="openshift-cluster-node-tuning-operator/tuned-rrxw4"
May 28 09:31:30.159104 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:30.159087    2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 09:31:30.159198 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:30.159108    2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 09:31:30.159198 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:30.159121    2578 projected.go:194] Error preparing data for projected volume kube-api-access-snvgh for pod openshift-network-diagnostics/network-check-target-n442c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 09:31:30.159303 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:30.159232    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74-kube-api-access-snvgh podName:36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74 nodeName:}" failed. No retries permitted until 2026-05-28 09:31:30.659186086 +0000 UTC m=+3.118931726 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-snvgh" (UniqueName: "kubernetes.io/projected/36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74-kube-api-access-snvgh") pod "network-check-target-n442c" (UID: "36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 09:31:30.161362 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.161341    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhpr9\" (UniqueName: \"kubernetes.io/projected/70d16a61-6335-4394-aebd-18e43cbd22a8-kube-api-access-xhpr9\") pod \"iptables-alerter-x49m9\" (UID: \"70d16a61-6335-4394-aebd-18e43cbd22a8\") " pod="openshift-network-operator/iptables-alerter-x49m9"
May 28 09:31:30.161711 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.161690    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bm5h8\" (UniqueName: \"kubernetes.io/projected/f12d790e-dc2c-4dec-b3a1-04e48182ae83-kube-api-access-bm5h8\") pod \"tuned-rrxw4\" (UID: \"f12d790e-dc2c-4dec-b3a1-04e48182ae83\") " pod="openshift-cluster-node-tuning-operator/tuned-rrxw4"
May 28 09:31:30.162164 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.162140    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhn4h\" (UniqueName: \"kubernetes.io/projected/397304a8-87ab-49c0-9fc0-a3ca99f04032-kube-api-access-dhn4h\") pod \"ovnkube-node-wqcwd\" (UID: \"397304a8-87ab-49c0-9fc0-a3ca99f04032\") " pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.162621 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.162601    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8vtk\" (UniqueName: \"kubernetes.io/projected/50480aff-36b8-40f0-b169-d1b8a3c6d70d-kube-api-access-d8vtk\") pod \"aws-ebs-csi-driver-node-f44r4\" (UID: \"50480aff-36b8-40f0-b169-d1b8a3c6d70d\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f44r4"
May 28 09:31:30.254296 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.254267    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/14998e85-5fb9-4268-8bfd-666f8ea4e771-host-var-lib-cni-bin\") pod \"multus-9qvc7\" (UID: \"14998e85-5fb9-4268-8bfd-666f8ea4e771\") " pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.254296 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.254299    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9b7b650a-16c7-4711-b774-2618ab6d17fd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pcp25\" (UID: \"9b7b650a-16c7-4711-b774-2618ab6d17fd\") " pod="openshift-multus/multus-additional-cni-plugins-pcp25"
May 28 09:31:30.254497 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.254326    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e77da112-3527-431e-b09e-a5e7b1e6237a-host\") pod \"node-ca-nvjjz\" (UID: \"e77da112-3527-431e-b09e-a5e7b1e6237a\") " pod="openshift-image-registry/node-ca-nvjjz"
May 28 09:31:30.254497 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.254350    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/14998e85-5fb9-4268-8bfd-666f8ea4e771-multus-daemon-config\") pod \"multus-9qvc7\" (UID: \"14998e85-5fb9-4268-8bfd-666f8ea4e771\") " pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.254497 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.254368    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/14998e85-5fb9-4268-8bfd-666f8ea4e771-host-run-netns\") pod \"multus-9qvc7\" (UID: \"14998e85-5fb9-4268-8bfd-666f8ea4e771\") " pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.254497 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.254381    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/14998e85-5fb9-4268-8bfd-666f8ea4e771-host-var-lib-cni-bin\") pod \"multus-9qvc7\" (UID: \"14998e85-5fb9-4268-8bfd-666f8ea4e771\") " pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.254497 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.254392    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e77da112-3527-431e-b09e-a5e7b1e6237a-host\") pod \"node-ca-nvjjz\" (UID: \"e77da112-3527-431e-b09e-a5e7b1e6237a\") " pod="openshift-image-registry/node-ca-nvjjz"
May 28 09:31:30.254497 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.254406    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/14998e85-5fb9-4268-8bfd-666f8ea4e771-host-run-netns\") pod \"multus-9qvc7\" (UID: \"14998e85-5fb9-4268-8bfd-666f8ea4e771\") " pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.254497 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.254430    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q4ff7\" (UniqueName: \"kubernetes.io/projected/14998e85-5fb9-4268-8bfd-666f8ea4e771-kube-api-access-q4ff7\") pod \"multus-9qvc7\" (UID: \"14998e85-5fb9-4268-8bfd-666f8ea4e771\") " pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.254497 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.254459    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r9vzg\" (UniqueName: \"kubernetes.io/projected/e77da112-3527-431e-b09e-a5e7b1e6237a-kube-api-access-r9vzg\") pod \"node-ca-nvjjz\" (UID: \"e77da112-3527-431e-b09e-a5e7b1e6237a\") " pod="openshift-image-registry/node-ca-nvjjz"
May 28 09:31:30.254497 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.254482    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/14998e85-5fb9-4268-8bfd-666f8ea4e771-host-run-k8s-cni-cncf-io\") pod \"multus-9qvc7\" (UID: \"14998e85-5fb9-4268-8bfd-666f8ea4e771\") " pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.254822 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.254503    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14998e85-5fb9-4268-8bfd-666f8ea4e771-host-var-lib-kubelet\") pod \"multus-9qvc7\" (UID: \"14998e85-5fb9-4268-8bfd-666f8ea4e771\") " pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.254822 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.254527    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l9g6s\" (UniqueName: \"kubernetes.io/projected/17ebbce7-58aa-49ef-8367-03b9d9f52618-kube-api-access-l9g6s\") pod \"node-resolver-zg2lk\" (UID: \"17ebbce7-58aa-49ef-8367-03b9d9f52618\") " pod="openshift-dns/node-resolver-zg2lk"
May 28 09:31:30.254822 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.254553    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14998e85-5fb9-4268-8bfd-666f8ea4e771-system-cni-dir\") pod \"multus-9qvc7\" (UID: \"14998e85-5fb9-4268-8bfd-666f8ea4e771\") " pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.254822 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.254575    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/14998e85-5fb9-4268-8bfd-666f8ea4e771-os-release\") pod \"multus-9qvc7\" (UID: \"14998e85-5fb9-4268-8bfd-666f8ea4e771\") " pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.254822 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.254592    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/14998e85-5fb9-4268-8bfd-666f8ea4e771-host-run-k8s-cni-cncf-io\") pod \"multus-9qvc7\" (UID: \"14998e85-5fb9-4268-8bfd-666f8ea4e771\") " pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.254822 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.254601    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9b7b650a-16c7-4711-b774-2618ab6d17fd-os-release\") pod \"multus-additional-cni-plugins-pcp25\" (UID: \"9b7b650a-16c7-4711-b774-2618ab6d17fd\") " pod="openshift-multus/multus-additional-cni-plugins-pcp25"
May 28 09:31:30.254822 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.254633    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17ebbce7-58aa-49ef-8367-03b9d9f52618-tmp-dir\") pod \"node-resolver-zg2lk\" (UID: \"17ebbce7-58aa-49ef-8367-03b9d9f52618\") " pod="openshift-dns/node-resolver-zg2lk"
May 28 09:31:30.254822 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.254657    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9b7b650a-16c7-4711-b774-2618ab6d17fd-os-release\") pod \"multus-additional-cni-plugins-pcp25\" (UID: \"9b7b650a-16c7-4711-b774-2618ab6d17fd\") " pod="openshift-multus/multus-additional-cni-plugins-pcp25"
May 28 09:31:30.254822 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.254660    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/14998e85-5fb9-4268-8bfd-666f8ea4e771-multus-conf-dir\") pod \"multus-9qvc7\" (UID: \"14998e85-5fb9-4268-8bfd-666f8ea4e771\") " pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.254822 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.254685    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9b7b650a-16c7-4711-b774-2618ab6d17fd-cnibin\") pod \"multus-additional-cni-plugins-pcp25\" (UID: \"9b7b650a-16c7-4711-b774-2618ab6d17fd\") " pod="openshift-multus/multus-additional-cni-plugins-pcp25"
May 28 09:31:30.254822 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.254724    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/14998e85-5fb9-4268-8bfd-666f8ea4e771-hostroot\") pod \"multus-9qvc7\" (UID: \"14998e85-5fb9-4268-8bfd-666f8ea4e771\") " pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.254822 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.254743    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14998e85-5fb9-4268-8bfd-666f8ea4e771-system-cni-dir\") pod \"multus-9qvc7\" (UID: \"14998e85-5fb9-4268-8bfd-666f8ea4e771\") " pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.254822 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.254770    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/14998e85-5fb9-4268-8bfd-666f8ea4e771-hostroot\") pod \"multus-9qvc7\" (UID: \"14998e85-5fb9-4268-8bfd-666f8ea4e771\") " pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.254822 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.254782    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/14998e85-5fb9-4268-8bfd-666f8ea4e771-os-release\") pod \"multus-9qvc7\" (UID: \"14998e85-5fb9-4268-8bfd-666f8ea4e771\") " pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.254822 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.254787    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14998e85-5fb9-4268-8bfd-666f8ea4e771-host-var-lib-kubelet\") pod \"multus-9qvc7\" (UID: \"14998e85-5fb9-4268-8bfd-666f8ea4e771\") " pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.254822 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.254813    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9jkck\" (UniqueName: \"kubernetes.io/projected/36d6c59d-f6ef-439d-8a97-58441ccdb9de-kube-api-access-9jkck\") pod \"network-metrics-daemon-4jgb2\" (UID: \"36d6c59d-f6ef-439d-8a97-58441ccdb9de\") " pod="openshift-multus/network-metrics-daemon-4jgb2"
May 28 09:31:30.255426 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.254809    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9b7b650a-16c7-4711-b774-2618ab6d17fd-cnibin\") pod \"multus-additional-cni-plugins-pcp25\" (UID: \"9b7b650a-16c7-4711-b774-2618ab6d17fd\") " pod="openshift-multus/multus-additional-cni-plugins-pcp25"
May 28 09:31:30.255426 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.254918    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9b7b650a-16c7-4711-b774-2618ab6d17fd-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pcp25\" (UID: \"9b7b650a-16c7-4711-b774-2618ab6d17fd\") " pod="openshift-multus/multus-additional-cni-plugins-pcp25"
May 28 09:31:30.255426 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.254937    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9b7b650a-16c7-4711-b774-2618ab6d17fd-cni-binary-copy\") pod \"multus-additional-cni-plugins-pcp25\" (UID: \"9b7b650a-16c7-4711-b774-2618ab6d17fd\") " pod="openshift-multus/multus-additional-cni-plugins-pcp25"
May 28 09:31:30.255426 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.254950    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/14998e85-5fb9-4268-8bfd-666f8ea4e771-multus-daemon-config\") pod \"multus-9qvc7\" (UID: \"14998e85-5fb9-4268-8bfd-666f8ea4e771\") " pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.255426 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.254939    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/17ebbce7-58aa-49ef-8367-03b9d9f52618-tmp-dir\") pod \"node-resolver-zg2lk\" (UID: \"17ebbce7-58aa-49ef-8367-03b9d9f52618\") " pod="openshift-dns/node-resolver-zg2lk"
May 28 09:31:30.255426 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.254962    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/14998e85-5fb9-4268-8bfd-666f8ea4e771-multus-conf-dir\") pod \"multus-9qvc7\" (UID: \"14998e85-5fb9-4268-8bfd-666f8ea4e771\") " pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.255426 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.255010    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e77da112-3527-431e-b09e-a5e7b1e6237a-serviceca\") pod \"node-ca-nvjjz\" (UID: \"e77da112-3527-431e-b09e-a5e7b1e6237a\") " pod="openshift-image-registry/node-ca-nvjjz"
May 28 09:31:30.255426 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.255048    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14998e85-5fb9-4268-8bfd-666f8ea4e771-multus-cni-dir\") pod \"multus-9qvc7\" (UID: \"14998e85-5fb9-4268-8bfd-666f8ea4e771\") " pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.255426 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.255073    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/14998e85-5fb9-4268-8bfd-666f8ea4e771-cnibin\") pod \"multus-9qvc7\" (UID: \"14998e85-5fb9-4268-8bfd-666f8ea4e771\") " pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.255426 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.255108    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/14998e85-5fb9-4268-8bfd-666f8ea4e771-multus-socket-dir-parent\") pod \"multus-9qvc7\" (UID: \"14998e85-5fb9-4268-8bfd-666f8ea4e771\") " pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.255426 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.255132    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/14998e85-5fb9-4268-8bfd-666f8ea4e771-host-run-multus-certs\") pod \"multus-9qvc7\" (UID: \"14998e85-5fb9-4268-8bfd-666f8ea4e771\") " pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.255426 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.255155    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36d6c59d-f6ef-439d-8a97-58441ccdb9de-metrics-certs\") pod \"network-metrics-daemon-4jgb2\" (UID: \"36d6c59d-f6ef-439d-8a97-58441ccdb9de\") " pod="openshift-multus/network-metrics-daemon-4jgb2"
May 28 09:31:30.255426 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.255157    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/14998e85-5fb9-4268-8bfd-666f8ea4e771-cnibin\") pod \"multus-9qvc7\" (UID: \"14998e85-5fb9-4268-8bfd-666f8ea4e771\") " pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.255426 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.255180    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/14998e85-5fb9-4268-8bfd-666f8ea4e771-host-var-lib-cni-multus\") pod \"multus-9qvc7\" (UID: \"14998e85-5fb9-4268-8bfd-666f8ea4e771\") " pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.255426 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.255201    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/14998e85-5fb9-4268-8bfd-666f8ea4e771-host-run-multus-certs\") pod \"multus-9qvc7\" (UID: \"14998e85-5fb9-4268-8bfd-666f8ea4e771\") " pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.255426 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.255209    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9b7b650a-16c7-4711-b774-2618ab6d17fd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pcp25\" (UID: \"9b7b650a-16c7-4711-b774-2618ab6d17fd\") " pod="openshift-multus/multus-additional-cni-plugins-pcp25"
May 28 09:31:30.255426 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.255249    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f4rhc\" (UniqueName: \"kubernetes.io/projected/9b7b650a-16c7-4711-b774-2618ab6d17fd-kube-api-access-f4rhc\") pod \"multus-additional-cni-plugins-pcp25\" (UID: \"9b7b650a-16c7-4711-b774-2618ab6d17fd\") " pod="openshift-multus/multus-additional-cni-plugins-pcp25"
May 28 09:31:30.255426 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.255254    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14998e85-5fb9-4268-8bfd-666f8ea4e771-multus-cni-dir\") pod \"multus-9qvc7\" (UID: \"14998e85-5fb9-4268-8bfd-666f8ea4e771\") " pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.256149 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.255261    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/14998e85-5fb9-4268-8bfd-666f8ea4e771-multus-socket-dir-parent\") pod \"multus-9qvc7\" (UID: \"14998e85-5fb9-4268-8bfd-666f8ea4e771\") " pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.256149 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.255288    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/14998e85-5fb9-4268-8bfd-666f8ea4e771-cni-binary-copy\") pod \"multus-9qvc7\" (UID: \"14998e85-5fb9-4268-8bfd-666f8ea4e771\") " pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.256149 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.255299    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/14998e85-5fb9-4268-8bfd-666f8ea4e771-host-var-lib-cni-multus\") pod \"multus-9qvc7\" (UID: \"14998e85-5fb9-4268-8bfd-666f8ea4e771\") " pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.256149 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.255319    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9b7b650a-16c7-4711-b774-2618ab6d17fd-system-cni-dir\") pod \"multus-additional-cni-plugins-pcp25\" (UID: \"9b7b650a-16c7-4711-b774-2618ab6d17fd\") " pod="openshift-multus/multus-additional-cni-plugins-pcp25"
May 28 09:31:30.256149 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.255345    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/17ebbce7-58aa-49ef-8367-03b9d9f52618-hosts-file\") pod \"node-resolver-zg2lk\" (UID: \"17ebbce7-58aa-49ef-8367-03b9d9f52618\") " pod="openshift-dns/node-resolver-zg2lk"
May 28 09:31:30.256149 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.255384    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14998e85-5fb9-4268-8bfd-666f8ea4e771-etc-kubernetes\") pod \"multus-9qvc7\" (UID: \"14998e85-5fb9-4268-8bfd-666f8ea4e771\") " pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.256149 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.255408    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9b7b650a-16c7-4711-b774-2618ab6d17fd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pcp25\" (UID: \"9b7b650a-16c7-4711-b774-2618ab6d17fd\") " pod="openshift-multus/multus-additional-cni-plugins-pcp25"
May 28 09:31:30.256149 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.255442    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e77da112-3527-431e-b09e-a5e7b1e6237a-serviceca\") pod \"node-ca-nvjjz\" (UID: \"e77da112-3527-431e-b09e-a5e7b1e6237a\") " pod="openshift-image-registry/node-ca-nvjjz"
May 28 09:31:30.256149 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.255443    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9b7b650a-16c7-4711-b774-2618ab6d17fd-cni-binary-copy\") pod \"multus-additional-cni-plugins-pcp25\" (UID: \"9b7b650a-16c7-4711-b774-2618ab6d17fd\") " pod="openshift-multus/multus-additional-cni-plugins-pcp25"
May 28 09:31:30.256149 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.255510    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14998e85-5fb9-4268-8bfd-666f8ea4e771-etc-kubernetes\") pod \"multus-9qvc7\" (UID: \"14998e85-5fb9-4268-8bfd-666f8ea4e771\") " pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.256149 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:30.255554    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 09:31:30.256149 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.255577    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9b7b650a-16c7-4711-b774-2618ab6d17fd-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pcp25\" (UID: \"9b7b650a-16c7-4711-b774-2618ab6d17fd\") " pod="openshift-multus/multus-additional-cni-plugins-pcp25"
May 28 09:31:30.256149 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.255606    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/17ebbce7-58aa-49ef-8367-03b9d9f52618-hosts-file\") pod \"node-resolver-zg2lk\" (UID: \"17ebbce7-58aa-49ef-8367-03b9d9f52618\") " pod="openshift-dns/node-resolver-zg2lk"
May 28 09:31:30.256149 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.255616    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9b7b650a-16c7-4711-b774-2618ab6d17fd-system-cni-dir\") pod \"multus-additional-cni-plugins-pcp25\" (UID: \"9b7b650a-16c7-4711-b774-2618ab6d17fd\") " pod="openshift-multus/multus-additional-cni-plugins-pcp25"
May 28 09:31:30.256149 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:30.255668    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36d6c59d-f6ef-439d-8a97-58441ccdb9de-metrics-certs podName:36d6c59d-f6ef-439d-8a97-58441ccdb9de nodeName:}" failed. No retries permitted until 2026-05-28 09:31:30.755644743 +0000 UTC m=+3.215390389 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36d6c59d-f6ef-439d-8a97-58441ccdb9de-metrics-certs") pod "network-metrics-daemon-4jgb2" (UID: "36d6c59d-f6ef-439d-8a97-58441ccdb9de") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 09:31:30.256149 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.255738    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9b7b650a-16c7-4711-b774-2618ab6d17fd-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pcp25\" (UID: \"9b7b650a-16c7-4711-b774-2618ab6d17fd\") " pod="openshift-multus/multus-additional-cni-plugins-pcp25"
May 28 09:31:30.256149 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.255930    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/14998e85-5fb9-4268-8bfd-666f8ea4e771-cni-binary-copy\") pod \"multus-9qvc7\" (UID: \"14998e85-5fb9-4268-8bfd-666f8ea4e771\") " pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.273310 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.273255    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4rhc\" (UniqueName: \"kubernetes.io/projected/9b7b650a-16c7-4711-b774-2618ab6d17fd-kube-api-access-f4rhc\") pod \"multus-additional-cni-plugins-pcp25\" (UID: \"9b7b650a-16c7-4711-b774-2618ab6d17fd\") " pod="openshift-multus/multus-additional-cni-plugins-pcp25"
May 28 09:31:30.273454 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.273430    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4ff7\" (UniqueName: \"kubernetes.io/projected/14998e85-5fb9-4268-8bfd-666f8ea4e771-kube-api-access-q4ff7\") pod \"multus-9qvc7\" (UID: \"14998e85-5fb9-4268-8bfd-666f8ea4e771\") " pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.273887 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.273863    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r9vzg\" (UniqueName: \"kubernetes.io/projected/e77da112-3527-431e-b09e-a5e7b1e6237a-kube-api-access-r9vzg\") pod \"node-ca-nvjjz\" (UID: \"e77da112-3527-431e-b09e-a5e7b1e6237a\") " pod="openshift-image-registry/node-ca-nvjjz"
May 28 09:31:30.274403 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.274386    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jkck\" (UniqueName: \"kubernetes.io/projected/36d6c59d-f6ef-439d-8a97-58441ccdb9de-kube-api-access-9jkck\") pod \"network-metrics-daemon-4jgb2\" (UID: \"36d6c59d-f6ef-439d-8a97-58441ccdb9de\") " pod="openshift-multus/network-metrics-daemon-4jgb2"
May 28 09:31:30.274596 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.274574    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9g6s\" (UniqueName: \"kubernetes.io/projected/17ebbce7-58aa-49ef-8367-03b9d9f52618-kube-api-access-l9g6s\") pod \"node-resolver-zg2lk\" (UID: \"17ebbce7-58aa-49ef-8367-03b9d9f52618\") " pod="openshift-dns/node-resolver-zg2lk"
May 28 09:31:30.339597 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.339567    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rrxw4"
May 28 09:31:30.349213 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.349195    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-x49m9"
May 28 09:31:30.358922 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.358903    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:30.364441 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.364423    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fswqv"
May 28 09:31:30.370956 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.370935    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f44r4"
May 28 09:31:30.377489 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.377471    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-nvjjz"
May 28 09:31:30.384082 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.384066    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-9qvc7"
May 28 09:31:30.390598 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.390580    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pcp25"
May 28 09:31:30.396101 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.396075    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zg2lk"
May 28 09:31:30.417814 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.417796    2578 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 09:31:30.617628 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:30.617594    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9e39b1c_78f9_4176_9dda_9464da6c6d4d.slice/crio-f407bd67e15db207c5c0b0d495cede4e3bbb1665a5af5e64825a4ee9d7e3b11f WatchSource:0}: Error finding container f407bd67e15db207c5c0b0d495cede4e3bbb1665a5af5e64825a4ee9d7e3b11f: Status 404 returned error can't find the container with id f407bd67e15db207c5c0b0d495cede4e3bbb1665a5af5e64825a4ee9d7e3b11f
May 28 09:31:30.618129 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:30.618086    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14998e85_5fb9_4268_8bfd_666f8ea4e771.slice/crio-3e141dc33cff5af6fd9111677907c898b29adf0fcd774c4143ddaf22f6072a25 WatchSource:0}: Error finding container 3e141dc33cff5af6fd9111677907c898b29adf0fcd774c4143ddaf22f6072a25: Status 404 returned error can't find the container with id 3e141dc33cff5af6fd9111677907c898b29adf0fcd774c4143ddaf22f6072a25
May 28 09:31:30.619158 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:30.619133    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf12d790e_dc2c_4dec_b3a1_04e48182ae83.slice/crio-67ce8413bd30b5d5922f8c21f0cd497a87e91cc2293fdb25d9292cc63ee73384 WatchSource:0}: Error finding container 67ce8413bd30b5d5922f8c21f0cd497a87e91cc2293fdb25d9292cc63ee73384: Status 404 returned error can't find the container with id 67ce8413bd30b5d5922f8c21f0cd497a87e91cc2293fdb25d9292cc63ee73384
May 28 09:31:30.620342 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:30.619948    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50480aff_36b8_40f0_b169_d1b8a3c6d70d.slice/crio-b792cc6535648710c24c2ceacbb4cdce40341d7a79de48121814fd7f62a7a89a WatchSource:0}: Error finding container b792cc6535648710c24c2ceacbb4cdce40341d7a79de48121814fd7f62a7a89a: Status 404 returned error can't find the container with id b792cc6535648710c24c2ceacbb4cdce40341d7a79de48121814fd7f62a7a89a
May 28 09:31:30.622288 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:30.622104    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod397304a8_87ab_49c0_9fc0_a3ca99f04032.slice/crio-143ec9bc2f75627be1acad09a962af391bb25379761f7ad779d6875dbf3ee411 WatchSource:0}: Error finding container 143ec9bc2f75627be1acad09a962af391bb25379761f7ad779d6875dbf3ee411: Status 404 returned error can't find the container with id 143ec9bc2f75627be1acad09a962af391bb25379761f7ad779d6875dbf3ee411
May 28 09:31:30.625068 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:30.625036    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70d16a61_6335_4394_aebd_18e43cbd22a8.slice/crio-6a44e296c20497d1d3c59f677b0ebf49721cf12126c65393d8512dddf7b92b15 WatchSource:0}: Error finding container 6a44e296c20497d1d3c59f677b0ebf49721cf12126c65393d8512dddf7b92b15: Status 404 returned error can't find the container with id 6a44e296c20497d1d3c59f677b0ebf49721cf12126c65393d8512dddf7b92b15
May 28 09:31:30.626447 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:30.626392    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b7b650a_16c7_4711_b774_2618ab6d17fd.slice/crio-7f7b83cdc2ed1f1c4fab982e9be99e5a56c4023c22752c20a8367edc5ae92aa3 WatchSource:0}: Error finding container 7f7b83cdc2ed1f1c4fab982e9be99e5a56c4023c22752c20a8367edc5ae92aa3: Status 404 returned error can't find the container with id 7f7b83cdc2ed1f1c4fab982e9be99e5a56c4023c22752c20a8367edc5ae92aa3
May 28 09:31:30.648415 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:31:30.648394    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode77da112_3527_431e_b09e_a5e7b1e6237a.slice/crio-87c3e300c868b6f5e768bf9be479c93990a75d3dc004cd99f668fa41d47e0fe8 WatchSource:0}: Error finding container 87c3e300c868b6f5e768bf9be479c93990a75d3dc004cd99f668fa41d47e0fe8: Status 404 returned error can't find the container with id 87c3e300c868b6f5e768bf9be479c93990a75d3dc004cd99f668fa41d47e0fe8
May 28 09:31:30.759237 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.759077    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-snvgh\" (UniqueName: \"kubernetes.io/projected/36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74-kube-api-access-snvgh\") pod \"network-check-target-n442c\" (UID: \"36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74\") " pod="openshift-network-diagnostics/network-check-target-n442c"
May 28 09:31:30.759237 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:30.759233    2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 09:31:30.759352 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:30.759250    2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 09:31:30.759352 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:30.759259    2578 projected.go:194] Error preparing data for projected volume kube-api-access-snvgh for pod openshift-network-diagnostics/network-check-target-n442c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 09:31:30.759352 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:30.759286    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36d6c59d-f6ef-439d-8a97-58441ccdb9de-metrics-certs\") pod \"network-metrics-daemon-4jgb2\" (UID: \"36d6c59d-f6ef-439d-8a97-58441ccdb9de\") " pod="openshift-multus/network-metrics-daemon-4jgb2"
May 28 09:31:30.759352 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:30.759295    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74-kube-api-access-snvgh podName:36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74 nodeName:}" failed. No retries permitted until 2026-05-28 09:31:31.75928162 +0000 UTC m=+4.219027243 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-snvgh" (UniqueName: "kubernetes.io/projected/36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74-kube-api-access-snvgh") pod "network-check-target-n442c" (UID: "36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 09:31:30.759352 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:30.759349    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 09:31:30.759498 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:30.759390    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36d6c59d-f6ef-439d-8a97-58441ccdb9de-metrics-certs podName:36d6c59d-f6ef-439d-8a97-58441ccdb9de nodeName:}" failed. No retries permitted until 2026-05-28 09:31:31.75937636 +0000 UTC m=+4.219121983 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36d6c59d-f6ef-439d-8a97-58441ccdb9de-metrics-certs") pod "network-metrics-daemon-4jgb2" (UID: "36d6c59d-f6ef-439d-8a97-58441ccdb9de") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 09:31:31.101679 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:31.101649    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n442c"
May 28 09:31:31.102211 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:31.101780    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n442c" podUID="36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74"
May 28 09:31:31.109825 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:31.109796    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pcp25" event={"ID":"9b7b650a-16c7-4711-b774-2618ab6d17fd","Type":"ContainerStarted","Data":"7f7b83cdc2ed1f1c4fab982e9be99e5a56c4023c22752c20a8367edc5ae92aa3"}
May 28 09:31:31.111082 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:31.111015    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x49m9" event={"ID":"70d16a61-6335-4394-aebd-18e43cbd22a8","Type":"ContainerStarted","Data":"6a44e296c20497d1d3c59f677b0ebf49721cf12126c65393d8512dddf7b92b15"}
May 28 09:31:31.113677 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:31.113651    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9qvc7" event={"ID":"14998e85-5fb9-4268-8bfd-666f8ea4e771","Type":"ContainerStarted","Data":"3e141dc33cff5af6fd9111677907c898b29adf0fcd774c4143ddaf22f6072a25"}
May 28 09:31:31.114907 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:31.114884    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zg2lk" event={"ID":"17ebbce7-58aa-49ef-8367-03b9d9f52618","Type":"ContainerStarted","Data":"8d8275a8cf6635ed948b5b9180b1d1cc1ba31be0b03885900f8e0a53a912a675"}
May 28 09:31:31.116090 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:31.116066    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f44r4" event={"ID":"50480aff-36b8-40f0-b169-d1b8a3c6d70d","Type":"ContainerStarted","Data":"b792cc6535648710c24c2ceacbb4cdce40341d7a79de48121814fd7f62a7a89a"}
May 28 09:31:31.117361 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:31.117314    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rrxw4" event={"ID":"f12d790e-dc2c-4dec-b3a1-04e48182ae83","Type":"ContainerStarted","Data":"67ce8413bd30b5d5922f8c21f0cd497a87e91cc2293fdb25d9292cc63ee73384"}
May 28 09:31:31.119195 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:31.119149    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fswqv" event={"ID":"a9e39b1c-78f9-4176-9dda-9464da6c6d4d","Type":"ContainerStarted","Data":"f407bd67e15db207c5c0b0d495cede4e3bbb1665a5af5e64825a4ee9d7e3b11f"}
May 28 09:31:31.122259 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:31.122098    2578 generic.go:358] "Generic (PLEG): container finished" podID="43e1caf191e8432918e21aec4ad05186" containerID="d083eee82a2643092e02656a11440f439ccb2884c508ac4b940fca891482806d" exitCode=0
May 28 09:31:31.122259 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:31.122171    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-49.ec2.internal" event={"ID":"43e1caf191e8432918e21aec4ad05186","Type":"ContainerDied","Data":"d083eee82a2643092e02656a11440f439ccb2884c508ac4b940fca891482806d"}
May 28 09:31:31.124486 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:31.124446    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nvjjz" event={"ID":"e77da112-3527-431e-b09e-a5e7b1e6237a","Type":"ContainerStarted","Data":"87c3e300c868b6f5e768bf9be479c93990a75d3dc004cd99f668fa41d47e0fe8"}
May 28 09:31:31.126820 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:31.126650    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd" event={"ID":"397304a8-87ab-49c0-9fc0-a3ca99f04032","Type":"ContainerStarted","Data":"143ec9bc2f75627be1acad09a962af391bb25379761f7ad779d6875dbf3ee411"}
May 28 09:31:31.129518 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:31.129140    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-49.ec2.internal" event={"ID":"1f961dde9f6169a438d2aee717de7ec2","Type":"ContainerStarted","Data":"96d72aaa105c63c937a44d4cfa84fd2b024724515779a1a783e5da86c3226969"}
May 28 09:31:31.140435 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:31.140373    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 09:26:29 +0000 UTC" deadline="2028-01-21 06:56:14.109569492 +0000 UTC"
May 28 09:31:31.140435 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:31.140410    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14469h24m42.969163011s"
May 28 09:31:31.152441 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:31.151876    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-49.ec2.internal" podStartSLOduration=2.151861242 podStartE2EDuration="2.151861242s" podCreationTimestamp="2026-05-28 09:31:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 09:31:31.151585575 +0000 UTC m=+3.611331220" watchObservedRunningTime="2026-05-28 09:31:31.151861242 +0000 UTC m=+3.611606889"
May 28 09:31:31.767401 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:31.767353    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-snvgh\" (UniqueName: \"kubernetes.io/projected/36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74-kube-api-access-snvgh\") pod \"network-check-target-n442c\" (UID: \"36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74\") " pod="openshift-network-diagnostics/network-check-target-n442c"
May 28 09:31:31.767587 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:31.767439    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36d6c59d-f6ef-439d-8a97-58441ccdb9de-metrics-certs\") pod \"network-metrics-daemon-4jgb2\" (UID: \"36d6c59d-f6ef-439d-8a97-58441ccdb9de\") " pod="openshift-multus/network-metrics-daemon-4jgb2"
May 28 09:31:31.767587 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:31.767564    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 09:31:31.767714 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:31.767626    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36d6c59d-f6ef-439d-8a97-58441ccdb9de-metrics-certs podName:36d6c59d-f6ef-439d-8a97-58441ccdb9de nodeName:}" failed. No retries permitted until 2026-05-28 09:31:33.767607088 +0000 UTC m=+6.227352721 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36d6c59d-f6ef-439d-8a97-58441ccdb9de-metrics-certs") pod "network-metrics-daemon-4jgb2" (UID: "36d6c59d-f6ef-439d-8a97-58441ccdb9de") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 09:31:31.768072 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:31.768056    2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 09:31:31.768133 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:31.768078    2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 09:31:31.768133 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:31.768092    2578 projected.go:194] Error preparing data for projected volume kube-api-access-snvgh for pod openshift-network-diagnostics/network-check-target-n442c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 09:31:31.768241 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:31.768145    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74-kube-api-access-snvgh podName:36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74 nodeName:}" failed. No retries permitted until 2026-05-28 09:31:33.768130959 +0000 UTC m=+6.227876590 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-snvgh" (UniqueName: "kubernetes.io/projected/36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74-kube-api-access-snvgh") pod "network-check-target-n442c" (UID: "36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 09:31:32.103309 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:32.103202    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jgb2"
May 28 09:31:32.103747 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:32.103343    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jgb2" podUID="36d6c59d-f6ef-439d-8a97-58441ccdb9de"
May 28 09:31:32.147320 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:32.147276    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-49.ec2.internal" event={"ID":"43e1caf191e8432918e21aec4ad05186","Type":"ContainerStarted","Data":"bff9bf10a3469b72c420dc2a19e5c2bb4eb7583a4096d7d9ddf297b40951ce19"}
May 28 09:31:33.100969 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:33.100938    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n442c"
May 28 09:31:33.101135 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:33.101061    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n442c" podUID="36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74"
May 28 09:31:33.785342 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:33.785309    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-snvgh\" (UniqueName: \"kubernetes.io/projected/36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74-kube-api-access-snvgh\") pod \"network-check-target-n442c\" (UID: \"36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74\") " pod="openshift-network-diagnostics/network-check-target-n442c"
May 28 09:31:33.785813 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:33.785384    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36d6c59d-f6ef-439d-8a97-58441ccdb9de-metrics-certs\") pod \"network-metrics-daemon-4jgb2\" (UID: \"36d6c59d-f6ef-439d-8a97-58441ccdb9de\") " pod="openshift-multus/network-metrics-daemon-4jgb2"
May 28 09:31:33.785813 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:33.785489    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 09:31:33.785813 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:33.785546    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36d6c59d-f6ef-439d-8a97-58441ccdb9de-metrics-certs podName:36d6c59d-f6ef-439d-8a97-58441ccdb9de nodeName:}" failed. No retries permitted until 2026-05-28 09:31:37.785526933 +0000 UTC m=+10.245272563 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36d6c59d-f6ef-439d-8a97-58441ccdb9de-metrics-certs") pod "network-metrics-daemon-4jgb2" (UID: "36d6c59d-f6ef-439d-8a97-58441ccdb9de") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 09:31:33.786013 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:33.785935    2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 09:31:33.786013 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:33.785955    2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 09:31:33.786013 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:33.785966    2578 projected.go:194] Error preparing data for projected volume kube-api-access-snvgh for pod openshift-network-diagnostics/network-check-target-n442c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 09:31:33.786013 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:33.786013    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74-kube-api-access-snvgh podName:36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74 nodeName:}" failed. No retries permitted until 2026-05-28 09:31:37.785996688 +0000 UTC m=+10.245742312 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-snvgh" (UniqueName: "kubernetes.io/projected/36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74-kube-api-access-snvgh") pod "network-check-target-n442c" (UID: "36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 09:31:34.101195 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:34.101120    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jgb2"
May 28 09:31:34.101366 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:34.101265    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jgb2" podUID="36d6c59d-f6ef-439d-8a97-58441ccdb9de"
May 28 09:31:35.100811 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:35.100778    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n442c"
May 28 09:31:35.101295 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:35.100907    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n442c" podUID="36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74"
May 28 09:31:36.101215 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:36.101172    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jgb2"
May 28 09:31:36.101673 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:36.101331    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jgb2" podUID="36d6c59d-f6ef-439d-8a97-58441ccdb9de"
May 28 09:31:37.101618 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:37.101411    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n442c"
May 28 09:31:37.101618 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:37.101543    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n442c" podUID="36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74"
May 28 09:31:37.813899 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:37.813586    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36d6c59d-f6ef-439d-8a97-58441ccdb9de-metrics-certs\") pod \"network-metrics-daemon-4jgb2\" (UID: \"36d6c59d-f6ef-439d-8a97-58441ccdb9de\") " pod="openshift-multus/network-metrics-daemon-4jgb2"
May 28 09:31:37.813899 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:37.813646    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-snvgh\" (UniqueName: \"kubernetes.io/projected/36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74-kube-api-access-snvgh\") pod \"network-check-target-n442c\" (UID: \"36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74\") " pod="openshift-network-diagnostics/network-check-target-n442c"
May 28 09:31:37.813899 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:37.813734    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 09:31:37.813899 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:37.813791    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36d6c59d-f6ef-439d-8a97-58441ccdb9de-metrics-certs podName:36d6c59d-f6ef-439d-8a97-58441ccdb9de nodeName:}" failed. No retries permitted until 2026-05-28 09:31:45.8137771 +0000 UTC m=+18.273522723 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36d6c59d-f6ef-439d-8a97-58441ccdb9de-metrics-certs") pod "network-metrics-daemon-4jgb2" (UID: "36d6c59d-f6ef-439d-8a97-58441ccdb9de") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 09:31:37.813899 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:37.813800    2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 09:31:37.813899 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:37.813815    2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 09:31:37.813899 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:37.813828    2578 projected.go:194] Error preparing data for projected volume kube-api-access-snvgh for pod openshift-network-diagnostics/network-check-target-n442c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 09:31:37.813899 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:37.813873    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74-kube-api-access-snvgh podName:36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74 nodeName:}" failed. No retries permitted until 2026-05-28 09:31:45.813859041 +0000 UTC m=+18.273604672 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-snvgh" (UniqueName: "kubernetes.io/projected/36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74-kube-api-access-snvgh") pod "network-check-target-n442c" (UID: "36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 09:31:38.102095 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:38.102028    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jgb2"
May 28 09:31:38.102530 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:38.102154    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jgb2" podUID="36d6c59d-f6ef-439d-8a97-58441ccdb9de"
May 28 09:31:39.101576 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:39.101536    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n442c"
May 28 09:31:39.101885 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:39.101655    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n442c" podUID="36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74"
May 28 09:31:40.101453 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:40.101420    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jgb2"
May 28 09:31:40.101904 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:40.101537    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jgb2" podUID="36d6c59d-f6ef-439d-8a97-58441ccdb9de"
May 28 09:31:41.101163 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:41.101123    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n442c"
May 28 09:31:41.101328 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:41.101259    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n442c" podUID="36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74"
May 28 09:31:42.101337 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:42.101304    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jgb2"
May 28 09:31:42.101710 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:42.101426    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jgb2" podUID="36d6c59d-f6ef-439d-8a97-58441ccdb9de"
May 28 09:31:43.101422 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:43.101388    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n442c"
May 28 09:31:43.101758 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:43.101510    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n442c" podUID="36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74"
May 28 09:31:44.101797 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:44.101770    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jgb2"
May 28 09:31:44.102174 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:44.101897    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jgb2" podUID="36d6c59d-f6ef-439d-8a97-58441ccdb9de"
May 28 09:31:45.101322 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:45.101290    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n442c"
May 28 09:31:45.101549 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:45.101413    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n442c" podUID="36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74"
May 28 09:31:45.877657 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:45.877624    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36d6c59d-f6ef-439d-8a97-58441ccdb9de-metrics-certs\") pod \"network-metrics-daemon-4jgb2\" (UID: \"36d6c59d-f6ef-439d-8a97-58441ccdb9de\") " pod="openshift-multus/network-metrics-daemon-4jgb2"
May 28 09:31:45.878083 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:45.877681    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-snvgh\" (UniqueName: \"kubernetes.io/projected/36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74-kube-api-access-snvgh\") pod \"network-check-target-n442c\" (UID: \"36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74\") " pod="openshift-network-diagnostics/network-check-target-n442c"
May 28 09:31:45.878083 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:45.877771    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 09:31:45.878083 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:45.877801    2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 09:31:45.878083 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:45.877824    2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 09:31:45.878083 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:45.877835    2578 projected.go:194] Error preparing data for projected volume kube-api-access-snvgh for pod openshift-network-diagnostics/network-check-target-n442c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 09:31:45.878083 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:45.877840    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36d6c59d-f6ef-439d-8a97-58441ccdb9de-metrics-certs podName:36d6c59d-f6ef-439d-8a97-58441ccdb9de nodeName:}" failed. No retries permitted until 2026-05-28 09:32:01.877819876 +0000 UTC m=+34.337565500 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36d6c59d-f6ef-439d-8a97-58441ccdb9de-metrics-certs") pod "network-metrics-daemon-4jgb2" (UID: "36d6c59d-f6ef-439d-8a97-58441ccdb9de") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 09:31:45.878083 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:45.877882    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74-kube-api-access-snvgh podName:36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74 nodeName:}" failed. No retries permitted until 2026-05-28 09:32:01.877867074 +0000 UTC m=+34.337612698 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-snvgh" (UniqueName: "kubernetes.io/projected/36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74-kube-api-access-snvgh") pod "network-check-target-n442c" (UID: "36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 09:31:46.101198 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:46.101164    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jgb2"
May 28 09:31:46.101377 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:46.101317    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jgb2" podUID="36d6c59d-f6ef-439d-8a97-58441ccdb9de"
May 28 09:31:47.100758 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:47.100724    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n442c"
May 28 09:31:47.101146 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:47.100826    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n442c" podUID="36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74"
May 28 09:31:48.102407 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:48.102375    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jgb2"
May 28 09:31:48.102848 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:48.102472    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jgb2" podUID="36d6c59d-f6ef-439d-8a97-58441ccdb9de"
May 28 09:31:49.101611 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:49.101325    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n442c"
May 28 09:31:49.101611 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:49.101578    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n442c" podUID="36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74"
May 28 09:31:49.177626 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:49.177598    2578 generic.go:358] "Generic (PLEG): container finished" podID="9b7b650a-16c7-4711-b774-2618ab6d17fd" containerID="d7ba8d5830e62b4448f0e25a31143d1108247bef1ef8dec303f534ab19cd8725" exitCode=0
May 28 09:31:49.178145 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:49.177676    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pcp25" event={"ID":"9b7b650a-16c7-4711-b774-2618ab6d17fd","Type":"ContainerDied","Data":"d7ba8d5830e62b4448f0e25a31143d1108247bef1ef8dec303f534ab19cd8725"}
May 28 09:31:49.181389 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:49.181248    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-9qvc7" event={"ID":"14998e85-5fb9-4268-8bfd-666f8ea4e771","Type":"ContainerStarted","Data":"06623aade75e347fd958871d44c25f6efb58c2817e72962cde21b64d0f523919"}
May 28 09:31:49.184041 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:49.184017    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zg2lk" event={"ID":"17ebbce7-58aa-49ef-8367-03b9d9f52618","Type":"ContainerStarted","Data":"69c3331cd0db094701ff0cbf88adbb28faec8825f4f9d1be2b98eaa8f8eba842"}
May 28 09:31:49.186156 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:49.186134    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f44r4" event={"ID":"50480aff-36b8-40f0-b169-d1b8a3c6d70d","Type":"ContainerStarted","Data":"1792024574dc7b201b0849ef49cc1f1afcccb42746fca0af5ca7ff9177790e78"}
May 28 09:31:49.187523 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:49.187502    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rrxw4" event={"ID":"f12d790e-dc2c-4dec-b3a1-04e48182ae83","Type":"ContainerStarted","Data":"075c14d0adbe55c4616c6d9d07e1854a9f9503fa8a73c89e3eb5246120ac4232"}
May 28 09:31:49.189526 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:49.189508    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fswqv" event={"ID":"a9e39b1c-78f9-4176-9dda-9464da6c6d4d","Type":"ContainerStarted","Data":"798fb705ab2e0dc072aa5148bb5e6b031a6dff974c3ba69025ed1fab552c4dc8"}
May 28 09:31:49.190459 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:49.190439    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-nvjjz" event={"ID":"e77da112-3527-431e-b09e-a5e7b1e6237a","Type":"ContainerStarted","Data":"637d5ade5475a80e8585466101ea37cd9be3c0ce7182d9bd4875c0c7496b3544"}
May 28 09:31:49.202692 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:49.202656    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-49.ec2.internal" podStartSLOduration=20.202646587 podStartE2EDuration="20.202646587s" podCreationTimestamp="2026-05-28 09:31:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 09:31:32.162464746 +0000 UTC m=+4.622210392" watchObservedRunningTime="2026-05-28 09:31:49.202646587 +0000 UTC m=+21.662392228"
May 28 09:31:49.214503 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:49.214462    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-nvjjz" podStartSLOduration=3.422971515 podStartE2EDuration="21.214449686s" podCreationTimestamp="2026-05-28 09:31:28 +0000 UTC" firstStartedPulling="2026-05-28 09:31:30.650273718 +0000 UTC m=+3.110019342" lastFinishedPulling="2026-05-28 09:31:48.441751886 +0000 UTC m=+20.901497513" observedRunningTime="2026-05-28 09:31:49.214429044 +0000 UTC m=+21.674174691" watchObservedRunningTime="2026-05-28 09:31:49.214449686 +0000 UTC m=+21.674195335"
May 28 09:31:49.236498 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:49.236461    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rrxw4" podStartSLOduration=3.387417169 podStartE2EDuration="21.236450544s" podCreationTimestamp="2026-05-28 09:31:28 +0000 UTC" firstStartedPulling="2026-05-28 09:31:30.621277892 +0000 UTC m=+3.081023529" lastFinishedPulling="2026-05-28 09:31:48.470311275 +0000 UTC m=+20.930056904" observedRunningTime="2026-05-28 09:31:49.236281878 +0000 UTC m=+21.696027525" watchObservedRunningTime="2026-05-28 09:31:49.236450544 +0000 UTC m=+21.696196190"
May 28 09:31:49.255908 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:49.255870    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-9qvc7" podStartSLOduration=3.113106828 podStartE2EDuration="21.255856002s" podCreationTimestamp="2026-05-28 09:31:28 +0000 UTC" firstStartedPulling="2026-05-28 09:31:30.62003834 +0000 UTC m=+3.079783979" lastFinishedPulling="2026-05-28 09:31:48.762787514 +0000 UTC m=+21.222533153" observedRunningTime="2026-05-28 09:31:49.255348149 +0000 UTC m=+21.715093795" watchObservedRunningTime="2026-05-28 09:31:49.255856002 +0000 UTC m=+21.715601648"
May 28 09:31:49.316093 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:49.316045    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-zg2lk" podStartSLOduration=3.464116442 podStartE2EDuration="21.31603001s" podCreationTimestamp="2026-05-28 09:31:28 +0000 UTC" firstStartedPulling="2026-05-28 09:31:30.623365809 +0000 UTC m=+3.083111432" lastFinishedPulling="2026-05-28 09:31:48.475279376 +0000 UTC m=+20.935025000" observedRunningTime="2026-05-28 09:31:49.288261607 +0000 UTC m=+21.748007296" watchObservedRunningTime="2026-05-28 09:31:49.31603001 +0000 UTC m=+21.775775656"
May 28 09:31:49.316494 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:49.316465    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fswqv" podStartSLOduration=3.49407618 podStartE2EDuration="21.316454771s" podCreationTimestamp="2026-05-28 09:31:28 +0000 UTC" firstStartedPulling="2026-05-28 09:31:30.619299671 +0000 UTC m=+3.079045310" lastFinishedPulling="2026-05-28 09:31:48.441678262 +0000 UTC m=+20.901423901" observedRunningTime="2026-05-28 09:31:49.316169708 +0000 UTC m=+21.775915352" watchObservedRunningTime="2026-05-28 09:31:49.316454771 +0000 UTC m=+21.776200418"
May 28 09:31:49.879400 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:49.879177    2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 28 09:31:50.101777 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:50.101750    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jgb2"
May 28 09:31:50.101945 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:50.101862    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jgb2" podUID="36d6c59d-f6ef-439d-8a97-58441ccdb9de"
May 28 09:31:50.104682 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:50.104601    2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-28T09:31:49.879393508Z","UUID":"532b3f5c-e3d6-4773-9e6e-84515aba867d","Handler":null,"Name":"","Endpoint":""}
May 28 09:31:50.107705 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:50.107623    2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 28 09:31:50.107705 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:50.107671    2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 28 09:31:50.187616 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:50.187586    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fswqv"
May 28 09:31:50.188263 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:50.188247    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fswqv"
May 28 09:31:50.193866 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:50.193804    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-x49m9" event={"ID":"70d16a61-6335-4394-aebd-18e43cbd22a8","Type":"ContainerStarted","Data":"35e0206bafac64b99325177f40afd19ca4eb62b8beeb20e27a3353436df7afdd"}
May 28 09:31:50.195529 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:50.195507    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f44r4" event={"ID":"50480aff-36b8-40f0-b169-d1b8a3c6d70d","Type":"ContainerStarted","Data":"4e4c86e57f41037f4431aad0dd3ddbb89ce53b31d0c05a099f9ad8f5dfbacfd8"}
May 28 09:31:50.198282 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:50.198260    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wqcwd_397304a8-87ab-49c0-9fc0-a3ca99f04032/ovn-acl-logging/0.log"
May 28 09:31:50.198645 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:50.198625    2578 generic.go:358] "Generic (PLEG): container finished" podID="397304a8-87ab-49c0-9fc0-a3ca99f04032" containerID="c9fedd25fe09e69ffc94411c991b7c3597914d02b828d6e4339732ec1c2d4daa" exitCode=1
May 28 09:31:50.198792 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:50.198755    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd" event={"ID":"397304a8-87ab-49c0-9fc0-a3ca99f04032","Type":"ContainerStarted","Data":"b50863b28bea317106991b74201755470f05387d66cff8b42adb10d96710d10a"}
May 28 09:31:50.198792 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:50.198786    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd" event={"ID":"397304a8-87ab-49c0-9fc0-a3ca99f04032","Type":"ContainerStarted","Data":"df4a18384e0cd7b4074c95e0d133d70537613a351cfe79ecfcdfabf0d01b3bbe"}
May 28 09:31:50.198924 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:50.198799    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd" event={"ID":"397304a8-87ab-49c0-9fc0-a3ca99f04032","Type":"ContainerStarted","Data":"e018d7f2fb789b1cc946a1612292b39f21988ec58116f85011e7489af63e06a2"}
May 28 09:31:50.198924 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:50.198814    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd" event={"ID":"397304a8-87ab-49c0-9fc0-a3ca99f04032","Type":"ContainerStarted","Data":"6a5be2ef5590ee125c8d61fad65156426dd5d4126cffda2716c5237b848d11cf"}
May 28 09:31:50.198924 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:50.198826    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd" event={"ID":"397304a8-87ab-49c0-9fc0-a3ca99f04032","Type":"ContainerDied","Data":"c9fedd25fe09e69ffc94411c991b7c3597914d02b828d6e4339732ec1c2d4daa"}
May 28 09:31:50.198924 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:50.198838    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd" event={"ID":"397304a8-87ab-49c0-9fc0-a3ca99f04032","Type":"ContainerStarted","Data":"b08b8979138736f7e3fa19f7eabcc8a55fdb99b20b86a7df05e046ddcffb76d5"}
May 28 09:31:50.199391 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:50.199372    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fswqv"
May 28 09:31:50.199822 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:50.199806    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fswqv"
May 28 09:31:50.202086 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:50.202069    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-ghjgh"]
May 28 09:31:50.224946 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:50.224924    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghjgh"
May 28 09:31:50.225041 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:50.224993    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ghjgh" podUID="85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5"
May 28 09:31:50.236525 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:50.236483    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-x49m9" podStartSLOduration=4.442091425 podStartE2EDuration="22.236471588s" podCreationTimestamp="2026-05-28 09:31:28 +0000 UTC" firstStartedPulling="2026-05-28 09:31:30.647409231 +0000 UTC m=+3.107154859" lastFinishedPulling="2026-05-28 09:31:48.441789398 +0000 UTC m=+20.901535022" observedRunningTime="2026-05-28 09:31:50.235981474 +0000 UTC m=+22.695727119" watchObservedRunningTime="2026-05-28 09:31:50.236471588 +0000 UTC m=+22.696217234"
May 28 09:31:50.311140 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:50.311112    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5-dbus\") pod \"global-pull-secret-syncer-ghjgh\" (UID: \"85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5\") " pod="kube-system/global-pull-secret-syncer-ghjgh"
May 28 09:31:50.311302 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:50.311178    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5-original-pull-secret\") pod \"global-pull-secret-syncer-ghjgh\" (UID: \"85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5\") " pod="kube-system/global-pull-secret-syncer-ghjgh"
May 28 09:31:50.311379 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:50.311330    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5-kubelet-config\") pod \"global-pull-secret-syncer-ghjgh\" (UID: \"85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5\") " pod="kube-system/global-pull-secret-syncer-ghjgh"
May 28 09:31:50.412078 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:50.411995    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5-original-pull-secret\") pod \"global-pull-secret-syncer-ghjgh\" (UID: \"85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5\") " pod="kube-system/global-pull-secret-syncer-ghjgh"
May 28 09:31:50.412248 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:50.412084    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5-kubelet-config\") pod \"global-pull-secret-syncer-ghjgh\" (UID: \"85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5\") " pod="kube-system/global-pull-secret-syncer-ghjgh"
May 28 09:31:50.412248 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:50.412118    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5-dbus\") pod \"global-pull-secret-syncer-ghjgh\" (UID: \"85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5\") " pod="kube-system/global-pull-secret-syncer-ghjgh"
May 28 09:31:50.412248 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:50.412178    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 09:31:50.412248 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:50.412245    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5-original-pull-secret podName:85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5 nodeName:}" failed. No retries permitted until 2026-05-28 09:31:50.912213681 +0000 UTC m=+23.371959322 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5-original-pull-secret") pod "global-pull-secret-syncer-ghjgh" (UID: "85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5") : object "kube-system"/"original-pull-secret" not registered
May 28 09:31:50.412514 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:50.412249    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5-kubelet-config\") pod \"global-pull-secret-syncer-ghjgh\" (UID: \"85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5\") " pod="kube-system/global-pull-secret-syncer-ghjgh"
May 28 09:31:50.412514 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:50.412427    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5-dbus\") pod \"global-pull-secret-syncer-ghjgh\" (UID: \"85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5\") " pod="kube-system/global-pull-secret-syncer-ghjgh"
May 28 09:31:50.915718 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:50.915666    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5-original-pull-secret\") pod \"global-pull-secret-syncer-ghjgh\" (UID: \"85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5\") " pod="kube-system/global-pull-secret-syncer-ghjgh"
May 28 09:31:50.915878 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:50.915814    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 09:31:50.915939 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:50.915880    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5-original-pull-secret podName:85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5 nodeName:}" failed. No retries permitted until 2026-05-28 09:31:51.915862819 +0000 UTC m=+24.375608460 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5-original-pull-secret") pod "global-pull-secret-syncer-ghjgh" (UID: "85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5") : object "kube-system"/"original-pull-secret" not registered
May 28 09:31:51.101720 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:51.101688    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n442c"
May 28 09:31:51.101889 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:51.101871    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n442c" podUID="36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74"
May 28 09:31:51.202756 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:51.202722    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f44r4" event={"ID":"50480aff-36b8-40f0-b169-d1b8a3c6d70d","Type":"ContainerStarted","Data":"b05acc8a1c9383b2b479a9e4788bb8f6d74ce4eaa44665c60f732fa60bda0331"}
May 28 09:31:51.221736 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:51.221695    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-f44r4" podStartSLOduration=2.9183586679999998 podStartE2EDuration="23.221682029s" podCreationTimestamp="2026-05-28 09:31:28 +0000 UTC" firstStartedPulling="2026-05-28 09:31:30.623182967 +0000 UTC m=+3.082928596" lastFinishedPulling="2026-05-28 09:31:50.92650633 +0000 UTC m=+23.386251957" observedRunningTime="2026-05-28 09:31:51.221431238 +0000 UTC m=+23.681176905" watchObservedRunningTime="2026-05-28 09:31:51.221682029 +0000 UTC m=+23.681427673"
May 28 09:31:51.924894 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:51.924674    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5-original-pull-secret\") pod \"global-pull-secret-syncer-ghjgh\" (UID: \"85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5\") " pod="kube-system/global-pull-secret-syncer-ghjgh"
May 28 09:31:51.925059 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:51.924826    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 09:31:51.925059 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:51.925017    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5-original-pull-secret podName:85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5 nodeName:}" failed. No retries permitted until 2026-05-28 09:31:53.925003065 +0000 UTC m=+26.384748689 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5-original-pull-secret") pod "global-pull-secret-syncer-ghjgh" (UID: "85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5") : object "kube-system"/"original-pull-secret" not registered
May 28 09:31:52.101700 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:52.101667    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghjgh"
May 28 09:31:52.101700 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:52.101683    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jgb2"
May 28 09:31:52.101920 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:52.101782    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ghjgh" podUID="85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5"
May 28 09:31:52.101920 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:52.101876    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jgb2" podUID="36d6c59d-f6ef-439d-8a97-58441ccdb9de"
May 28 09:31:53.101301 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:53.101282    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n442c"
May 28 09:31:53.101632 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:53.101366    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n442c" podUID="36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74"
May 28 09:31:53.210742 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:53.210724    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wqcwd_397304a8-87ab-49c0-9fc0-a3ca99f04032/ovn-acl-logging/0.log"
May 28 09:31:53.211026 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:53.210998    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd" event={"ID":"397304a8-87ab-49c0-9fc0-a3ca99f04032","Type":"ContainerStarted","Data":"3286ad78de46917709f48f3f151b2f45e0602282de90d4d9d6daee46374e6672"}
May 28 09:31:53.939699 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:53.939650    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5-original-pull-secret\") pod \"global-pull-secret-syncer-ghjgh\" (UID: \"85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5\") " pod="kube-system/global-pull-secret-syncer-ghjgh"
May 28 09:31:53.939903 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:53.939787    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 09:31:53.939903 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:53.939845    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5-original-pull-secret podName:85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5 nodeName:}" failed. No retries permitted until 2026-05-28 09:31:57.939828883 +0000 UTC m=+30.399574520 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5-original-pull-secret") pod "global-pull-secret-syncer-ghjgh" (UID: "85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5") : object "kube-system"/"original-pull-secret" not registered
May 28 09:31:54.100975 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:54.100946    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jgb2"
May 28 09:31:54.101122 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:54.101036    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jgb2" podUID="36d6c59d-f6ef-439d-8a97-58441ccdb9de"
May 28 09:31:54.101122 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:54.101094    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghjgh"
May 28 09:31:54.101248 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:54.101174    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ghjgh" podUID="85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5"
May 28 09:31:54.213924 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:54.213836    2578 generic.go:358] "Generic (PLEG): container finished" podID="9b7b650a-16c7-4711-b774-2618ab6d17fd" containerID="1d5e19d784ce4fab12ca7e1bc92e9f869acb40b0c1eb88fdf9fa650a50870e02" exitCode=0
May 28 09:31:54.213924 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:54.213890    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pcp25" event={"ID":"9b7b650a-16c7-4711-b774-2618ab6d17fd","Type":"ContainerDied","Data":"1d5e19d784ce4fab12ca7e1bc92e9f869acb40b0c1eb88fdf9fa650a50870e02"}
May 28 09:31:55.101087 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:55.101057    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n442c"
May 28 09:31:55.101257 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:55.101163    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n442c" podUID="36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74"
May 28 09:31:56.101561 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:56.101388    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jgb2"
May 28 09:31:56.102004 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:56.101438    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghjgh"
May 28 09:31:56.102004 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:56.101626    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jgb2" podUID="36d6c59d-f6ef-439d-8a97-58441ccdb9de"
May 28 09:31:56.102004 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:56.101727    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ghjgh" podUID="85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5"
May 28 09:31:56.219181 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:56.219155    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wqcwd_397304a8-87ab-49c0-9fc0-a3ca99f04032/ovn-acl-logging/0.log"
May 28 09:31:56.219507 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:56.219483    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd" event={"ID":"397304a8-87ab-49c0-9fc0-a3ca99f04032","Type":"ContainerStarted","Data":"ed9d3772d70080778c4f6a909cd8b746ea5da1fda3f63444734c76bb34a6efc4"}
May 28 09:31:56.219824 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:56.219792    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:56.219918 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:56.219829    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:56.219970 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:56.219938    2578 scope.go:117] "RemoveContainer" containerID="c9fedd25fe09e69ffc94411c991b7c3597914d02b828d6e4339732ec1c2d4daa"
May 28 09:31:56.221481 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:56.221459    2578 generic.go:358] "Generic (PLEG): container finished" podID="9b7b650a-16c7-4711-b774-2618ab6d17fd" containerID="1ee6f2991755af00b1df3ce0de1ba8d6008da182576686277bd810dc8bf515a9" exitCode=0
May 28 09:31:56.221570 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:56.221504    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pcp25" event={"ID":"9b7b650a-16c7-4711-b774-2618ab6d17fd","Type":"ContainerDied","Data":"1ee6f2991755af00b1df3ce0de1ba8d6008da182576686277bd810dc8bf515a9"}
May 28 09:31:56.235017 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:56.235003    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:57.100784 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:57.100748    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n442c"
May 28 09:31:57.100977 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:57.100856    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n442c" podUID="36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74"
May 28 09:31:57.226900 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:57.226874    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wqcwd_397304a8-87ab-49c0-9fc0-a3ca99f04032/ovn-acl-logging/0.log"
May 28 09:31:57.227284 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:57.227200    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd" event={"ID":"397304a8-87ab-49c0-9fc0-a3ca99f04032","Type":"ContainerStarted","Data":"fd3fe97a0e1529415f4159e67bf009858adc3e2e1ec3234b3dc7044644dc3f3c"}
May 28 09:31:57.227796 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:57.227774    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:57.245207 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:57.245190    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:31:57.261841 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:57.261790    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd" podStartSLOduration=10.733464524 podStartE2EDuration="29.261773169s" podCreationTimestamp="2026-05-28 09:31:28 +0000 UTC" firstStartedPulling="2026-05-28 09:31:30.624302107 +0000 UTC m=+3.084047731" lastFinishedPulling="2026-05-28 09:31:49.152610737 +0000 UTC m=+21.612356376" observedRunningTime="2026-05-28 09:31:57.261744416 +0000 UTC m=+29.721490073" watchObservedRunningTime="2026-05-28 09:31:57.261773169 +0000 UTC m=+29.721518812"
May 28 09:31:57.744036 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:57.744010    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ghjgh"]
May 28 09:31:57.744168 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:57.744120    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghjgh"
May 28 09:31:57.744257 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:57.744197    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ghjgh" podUID="85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5"
May 28 09:31:57.747282 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:57.747256    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n442c"]
May 28 09:31:57.747378 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:57.747341    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n442c"
May 28 09:31:57.747452 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:57.747430    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n442c" podUID="36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74"
May 28 09:31:57.750426 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:57.750408    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4jgb2"]
May 28 09:31:57.750537 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:57.750510    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jgb2"
May 28 09:31:57.750623 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:57.750607    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jgb2" podUID="36d6c59d-f6ef-439d-8a97-58441ccdb9de"
May 28 09:31:57.967354 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:57.967327    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5-original-pull-secret\") pod \"global-pull-secret-syncer-ghjgh\" (UID: \"85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5\") " pod="kube-system/global-pull-secret-syncer-ghjgh"
May 28 09:31:57.967485 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:57.967455    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 09:31:57.967527 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:57.967508    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5-original-pull-secret podName:85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5 nodeName:}" failed. No retries permitted until 2026-05-28 09:32:05.967495047 +0000 UTC m=+38.427240670 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5-original-pull-secret") pod "global-pull-secret-syncer-ghjgh" (UID: "85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5") : object "kube-system"/"original-pull-secret" not registered
May 28 09:31:58.231193 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:58.231119    2578 generic.go:358] "Generic (PLEG): container finished" podID="9b7b650a-16c7-4711-b774-2618ab6d17fd" containerID="34014bbde3777072692d2c84ffcf137458aefad3477b85b9c60b40a04108ddb7" exitCode=0
May 28 09:31:58.231500 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:58.231204    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pcp25" event={"ID":"9b7b650a-16c7-4711-b774-2618ab6d17fd","Type":"ContainerDied","Data":"34014bbde3777072692d2c84ffcf137458aefad3477b85b9c60b40a04108ddb7"}
May 28 09:31:59.101515 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:59.101434    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n442c"
May 28 09:31:59.101515 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:31:59.101474    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jgb2"
May 28 09:31:59.101711 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:59.101561    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n442c" podUID="36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74"
May 28 09:31:59.101711 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:31:59.101681    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jgb2" podUID="36d6c59d-f6ef-439d-8a97-58441ccdb9de"
May 28 09:32:00.101103 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:00.101073    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghjgh"
May 28 09:32:00.101566 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:00.101198    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ghjgh" podUID="85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5"
May 28 09:32:01.100779 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:01.100742    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n442c"
May 28 09:32:01.100950 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:01.100743    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jgb2"
May 28 09:32:01.100950 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:01.100841    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-n442c" podUID="36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74"
May 28 09:32:01.101033 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:01.100955    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4jgb2" podUID="36d6c59d-f6ef-439d-8a97-58441ccdb9de"
May 28 09:32:01.897809 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:01.897776    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36d6c59d-f6ef-439d-8a97-58441ccdb9de-metrics-certs\") pod \"network-metrics-daemon-4jgb2\" (UID: \"36d6c59d-f6ef-439d-8a97-58441ccdb9de\") " pod="openshift-multus/network-metrics-daemon-4jgb2"
May 28 09:32:01.897809 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:01.897816    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-snvgh\" (UniqueName: \"kubernetes.io/projected/36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74-kube-api-access-snvgh\") pod \"network-check-target-n442c\" (UID: \"36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74\") " pod="openshift-network-diagnostics/network-check-target-n442c"
May 28 09:32:01.898183 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:01.897918    2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 09:32:01.898183 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:01.897917    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 09:32:01.898183 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:01.897975    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36d6c59d-f6ef-439d-8a97-58441ccdb9de-metrics-certs podName:36d6c59d-f6ef-439d-8a97-58441ccdb9de nodeName:}" failed. No retries permitted until 2026-05-28 09:32:33.897960911 +0000 UTC m=+66.357706538 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36d6c59d-f6ef-439d-8a97-58441ccdb9de-metrics-certs") pod "network-metrics-daemon-4jgb2" (UID: "36d6c59d-f6ef-439d-8a97-58441ccdb9de") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 09:32:01.898183 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:01.897929    2578 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 09:32:01.898183 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:01.898012    2578 projected.go:194] Error preparing data for projected volume kube-api-access-snvgh for pod openshift-network-diagnostics/network-check-target-n442c: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 09:32:01.898183 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:01.898051    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74-kube-api-access-snvgh podName:36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74 nodeName:}" failed. No retries permitted until 2026-05-28 09:32:33.898040633 +0000 UTC m=+66.357786256 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-snvgh" (UniqueName: "kubernetes.io/projected/36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74-kube-api-access-snvgh") pod "network-check-target-n442c" (UID: "36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 09:32:02.101362 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.101327    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghjgh"
May 28 09:32:02.101530 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:02.101452    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ghjgh" podUID="85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5"
May 28 09:32:02.409532 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.409507    2578 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-138-49.ec2.internal" event="NodeReady"
May 28 09:32:02.409679 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.409610    2578 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 28 09:32:02.453341 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.453316    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-84ff99d684-f4qwp"]
May 28 09:32:02.471815 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.471748    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84ff99d684-f4qwp"
May 28 09:32:02.476027 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.476001    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 28 09:32:02.476614 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.476589    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 28 09:32:02.476815 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.476799    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rk8br\""
May 28 09:32:02.477185 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.477165    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 28 09:32:02.483774 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.483402    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-cl4cv"]
May 28 09:32:02.491390 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.491370    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 28 09:32:02.506744 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.506714    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-ndlhq"]
May 28 09:32:02.506861 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.506846    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cl4cv"
May 28 09:32:02.509607 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.509577    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 28 09:32:02.509736 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.509711    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5x7r9\""
May 28 09:32:02.509920 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.509893    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 28 09:32:02.510047 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.510012    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 28 09:32:02.520593 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.520576    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-4jnrs"]
May 28 09:32:02.520729 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.520715    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-ndlhq"
May 28 09:32:02.523896 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.523864    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
May 28 09:32:02.524017 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.523993    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-m6hd2\""
May 28 09:32:02.524137 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.524120    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
May 28 09:32:02.538906 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.538886    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-84ff99d684-f4qwp"]
May 28 09:32:02.539000 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.538912    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cl4cv"]
May 28 09:32:02.539000 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.538923    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-ndlhq"]
May 28 09:32:02.539102 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.539038    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4jnrs"
May 28 09:32:02.542128 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.542096    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 28 09:32:02.542231 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.542128    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-59hlf\""
May 28 09:32:02.542231 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.542099    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 28 09:32:02.547976 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.547932    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4jnrs"]
May 28 09:32:02.602186 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.602160    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a6ff9851-21a3-400e-9444-0b26d8e695d0-registry-certificates\") pod \"image-registry-84ff99d684-f4qwp\" (UID: \"a6ff9851-21a3-400e-9444-0b26d8e695d0\") " pod="openshift-image-registry/image-registry-84ff99d684-f4qwp"
May 28 09:32:02.602295 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.602199    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a6ff9851-21a3-400e-9444-0b26d8e695d0-installation-pull-secrets\") pod \"image-registry-84ff99d684-f4qwp\" (UID: \"a6ff9851-21a3-400e-9444-0b26d8e695d0\") " pod="openshift-image-registry/image-registry-84ff99d684-f4qwp"
May 28 09:32:02.602295 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.602242    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4f338af0-ba12-449a-9d1d-131a715463e9-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-ndlhq\" (UID: \"4f338af0-ba12-449a-9d1d-131a715463e9\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-ndlhq"
May 28 09:32:02.602378 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.602307    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a6ff9851-21a3-400e-9444-0b26d8e695d0-bound-sa-token\") pod \"image-registry-84ff99d684-f4qwp\" (UID: \"a6ff9851-21a3-400e-9444-0b26d8e695d0\") " pod="openshift-image-registry/image-registry-84ff99d684-f4qwp"
May 28 09:32:02.602378 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.602327    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3a32cf92-12af-459a-ad67-15d50ffbcb4a-cert\") pod \"ingress-canary-cl4cv\" (UID: \"3a32cf92-12af-459a-ad67-15d50ffbcb4a\") " pod="openshift-ingress-canary/ingress-canary-cl4cv"
May 28 09:32:02.602378 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.602357    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a6ff9851-21a3-400e-9444-0b26d8e695d0-registry-tls\") pod \"image-registry-84ff99d684-f4qwp\" (UID: \"a6ff9851-21a3-400e-9444-0b26d8e695d0\") " pod="openshift-image-registry/image-registry-84ff99d684-f4qwp"
May 28 09:32:02.602516 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.602405    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a6ff9851-21a3-400e-9444-0b26d8e695d0-image-registry-private-configuration\") pod \"image-registry-84ff99d684-f4qwp\" (UID: \"a6ff9851-21a3-400e-9444-0b26d8e695d0\") " pod="openshift-image-registry/image-registry-84ff99d684-f4qwp"
May 28 09:32:02.602516 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.602456    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hclhm\" (UniqueName: \"kubernetes.io/projected/3a32cf92-12af-459a-ad67-15d50ffbcb4a-kube-api-access-hclhm\") pod \"ingress-canary-cl4cv\" (UID: \"3a32cf92-12af-459a-ad67-15d50ffbcb4a\") " pod="openshift-ingress-canary/ingress-canary-cl4cv"
May 28 09:32:02.602516 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.602510    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a6ff9851-21a3-400e-9444-0b26d8e695d0-ca-trust-extracted\") pod \"image-registry-84ff99d684-f4qwp\" (UID: \"a6ff9851-21a3-400e-9444-0b26d8e695d0\") " pod="openshift-image-registry/image-registry-84ff99d684-f4qwp"
May 28 09:32:02.602664 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.602535    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgzdn\" (UniqueName: \"kubernetes.io/projected/a6ff9851-21a3-400e-9444-0b26d8e695d0-kube-api-access-bgzdn\") pod \"image-registry-84ff99d684-f4qwp\" (UID: \"a6ff9851-21a3-400e-9444-0b26d8e695d0\") " pod="openshift-image-registry/image-registry-84ff99d684-f4qwp"
May 28 09:32:02.602664 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.602564    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4f338af0-ba12-449a-9d1d-131a715463e9-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-ndlhq\" (UID: \"4f338af0-ba12-449a-9d1d-131a715463e9\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-ndlhq"
May 28 09:32:02.602664 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.602629    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a6ff9851-21a3-400e-9444-0b26d8e695d0-trusted-ca\") pod \"image-registry-84ff99d684-f4qwp\" (UID: \"a6ff9851-21a3-400e-9444-0b26d8e695d0\") " pod="openshift-image-registry/image-registry-84ff99d684-f4qwp"
May 28 09:32:02.703551 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.703525    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a6ff9851-21a3-400e-9444-0b26d8e695d0-bound-sa-token\") pod \"image-registry-84ff99d684-f4qwp\" (UID: \"a6ff9851-21a3-400e-9444-0b26d8e695d0\") " pod="openshift-image-registry/image-registry-84ff99d684-f4qwp"
May 28 09:32:02.703728 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.703561    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3a32cf92-12af-459a-ad67-15d50ffbcb4a-cert\") pod \"ingress-canary-cl4cv\" (UID: \"3a32cf92-12af-459a-ad67-15d50ffbcb4a\") " pod="openshift-ingress-canary/ingress-canary-cl4cv"
May 28 09:32:02.703728 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:02.703686    2578 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 09:32:02.703728 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.703711    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a6ff9851-21a3-400e-9444-0b26d8e695d0-registry-tls\") pod \"image-registry-84ff99d684-f4qwp\" (UID: \"a6ff9851-21a3-400e-9444-0b26d8e695d0\") " pod="openshift-image-registry/image-registry-84ff99d684-f4qwp"
May 28 09:32:02.703943 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:02.703748    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a32cf92-12af-459a-ad67-15d50ffbcb4a-cert podName:3a32cf92-12af-459a-ad67-15d50ffbcb4a nodeName:}" failed. No retries permitted until 2026-05-28 09:32:03.203727917 +0000 UTC m=+35.663473541 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3a32cf92-12af-459a-ad67-15d50ffbcb4a-cert") pod "ingress-canary-cl4cv" (UID: "3a32cf92-12af-459a-ad67-15d50ffbcb4a") : secret "canary-serving-cert" not found
May 28 09:32:02.703943 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:02.703800    2578 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 09:32:02.703943 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.703802    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a6ff9851-21a3-400e-9444-0b26d8e695d0-image-registry-private-configuration\") pod \"image-registry-84ff99d684-f4qwp\" (UID: \"a6ff9851-21a3-400e-9444-0b26d8e695d0\") " pod="openshift-image-registry/image-registry-84ff99d684-f4qwp"
May 28 09:32:02.703943 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:02.703813    2578 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84ff99d684-f4qwp: secret "image-registry-tls" not found
May 28 09:32:02.703943 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.703837    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4bc2255b-95b4-4e5d-84ca-3b62b9da5519-config-volume\") pod \"dns-default-4jnrs\" (UID: \"4bc2255b-95b4-4e5d-84ca-3b62b9da5519\") " pod="openshift-dns/dns-default-4jnrs"
May 28 09:32:02.703943 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:02.703859    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a6ff9851-21a3-400e-9444-0b26d8e695d0-registry-tls podName:a6ff9851-21a3-400e-9444-0b26d8e695d0 nodeName:}" failed. No retries permitted until 2026-05-28 09:32:03.203842593 +0000 UTC m=+35.663588231 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a6ff9851-21a3-400e-9444-0b26d8e695d0-registry-tls") pod "image-registry-84ff99d684-f4qwp" (UID: "a6ff9851-21a3-400e-9444-0b26d8e695d0") : secret "image-registry-tls" not found
May 28 09:32:02.703943 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.703918    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4bc2255b-95b4-4e5d-84ca-3b62b9da5519-tmp-dir\") pod \"dns-default-4jnrs\" (UID: \"4bc2255b-95b4-4e5d-84ca-3b62b9da5519\") " pod="openshift-dns/dns-default-4jnrs"
May 28 09:32:02.704268 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.703955    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hclhm\" (UniqueName: \"kubernetes.io/projected/3a32cf92-12af-459a-ad67-15d50ffbcb4a-kube-api-access-hclhm\") pod \"ingress-canary-cl4cv\" (UID: \"3a32cf92-12af-459a-ad67-15d50ffbcb4a\") " pod="openshift-ingress-canary/ingress-canary-cl4cv"
May 28 09:32:02.704268 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.703985    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a6ff9851-21a3-400e-9444-0b26d8e695d0-ca-trust-extracted\") pod \"image-registry-84ff99d684-f4qwp\" (UID: \"a6ff9851-21a3-400e-9444-0b26d8e695d0\") " pod="openshift-image-registry/image-registry-84ff99d684-f4qwp"
May 28 09:32:02.704268 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.704013    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bgzdn\" (UniqueName: \"kubernetes.io/projected/a6ff9851-21a3-400e-9444-0b26d8e695d0-kube-api-access-bgzdn\") pod \"image-registry-84ff99d684-f4qwp\" (UID: \"a6ff9851-21a3-400e-9444-0b26d8e695d0\") " pod="openshift-image-registry/image-registry-84ff99d684-f4qwp"
May 28 09:32:02.704268 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.704041    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pmt8\" (UniqueName: \"kubernetes.io/projected/4bc2255b-95b4-4e5d-84ca-3b62b9da5519-kube-api-access-6pmt8\") pod \"dns-default-4jnrs\" (UID: \"4bc2255b-95b4-4e5d-84ca-3b62b9da5519\") " pod="openshift-dns/dns-default-4jnrs"
May 28 09:32:02.704268 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.704072    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4f338af0-ba12-449a-9d1d-131a715463e9-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-ndlhq\" (UID: \"4f338af0-ba12-449a-9d1d-131a715463e9\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-ndlhq"
May 28 09:32:02.704268 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.704109    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a6ff9851-21a3-400e-9444-0b26d8e695d0-trusted-ca\") pod \"image-registry-84ff99d684-f4qwp\" (UID: \"a6ff9851-21a3-400e-9444-0b26d8e695d0\") " pod="openshift-image-registry/image-registry-84ff99d684-f4qwp"
May 28 09:32:02.704268 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.704133    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4bc2255b-95b4-4e5d-84ca-3b62b9da5519-metrics-tls\") pod \"dns-default-4jnrs\" (UID: \"4bc2255b-95b4-4e5d-84ca-3b62b9da5519\") " pod="openshift-dns/dns-default-4jnrs"
May 28 09:32:02.704268 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:02.704246    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 28 09:32:02.704620 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.704284    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a6ff9851-21a3-400e-9444-0b26d8e695d0-registry-certificates\") pod \"image-registry-84ff99d684-f4qwp\" (UID: \"a6ff9851-21a3-400e-9444-0b26d8e695d0\") " pod="openshift-image-registry/image-registry-84ff99d684-f4qwp"
May 28 09:32:02.704620 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.704383    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a6ff9851-21a3-400e-9444-0b26d8e695d0-installation-pull-secrets\") pod \"image-registry-84ff99d684-f4qwp\" (UID: \"a6ff9851-21a3-400e-9444-0b26d8e695d0\") " pod="openshift-image-registry/image-registry-84ff99d684-f4qwp"
May 28 09:32:02.704620 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:02.704401    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f338af0-ba12-449a-9d1d-131a715463e9-networking-console-plugin-cert podName:4f338af0-ba12-449a-9d1d-131a715463e9 nodeName:}" failed. No retries permitted until 2026-05-28 09:32:03.204380992 +0000 UTC m=+35.664126634 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4f338af0-ba12-449a-9d1d-131a715463e9-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-ndlhq" (UID: "4f338af0-ba12-449a-9d1d-131a715463e9") : secret "networking-console-plugin-cert" not found
May 28 09:32:02.704620 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.704438    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4f338af0-ba12-449a-9d1d-131a715463e9-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-ndlhq\" (UID: \"4f338af0-ba12-449a-9d1d-131a715463e9\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-ndlhq"
May 28 09:32:02.704620 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.704458    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a6ff9851-21a3-400e-9444-0b26d8e695d0-ca-trust-extracted\") pod \"image-registry-84ff99d684-f4qwp\" (UID: \"a6ff9851-21a3-400e-9444-0b26d8e695d0\") " pod="openshift-image-registry/image-registry-84ff99d684-f4qwp"
May 28 09:32:02.704911 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.704832    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a6ff9851-21a3-400e-9444-0b26d8e695d0-registry-certificates\") pod \"image-registry-84ff99d684-f4qwp\" (UID: \"a6ff9851-21a3-400e-9444-0b26d8e695d0\") " pod="openshift-image-registry/image-registry-84ff99d684-f4qwp"
May 28 09:32:02.705103 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.705084    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a6ff9851-21a3-400e-9444-0b26d8e695d0-trusted-ca\") pod \"image-registry-84ff99d684-f4qwp\" (UID: \"a6ff9851-21a3-400e-9444-0b26d8e695d0\") " pod="openshift-image-registry/image-registry-84ff99d684-f4qwp"
May 28 09:32:02.705186 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.705169    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4f338af0-ba12-449a-9d1d-131a715463e9-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-ndlhq\" (UID: \"4f338af0-ba12-449a-9d1d-131a715463e9\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-ndlhq"
May 28 09:32:02.708338 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.708318    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a6ff9851-21a3-400e-9444-0b26d8e695d0-image-registry-private-configuration\") pod \"image-registry-84ff99d684-f4qwp\" (UID: \"a6ff9851-21a3-400e-9444-0b26d8e695d0\") " pod="openshift-image-registry/image-registry-84ff99d684-f4qwp"
May 28 09:32:02.708440 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.708349    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a6ff9851-21a3-400e-9444-0b26d8e695d0-installation-pull-secrets\") pod \"image-registry-84ff99d684-f4qwp\" (UID: \"a6ff9851-21a3-400e-9444-0b26d8e695d0\") " pod="openshift-image-registry/image-registry-84ff99d684-f4qwp"
May 28 09:32:02.713487 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.713464    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hclhm\" (UniqueName: \"kubernetes.io/projected/3a32cf92-12af-459a-ad67-15d50ffbcb4a-kube-api-access-hclhm\") pod \"ingress-canary-cl4cv\" (UID: \"3a32cf92-12af-459a-ad67-15d50ffbcb4a\") " pod="openshift-ingress-canary/ingress-canary-cl4cv"
May 28 09:32:02.713869 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.713836    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgzdn\" (UniqueName: \"kubernetes.io/projected/a6ff9851-21a3-400e-9444-0b26d8e695d0-kube-api-access-bgzdn\") pod \"image-registry-84ff99d684-f4qwp\" (UID: \"a6ff9851-21a3-400e-9444-0b26d8e695d0\") " pod="openshift-image-registry/image-registry-84ff99d684-f4qwp"
May 28 09:32:02.714572 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.714546    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a6ff9851-21a3-400e-9444-0b26d8e695d0-bound-sa-token\") pod \"image-registry-84ff99d684-f4qwp\" (UID: \"a6ff9851-21a3-400e-9444-0b26d8e695d0\") " pod="openshift-image-registry/image-registry-84ff99d684-f4qwp"
May 28 09:32:02.805191 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.805140    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4bc2255b-95b4-4e5d-84ca-3b62b9da5519-config-volume\") pod \"dns-default-4jnrs\" (UID: \"4bc2255b-95b4-4e5d-84ca-3b62b9da5519\") " pod="openshift-dns/dns-default-4jnrs"
May 28 09:32:02.805191 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.805175    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4bc2255b-95b4-4e5d-84ca-3b62b9da5519-tmp-dir\") pod \"dns-default-4jnrs\" (UID: \"4bc2255b-95b4-4e5d-84ca-3b62b9da5519\") " pod="openshift-dns/dns-default-4jnrs"
May 28 09:32:02.805325 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.805198    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6pmt8\" (UniqueName: \"kubernetes.io/projected/4bc2255b-95b4-4e5d-84ca-3b62b9da5519-kube-api-access-6pmt8\") pod \"dns-default-4jnrs\" (UID: \"4bc2255b-95b4-4e5d-84ca-3b62b9da5519\") " pod="openshift-dns/dns-default-4jnrs"
May 28 09:32:02.805443 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.805427    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4bc2255b-95b4-4e5d-84ca-3b62b9da5519-metrics-tls\") pod \"dns-default-4jnrs\" (UID: \"4bc2255b-95b4-4e5d-84ca-3b62b9da5519\") " pod="openshift-dns/dns-default-4jnrs"
May 28 09:32:02.805492 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.805432    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4bc2255b-95b4-4e5d-84ca-3b62b9da5519-tmp-dir\") pod \"dns-default-4jnrs\" (UID: \"4bc2255b-95b4-4e5d-84ca-3b62b9da5519\") " pod="openshift-dns/dns-default-4jnrs"
May 28 09:32:02.805492 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:02.805487    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 09:32:02.805558 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:02.805530    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bc2255b-95b4-4e5d-84ca-3b62b9da5519-metrics-tls podName:4bc2255b-95b4-4e5d-84ca-3b62b9da5519 nodeName:}" failed. No retries permitted until 2026-05-28 09:32:03.30551898 +0000 UTC m=+35.765264606 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4bc2255b-95b4-4e5d-84ca-3b62b9da5519-metrics-tls") pod "dns-default-4jnrs" (UID: "4bc2255b-95b4-4e5d-84ca-3b62b9da5519") : secret "dns-default-metrics-tls" not found
May 28 09:32:02.805659 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.805642    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4bc2255b-95b4-4e5d-84ca-3b62b9da5519-config-volume\") pod \"dns-default-4jnrs\" (UID: \"4bc2255b-95b4-4e5d-84ca-3b62b9da5519\") " pod="openshift-dns/dns-default-4jnrs"
May 28 09:32:02.814371 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:02.814349    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pmt8\" (UniqueName: \"kubernetes.io/projected/4bc2255b-95b4-4e5d-84ca-3b62b9da5519-kube-api-access-6pmt8\") pod \"dns-default-4jnrs\" (UID: \"4bc2255b-95b4-4e5d-84ca-3b62b9da5519\") " pod="openshift-dns/dns-default-4jnrs"
May 28 09:32:03.101159 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:03.101092    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jgb2"
May 28 09:32:03.101766 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:03.101092    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n442c"
May 28 09:32:03.104150 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:03.104135    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 28 09:32:03.104208 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:03.104178    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-59hvh\""
May 28 09:32:03.104267 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:03.104215    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 28 09:32:03.104346 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:03.104328    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rxqxx\""
May 28 09:32:03.104482 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:03.104466    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 28 09:32:03.207745 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:03.207721    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3a32cf92-12af-459a-ad67-15d50ffbcb4a-cert\") pod \"ingress-canary-cl4cv\" (UID: \"3a32cf92-12af-459a-ad67-15d50ffbcb4a\") " pod="openshift-ingress-canary/ingress-canary-cl4cv"
May 28 09:32:03.207846 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:03.207752    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a6ff9851-21a3-400e-9444-0b26d8e695d0-registry-tls\") pod \"image-registry-84ff99d684-f4qwp\" (UID: \"a6ff9851-21a3-400e-9444-0b26d8e695d0\") " pod="openshift-image-registry/image-registry-84ff99d684-f4qwp"
May 28 09:32:03.207846 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:03.207811    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4f338af0-ba12-449a-9d1d-131a715463e9-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-ndlhq\" (UID: \"4f338af0-ba12-449a-9d1d-131a715463e9\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-ndlhq"
May 28 09:32:03.207927 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:03.207850    2578 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 09:32:03.207927 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:03.207896    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 28 09:32:03.207927 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:03.207916    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a32cf92-12af-459a-ad67-15d50ffbcb4a-cert podName:3a32cf92-12af-459a-ad67-15d50ffbcb4a nodeName:}" failed. No retries permitted until 2026-05-28 09:32:04.207895433 +0000 UTC m=+36.667641078 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3a32cf92-12af-459a-ad67-15d50ffbcb4a-cert") pod "ingress-canary-cl4cv" (UID: "3a32cf92-12af-459a-ad67-15d50ffbcb4a") : secret "canary-serving-cert" not found
May 28 09:32:03.208045 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:03.207860    2578 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 09:32:03.208045 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:03.207935    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f338af0-ba12-449a-9d1d-131a715463e9-networking-console-plugin-cert podName:4f338af0-ba12-449a-9d1d-131a715463e9 nodeName:}" failed. No retries permitted until 2026-05-28 09:32:04.207923058 +0000 UTC m=+36.667668683 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4f338af0-ba12-449a-9d1d-131a715463e9-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-ndlhq" (UID: "4f338af0-ba12-449a-9d1d-131a715463e9") : secret "networking-console-plugin-cert" not found
May 28 09:32:03.208045 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:03.207940    2578 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84ff99d684-f4qwp: secret "image-registry-tls" not found
May 28 09:32:03.208045 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:03.207979    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a6ff9851-21a3-400e-9444-0b26d8e695d0-registry-tls podName:a6ff9851-21a3-400e-9444-0b26d8e695d0 nodeName:}" failed. No retries permitted until 2026-05-28 09:32:04.207968868 +0000 UTC m=+36.667714491 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a6ff9851-21a3-400e-9444-0b26d8e695d0-registry-tls") pod "image-registry-84ff99d684-f4qwp" (UID: "a6ff9851-21a3-400e-9444-0b26d8e695d0") : secret "image-registry-tls" not found
May 28 09:32:03.308957 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:03.308932    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4bc2255b-95b4-4e5d-84ca-3b62b9da5519-metrics-tls\") pod \"dns-default-4jnrs\" (UID: \"4bc2255b-95b4-4e5d-84ca-3b62b9da5519\") " pod="openshift-dns/dns-default-4jnrs"
May 28 09:32:03.309094 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:03.309030    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 09:32:03.309094 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:03.309073    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bc2255b-95b4-4e5d-84ca-3b62b9da5519-metrics-tls podName:4bc2255b-95b4-4e5d-84ca-3b62b9da5519 nodeName:}" failed. No retries permitted until 2026-05-28 09:32:04.309061657 +0000 UTC m=+36.768807281 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4bc2255b-95b4-4e5d-84ca-3b62b9da5519-metrics-tls") pod "dns-default-4jnrs" (UID: "4bc2255b-95b4-4e5d-84ca-3b62b9da5519") : secret "dns-default-metrics-tls" not found
May 28 09:32:04.101157 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:04.101121    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghjgh"
May 28 09:32:04.104019 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:04.103994    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 28 09:32:04.216093 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:04.216063    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a6ff9851-21a3-400e-9444-0b26d8e695d0-registry-tls\") pod \"image-registry-84ff99d684-f4qwp\" (UID: \"a6ff9851-21a3-400e-9444-0b26d8e695d0\") " pod="openshift-image-registry/image-registry-84ff99d684-f4qwp"
May 28 09:32:04.216288 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:04.216166    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4f338af0-ba12-449a-9d1d-131a715463e9-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-ndlhq\" (UID: \"4f338af0-ba12-449a-9d1d-131a715463e9\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-ndlhq"
May 28 09:32:04.216288 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:04.216239    2578 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 09:32:04.216288 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:04.216262    2578 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84ff99d684-f4qwp: secret "image-registry-tls" not found
May 28 09:32:04.216459 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:04.216292    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 28 09:32:04.216459 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:04.216243    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3a32cf92-12af-459a-ad67-15d50ffbcb4a-cert\") pod \"ingress-canary-cl4cv\" (UID: \"3a32cf92-12af-459a-ad67-15d50ffbcb4a\") " pod="openshift-ingress-canary/ingress-canary-cl4cv"
May 28 09:32:04.216459 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:04.216325    2578 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 09:32:04.216459 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:04.216333    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a6ff9851-21a3-400e-9444-0b26d8e695d0-registry-tls podName:a6ff9851-21a3-400e-9444-0b26d8e695d0 nodeName:}" failed. No retries permitted until 2026-05-28 09:32:06.216312643 +0000 UTC m=+38.676058286 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a6ff9851-21a3-400e-9444-0b26d8e695d0-registry-tls") pod "image-registry-84ff99d684-f4qwp" (UID: "a6ff9851-21a3-400e-9444-0b26d8e695d0") : secret "image-registry-tls" not found
May 28 09:32:04.216459 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:04.216356    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f338af0-ba12-449a-9d1d-131a715463e9-networking-console-plugin-cert podName:4f338af0-ba12-449a-9d1d-131a715463e9 nodeName:}" failed. No retries permitted until 2026-05-28 09:32:06.216347324 +0000 UTC m=+38.676092954 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4f338af0-ba12-449a-9d1d-131a715463e9-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-ndlhq" (UID: "4f338af0-ba12-449a-9d1d-131a715463e9") : secret "networking-console-plugin-cert" not found
May 28 09:32:04.216459 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:04.216375    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a32cf92-12af-459a-ad67-15d50ffbcb4a-cert podName:3a32cf92-12af-459a-ad67-15d50ffbcb4a nodeName:}" failed. No retries permitted until 2026-05-28 09:32:06.216365829 +0000 UTC m=+38.676111459 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3a32cf92-12af-459a-ad67-15d50ffbcb4a-cert") pod "ingress-canary-cl4cv" (UID: "3a32cf92-12af-459a-ad67-15d50ffbcb4a") : secret "canary-serving-cert" not found
May 28 09:32:04.316860 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:04.316828    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4bc2255b-95b4-4e5d-84ca-3b62b9da5519-metrics-tls\") pod \"dns-default-4jnrs\" (UID: \"4bc2255b-95b4-4e5d-84ca-3b62b9da5519\") " pod="openshift-dns/dns-default-4jnrs"
May 28 09:32:04.317030 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:04.317002    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 09:32:04.317084 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:04.317074    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bc2255b-95b4-4e5d-84ca-3b62b9da5519-metrics-tls podName:4bc2255b-95b4-4e5d-84ca-3b62b9da5519 nodeName:}" failed. No retries permitted until 2026-05-28 09:32:06.31705474 +0000 UTC m=+38.776800381 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4bc2255b-95b4-4e5d-84ca-3b62b9da5519-metrics-tls") pod "dns-default-4jnrs" (UID: "4bc2255b-95b4-4e5d-84ca-3b62b9da5519") : secret "dns-default-metrics-tls" not found
May 28 09:32:06.031544 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:06.031521    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5-original-pull-secret\") pod \"global-pull-secret-syncer-ghjgh\" (UID: \"85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5\") " pod="kube-system/global-pull-secret-syncer-ghjgh"
May 28 09:32:06.033859 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:06.033828    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5-original-pull-secret\") pod \"global-pull-secret-syncer-ghjgh\" (UID: \"85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5\") " pod="kube-system/global-pull-secret-syncer-ghjgh"
May 28 09:32:06.211228 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:06.211203    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ghjgh"
May 28 09:32:06.233563 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:06.233522    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3a32cf92-12af-459a-ad67-15d50ffbcb4a-cert\") pod \"ingress-canary-cl4cv\" (UID: \"3a32cf92-12af-459a-ad67-15d50ffbcb4a\") " pod="openshift-ingress-canary/ingress-canary-cl4cv"
May 28 09:32:06.233690 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:06.233569    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a6ff9851-21a3-400e-9444-0b26d8e695d0-registry-tls\") pod \"image-registry-84ff99d684-f4qwp\" (UID: \"a6ff9851-21a3-400e-9444-0b26d8e695d0\") " pod="openshift-image-registry/image-registry-84ff99d684-f4qwp"
May 28 09:32:06.233690 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:06.233646    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4f338af0-ba12-449a-9d1d-131a715463e9-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-ndlhq\" (UID: \"4f338af0-ba12-449a-9d1d-131a715463e9\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-ndlhq"
May 28 09:32:06.233690 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:06.233669    2578 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 09:32:06.233841 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:06.233737    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a32cf92-12af-459a-ad67-15d50ffbcb4a-cert podName:3a32cf92-12af-459a-ad67-15d50ffbcb4a nodeName:}" failed. No retries permitted until 2026-05-28 09:32:10.233717685 +0000 UTC m=+42.693463312 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3a32cf92-12af-459a-ad67-15d50ffbcb4a-cert") pod "ingress-canary-cl4cv" (UID: "3a32cf92-12af-459a-ad67-15d50ffbcb4a") : secret "canary-serving-cert" not found
May 28 09:32:06.233841 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:06.233771    2578 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 09:32:06.233841 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:06.233787    2578 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84ff99d684-f4qwp: secret "image-registry-tls" not found
May 28 09:32:06.233841 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:06.233809    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 28 09:32:06.233841 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:06.233834    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a6ff9851-21a3-400e-9444-0b26d8e695d0-registry-tls podName:a6ff9851-21a3-400e-9444-0b26d8e695d0 nodeName:}" failed. No retries permitted until 2026-05-28 09:32:10.233819221 +0000 UTC m=+42.693564846 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a6ff9851-21a3-400e-9444-0b26d8e695d0-registry-tls") pod "image-registry-84ff99d684-f4qwp" (UID: "a6ff9851-21a3-400e-9444-0b26d8e695d0") : secret "image-registry-tls" not found
May 28 09:32:06.234064 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:06.233854    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f338af0-ba12-449a-9d1d-131a715463e9-networking-console-plugin-cert podName:4f338af0-ba12-449a-9d1d-131a715463e9 nodeName:}" failed. No retries permitted until 2026-05-28 09:32:10.233840431 +0000 UTC m=+42.693586068 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4f338af0-ba12-449a-9d1d-131a715463e9-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-ndlhq" (UID: "4f338af0-ba12-449a-9d1d-131a715463e9") : secret "networking-console-plugin-cert" not found
May 28 09:32:06.249365 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:06.249343    2578 generic.go:358] "Generic (PLEG): container finished" podID="9b7b650a-16c7-4711-b774-2618ab6d17fd" containerID="0f87626ad0055d55c5b70cc9ce59f813ca847dde4d3a8a768a0648006f668061" exitCode=0
May 28 09:32:06.249491 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:06.249389    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pcp25" event={"ID":"9b7b650a-16c7-4711-b774-2618ab6d17fd","Type":"ContainerDied","Data":"0f87626ad0055d55c5b70cc9ce59f813ca847dde4d3a8a768a0648006f668061"}
May 28 09:32:06.334815 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:06.334620    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4bc2255b-95b4-4e5d-84ca-3b62b9da5519-metrics-tls\") pod \"dns-default-4jnrs\" (UID: \"4bc2255b-95b4-4e5d-84ca-3b62b9da5519\") " pod="openshift-dns/dns-default-4jnrs"
May 28 09:32:06.334950 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:06.334761    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 09:32:06.334950 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:06.334939    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bc2255b-95b4-4e5d-84ca-3b62b9da5519-metrics-tls podName:4bc2255b-95b4-4e5d-84ca-3b62b9da5519 nodeName:}" failed. No retries permitted until 2026-05-28 09:32:10.33491932 +0000 UTC m=+42.794664957 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4bc2255b-95b4-4e5d-84ca-3b62b9da5519-metrics-tls") pod "dns-default-4jnrs" (UID: "4bc2255b-95b4-4e5d-84ca-3b62b9da5519") : secret "dns-default-metrics-tls" not found
May 28 09:32:06.412799 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:06.412772    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ghjgh"]
May 28 09:32:06.418455 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:32:06.418431    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85b6e3b2_9894_4ebd_9c28_33bf84f4fbd5.slice/crio-0034f8ae81a7b295cf65aeee1343d91b20f01f2a35e35ab5cf985ae066ae6b84 WatchSource:0}: Error finding container 0034f8ae81a7b295cf65aeee1343d91b20f01f2a35e35ab5cf985ae066ae6b84: Status 404 returned error can't find the container with id 0034f8ae81a7b295cf65aeee1343d91b20f01f2a35e35ab5cf985ae066ae6b84
May 28 09:32:07.252919 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:07.252879    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ghjgh" event={"ID":"85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5","Type":"ContainerStarted","Data":"0034f8ae81a7b295cf65aeee1343d91b20f01f2a35e35ab5cf985ae066ae6b84"}
May 28 09:32:07.255943 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:07.255913    2578 generic.go:358] "Generic (PLEG): container finished" podID="9b7b650a-16c7-4711-b774-2618ab6d17fd" containerID="94ce7bf718e9f490330274f1ffee4047d474c28519e684d405e3750d773f3702" exitCode=0
May 28 09:32:07.256074 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:07.255959    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pcp25" event={"ID":"9b7b650a-16c7-4711-b774-2618ab6d17fd","Type":"ContainerDied","Data":"94ce7bf718e9f490330274f1ffee4047d474c28519e684d405e3750d773f3702"}
May 28 09:32:08.261101 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:08.260930    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pcp25" event={"ID":"9b7b650a-16c7-4711-b774-2618ab6d17fd","Type":"ContainerStarted","Data":"7d763b9f6b6fe43b075303e0c0ba0059312c79c33e769dbb753b97ab4e7dc598"}
May 28 09:32:08.285735 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:08.285698    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pcp25" podStartSLOduration=5.327785499 podStartE2EDuration="40.285681729s" podCreationTimestamp="2026-05-28 09:31:28 +0000 UTC" firstStartedPulling="2026-05-28 09:31:30.647384039 +0000 UTC m=+3.107129669" lastFinishedPulling="2026-05-28 09:32:05.605280275 +0000 UTC m=+38.065025899" observedRunningTime="2026-05-28 09:32:08.284111787 +0000 UTC m=+40.743857433" watchObservedRunningTime="2026-05-28 09:32:08.285681729 +0000 UTC m=+40.745427372"
May 28 09:32:10.267391 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:10.267355    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4f338af0-ba12-449a-9d1d-131a715463e9-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-ndlhq\" (UID: \"4f338af0-ba12-449a-9d1d-131a715463e9\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-ndlhq"
May 28 09:32:10.267945 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:10.267450    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3a32cf92-12af-459a-ad67-15d50ffbcb4a-cert\") pod \"ingress-canary-cl4cv\" (UID: \"3a32cf92-12af-459a-ad67-15d50ffbcb4a\") " pod="openshift-ingress-canary/ingress-canary-cl4cv"
May 28 09:32:10.267945 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:10.267483    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a6ff9851-21a3-400e-9444-0b26d8e695d0-registry-tls\") pod \"image-registry-84ff99d684-f4qwp\" (UID: \"a6ff9851-21a3-400e-9444-0b26d8e695d0\") " pod="openshift-image-registry/image-registry-84ff99d684-f4qwp"
May 28 09:32:10.267945 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:10.267511    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 28 09:32:10.267945 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:10.267552    2578 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 09:32:10.267945 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:10.267579    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f338af0-ba12-449a-9d1d-131a715463e9-networking-console-plugin-cert podName:4f338af0-ba12-449a-9d1d-131a715463e9 nodeName:}" failed. No retries permitted until 2026-05-28 09:32:18.267561908 +0000 UTC m=+50.727307532 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4f338af0-ba12-449a-9d1d-131a715463e9-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-ndlhq" (UID: "4f338af0-ba12-449a-9d1d-131a715463e9") : secret "networking-console-plugin-cert" not found
May 28 09:32:10.267945 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:10.267583    2578 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 09:32:10.267945 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:10.267594    2578 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84ff99d684-f4qwp: secret "image-registry-tls" not found
May 28 09:32:10.267945 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:10.267604    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a32cf92-12af-459a-ad67-15d50ffbcb4a-cert podName:3a32cf92-12af-459a-ad67-15d50ffbcb4a nodeName:}" failed. No retries permitted until 2026-05-28 09:32:18.26758827 +0000 UTC m=+50.727333897 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3a32cf92-12af-459a-ad67-15d50ffbcb4a-cert") pod "ingress-canary-cl4cv" (UID: "3a32cf92-12af-459a-ad67-15d50ffbcb4a") : secret "canary-serving-cert" not found
May 28 09:32:10.267945 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:10.267625    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a6ff9851-21a3-400e-9444-0b26d8e695d0-registry-tls podName:a6ff9851-21a3-400e-9444-0b26d8e695d0 nodeName:}" failed. No retries permitted until 2026-05-28 09:32:18.26761601 +0000 UTC m=+50.727361634 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a6ff9851-21a3-400e-9444-0b26d8e695d0-registry-tls") pod "image-registry-84ff99d684-f4qwp" (UID: "a6ff9851-21a3-400e-9444-0b26d8e695d0") : secret "image-registry-tls" not found
May 28 09:32:10.367887 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:10.367853    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4bc2255b-95b4-4e5d-84ca-3b62b9da5519-metrics-tls\") pod \"dns-default-4jnrs\" (UID: \"4bc2255b-95b4-4e5d-84ca-3b62b9da5519\") " pod="openshift-dns/dns-default-4jnrs"
May 28 09:32:10.368078 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:10.368015    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 09:32:10.368144 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:10.368083    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bc2255b-95b4-4e5d-84ca-3b62b9da5519-metrics-tls podName:4bc2255b-95b4-4e5d-84ca-3b62b9da5519 nodeName:}" failed. No retries permitted until 2026-05-28 09:32:18.368068449 +0000 UTC m=+50.827814073 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4bc2255b-95b4-4e5d-84ca-3b62b9da5519-metrics-tls") pod "dns-default-4jnrs" (UID: "4bc2255b-95b4-4e5d-84ca-3b62b9da5519") : secret "dns-default-metrics-tls" not found
May 28 09:32:11.267304 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:11.267272    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ghjgh" event={"ID":"85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5","Type":"ContainerStarted","Data":"c752004069e971c185ed78c29f0720dce7211d1dc5831fc571330c5478c4b735"}
May 28 09:32:11.286313 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:11.286273    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-ghjgh" podStartSLOduration=16.853042025 podStartE2EDuration="21.286258186s" podCreationTimestamp="2026-05-28 09:31:50 +0000 UTC" firstStartedPulling="2026-05-28 09:32:06.420021501 +0000 UTC m=+38.879767125" lastFinishedPulling="2026-05-28 09:32:10.853237647 +0000 UTC m=+43.312983286" observedRunningTime="2026-05-28 09:32:11.285697255 +0000 UTC m=+43.745442902" watchObservedRunningTime="2026-05-28 09:32:11.286258186 +0000 UTC m=+43.746003832"
May 28 09:32:18.323817 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:18.323776    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4f338af0-ba12-449a-9d1d-131a715463e9-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-ndlhq\" (UID: \"4f338af0-ba12-449a-9d1d-131a715463e9\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-ndlhq"
May 28 09:32:18.324259 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:18.323841    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3a32cf92-12af-459a-ad67-15d50ffbcb4a-cert\") pod \"ingress-canary-cl4cv\" (UID: \"3a32cf92-12af-459a-ad67-15d50ffbcb4a\") " pod="openshift-ingress-canary/ingress-canary-cl4cv"
May 28 09:32:18.324259 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:18.323861    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a6ff9851-21a3-400e-9444-0b26d8e695d0-registry-tls\") pod \"image-registry-84ff99d684-f4qwp\" (UID: \"a6ff9851-21a3-400e-9444-0b26d8e695d0\") " pod="openshift-image-registry/image-registry-84ff99d684-f4qwp"
May 28 09:32:18.324259 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:18.323906    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 28 09:32:18.324259 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:18.323933    2578 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 09:32:18.324259 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:18.323933    2578 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 09:32:18.324259 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:18.323963    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f338af0-ba12-449a-9d1d-131a715463e9-networking-console-plugin-cert podName:4f338af0-ba12-449a-9d1d-131a715463e9 nodeName:}" failed. No retries permitted until 2026-05-28 09:32:34.323948772 +0000 UTC m=+66.783694401 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4f338af0-ba12-449a-9d1d-131a715463e9-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-ndlhq" (UID: "4f338af0-ba12-449a-9d1d-131a715463e9") : secret "networking-console-plugin-cert" not found
May 28 09:32:18.324259 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:18.323993    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a32cf92-12af-459a-ad67-15d50ffbcb4a-cert podName:3a32cf92-12af-459a-ad67-15d50ffbcb4a nodeName:}" failed. No retries permitted until 2026-05-28 09:32:34.323977891 +0000 UTC m=+66.783723518 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3a32cf92-12af-459a-ad67-15d50ffbcb4a-cert") pod "ingress-canary-cl4cv" (UID: "3a32cf92-12af-459a-ad67-15d50ffbcb4a") : secret "canary-serving-cert" not found
May 28 09:32:18.324259 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:18.323942    2578 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84ff99d684-f4qwp: secret "image-registry-tls" not found
May 28 09:32:18.324259 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:18.324040    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a6ff9851-21a3-400e-9444-0b26d8e695d0-registry-tls podName:a6ff9851-21a3-400e-9444-0b26d8e695d0 nodeName:}" failed. No retries permitted until 2026-05-28 09:32:34.324030209 +0000 UTC m=+66.783775836 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a6ff9851-21a3-400e-9444-0b26d8e695d0-registry-tls") pod "image-registry-84ff99d684-f4qwp" (UID: "a6ff9851-21a3-400e-9444-0b26d8e695d0") : secret "image-registry-tls" not found
May 28 09:32:18.424644 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:18.424601    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4bc2255b-95b4-4e5d-84ca-3b62b9da5519-metrics-tls\") pod \"dns-default-4jnrs\" (UID: \"4bc2255b-95b4-4e5d-84ca-3b62b9da5519\") " pod="openshift-dns/dns-default-4jnrs"
May 28 09:32:18.424826 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:18.424755    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 09:32:18.424826 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:18.424817    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bc2255b-95b4-4e5d-84ca-3b62b9da5519-metrics-tls podName:4bc2255b-95b4-4e5d-84ca-3b62b9da5519 nodeName:}" failed. No retries permitted until 2026-05-28 09:32:34.424800929 +0000 UTC m=+66.884546554 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4bc2255b-95b4-4e5d-84ca-3b62b9da5519-metrics-tls") pod "dns-default-4jnrs" (UID: "4bc2255b-95b4-4e5d-84ca-3b62b9da5519") : secret "dns-default-metrics-tls" not found
May 28 09:32:29.242598 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:29.242571    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wqcwd"
May 28 09:32:29.994654 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:29.994620    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-555dccc9b-8jzmx"]
May 28 09:32:29.997852 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:29.997833    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-555dccc9b-8jzmx"
May 28 09:32:30.000289 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:30.000263    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
May 28 09:32:30.000396 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:30.000305    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-5zgsd\""
May 28 09:32:30.000396 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:30.000310    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
May 28 09:32:30.001914 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:30.001892    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
May 28 09:32:30.002164 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:30.001964    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
May 28 09:32:30.007828 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:30.007812    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-555dccc9b-8jzmx"]
May 28 09:32:30.024422 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:30.024397    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f6bf4f776-86qfp"]
May 28 09:32:30.026428 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:30.026414    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f6bf4f776-86qfp"
May 28 09:32:30.028881 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:30.028841    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
May 28 09:32:30.028881 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:30.028877    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
May 28 09:32:30.029003 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:30.028904    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
May 28 09:32:30.029003 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:30.028879    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
May 28 09:32:30.037756 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:30.037736    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f6bf4f776-86qfp"]
May 28 09:32:30.106275 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:30.106256    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/666e1a9c-fdbf-477c-be7f-94b2f0afd792-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-f6bf4f776-86qfp\" (UID: \"666e1a9c-fdbf-477c-be7f-94b2f0afd792\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f6bf4f776-86qfp"
May 28 09:32:30.106363 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:30.106289    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/666e1a9c-fdbf-477c-be7f-94b2f0afd792-hub\") pod \"cluster-proxy-proxy-agent-f6bf4f776-86qfp\" (UID: \"666e1a9c-fdbf-477c-be7f-94b2f0afd792\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f6bf4f776-86qfp"
May 28 09:32:30.106363 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:30.106312    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/666e1a9c-fdbf-477c-be7f-94b2f0afd792-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-f6bf4f776-86qfp\" (UID: \"666e1a9c-fdbf-477c-be7f-94b2f0afd792\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f6bf4f776-86qfp"
May 28 09:32:30.106448 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:30.106359    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2d916dc6-fdea-4cbe-96d0-f1e84c6fc898-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-555dccc9b-8jzmx\" (UID: \"2d916dc6-fdea-4cbe-96d0-f1e84c6fc898\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-555dccc9b-8jzmx"
May 28 09:32:30.106448 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:30.106384    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9x56\" (UniqueName: \"kubernetes.io/projected/2d916dc6-fdea-4cbe-96d0-f1e84c6fc898-kube-api-access-s9x56\") pod \"managed-serviceaccount-addon-agent-555dccc9b-8jzmx\" (UID: \"2d916dc6-fdea-4cbe-96d0-f1e84c6fc898\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-555dccc9b-8jzmx"
May 28 09:32:30.106448 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:30.106402    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/666e1a9c-fdbf-477c-be7f-94b2f0afd792-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-f6bf4f776-86qfp\" (UID: \"666e1a9c-fdbf-477c-be7f-94b2f0afd792\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f6bf4f776-86qfp"
May 28 09:32:30.106560 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:30.106484    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/666e1a9c-fdbf-477c-be7f-94b2f0afd792-ca\") pod \"cluster-proxy-proxy-agent-f6bf4f776-86qfp\" (UID: \"666e1a9c-fdbf-477c-be7f-94b2f0afd792\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f6bf4f776-86qfp"
May 28 09:32:30.106560 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:30.106524    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rlp4\" (UniqueName: \"kubernetes.io/projected/666e1a9c-fdbf-477c-be7f-94b2f0afd792-kube-api-access-4rlp4\") pod \"cluster-proxy-proxy-agent-f6bf4f776-86qfp\" (UID: \"666e1a9c-fdbf-477c-be7f-94b2f0afd792\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f6bf4f776-86qfp"
May 28 09:32:30.207314 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:30.207296    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/666e1a9c-fdbf-477c-be7f-94b2f0afd792-hub\") pod \"cluster-proxy-proxy-agent-f6bf4f776-86qfp\" (UID: \"666e1a9c-fdbf-477c-be7f-94b2f0afd792\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f6bf4f776-86qfp"
May 28 09:32:30.207400 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:30.207327    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/666e1a9c-fdbf-477c-be7f-94b2f0afd792-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-f6bf4f776-86qfp\" (UID: \"666e1a9c-fdbf-477c-be7f-94b2f0afd792\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f6bf4f776-86qfp"
May 28 09:32:30.207400 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:30.207350    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2d916dc6-fdea-4cbe-96d0-f1e84c6fc898-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-555dccc9b-8jzmx\" (UID: \"2d916dc6-fdea-4cbe-96d0-f1e84c6fc898\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-555dccc9b-8jzmx"
May 28 09:32:30.207400 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:30.207367    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s9x56\" (UniqueName: \"kubernetes.io/projected/2d916dc6-fdea-4cbe-96d0-f1e84c6fc898-kube-api-access-s9x56\") pod \"managed-serviceaccount-addon-agent-555dccc9b-8jzmx\" (UID: \"2d916dc6-fdea-4cbe-96d0-f1e84c6fc898\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-555dccc9b-8jzmx"
May 28 09:32:30.207400 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:30.207390    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/666e1a9c-fdbf-477c-be7f-94b2f0afd792-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-f6bf4f776-86qfp\" (UID: \"666e1a9c-fdbf-477c-be7f-94b2f0afd792\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f6bf4f776-86qfp"
May 28 09:32:30.207637 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:30.207610    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/666e1a9c-fdbf-477c-be7f-94b2f0afd792-ca\") pod \"cluster-proxy-proxy-agent-f6bf4f776-86qfp\" (UID: \"666e1a9c-fdbf-477c-be7f-94b2f0afd792\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f6bf4f776-86qfp"
May 28 09:32:30.207721 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:30.207651    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4rlp4\" (UniqueName: \"kubernetes.io/projected/666e1a9c-fdbf-477c-be7f-94b2f0afd792-kube-api-access-4rlp4\") pod \"cluster-proxy-proxy-agent-f6bf4f776-86qfp\" (UID: \"666e1a9c-fdbf-477c-be7f-94b2f0afd792\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f6bf4f776-86qfp"
May 28 09:32:30.207767 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:30.207738    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/666e1a9c-fdbf-477c-be7f-94b2f0afd792-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-f6bf4f776-86qfp\" (UID: \"666e1a9c-fdbf-477c-be7f-94b2f0afd792\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f6bf4f776-86qfp"
May 28 09:32:30.208135 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:30.208108    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ocpservice-ca\" (UniqueName: \"kubernetes.io/configmap/666e1a9c-fdbf-477c-be7f-94b2f0afd792-ocpservice-ca\") pod \"cluster-proxy-proxy-agent-f6bf4f776-86qfp\" (UID: \"666e1a9c-fdbf-477c-be7f-94b2f0afd792\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f6bf4f776-86qfp"
May 28 09:32:30.211352 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:30.211328    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/666e1a9c-fdbf-477c-be7f-94b2f0afd792-ca\") pod \"cluster-proxy-proxy-agent-f6bf4f776-86qfp\" (UID: \"666e1a9c-fdbf-477c-be7f-94b2f0afd792\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f6bf4f776-86qfp"
May 28 09:32:30.211352 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:30.211339    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/666e1a9c-fdbf-477c-be7f-94b2f0afd792-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-f6bf4f776-86qfp\" (UID: \"666e1a9c-fdbf-477c-be7f-94b2f0afd792\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f6bf4f776-86qfp"
May 28 09:32:30.211484 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:30.211389    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/666e1a9c-fdbf-477c-be7f-94b2f0afd792-hub\") pod \"cluster-proxy-proxy-agent-f6bf4f776-86qfp\" (UID: \"666e1a9c-fdbf-477c-be7f-94b2f0afd792\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f6bf4f776-86qfp"
May 28 09:32:30.211484 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:30.211407    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/666e1a9c-fdbf-477c-be7f-94b2f0afd792-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-f6bf4f776-86qfp\" (UID: \"666e1a9c-fdbf-477c-be7f-94b2f0afd792\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f6bf4f776-86qfp"
May 28 09:32:30.211484 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:30.211406    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2d916dc6-fdea-4cbe-96d0-f1e84c6fc898-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-555dccc9b-8jzmx\" (UID: \"2d916dc6-fdea-4cbe-96d0-f1e84c6fc898\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-555dccc9b-8jzmx"
May 28 09:32:30.215702 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:30.215663    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rlp4\" (UniqueName: \"kubernetes.io/projected/666e1a9c-fdbf-477c-be7f-94b2f0afd792-kube-api-access-4rlp4\") pod \"cluster-proxy-proxy-agent-f6bf4f776-86qfp\" (UID: \"666e1a9c-fdbf-477c-be7f-94b2f0afd792\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f6bf4f776-86qfp"
May 28 09:32:30.215859 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:30.215845    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9x56\" (UniqueName: \"kubernetes.io/projected/2d916dc6-fdea-4cbe-96d0-f1e84c6fc898-kube-api-access-s9x56\") pod \"managed-serviceaccount-addon-agent-555dccc9b-8jzmx\" (UID: \"2d916dc6-fdea-4cbe-96d0-f1e84c6fc898\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-555dccc9b-8jzmx"
May 28 09:32:30.318044 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:30.317992    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-555dccc9b-8jzmx"
May 28 09:32:30.333512 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:30.333494    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f6bf4f776-86qfp"
May 28 09:32:30.439723 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:30.439692    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-555dccc9b-8jzmx"]
May 28 09:32:30.444362 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:32:30.444338    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2d916dc6_fdea_4cbe_96d0_f1e84c6fc898.slice/crio-673f3eb4990a9817caec33395bb5816b9e754eaf4b54a24816a0603f10de5533 WatchSource:0}: Error finding container 673f3eb4990a9817caec33395bb5816b9e754eaf4b54a24816a0603f10de5533: Status 404 returned error can't find the container with id 673f3eb4990a9817caec33395bb5816b9e754eaf4b54a24816a0603f10de5533
May 28 09:32:30.461536 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:30.461513    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f6bf4f776-86qfp"]
May 28 09:32:30.464426 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:32:30.464404    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod666e1a9c_fdbf_477c_be7f_94b2f0afd792.slice/crio-750267d450a13c66045513838e7f715e28b3781e56c4d519d50b3f8628e50d72 WatchSource:0}: Error finding container 750267d450a13c66045513838e7f715e28b3781e56c4d519d50b3f8628e50d72: Status 404 returned error can't find the container with id 750267d450a13c66045513838e7f715e28b3781e56c4d519d50b3f8628e50d72
May 28 09:32:31.304990 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:31.304948    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f6bf4f776-86qfp" event={"ID":"666e1a9c-fdbf-477c-be7f-94b2f0afd792","Type":"ContainerStarted","Data":"750267d450a13c66045513838e7f715e28b3781e56c4d519d50b3f8628e50d72"}
May 28 09:32:31.306818 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:31.306787    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-555dccc9b-8jzmx" event={"ID":"2d916dc6-fdea-4cbe-96d0-f1e84c6fc898","Type":"ContainerStarted","Data":"673f3eb4990a9817caec33395bb5816b9e754eaf4b54a24816a0603f10de5533"}
May 28 09:32:33.940658 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:33.940626    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36d6c59d-f6ef-439d-8a97-58441ccdb9de-metrics-certs\") pod \"network-metrics-daemon-4jgb2\" (UID: \"36d6c59d-f6ef-439d-8a97-58441ccdb9de\") " pod="openshift-multus/network-metrics-daemon-4jgb2"
May 28 09:32:33.941097 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:33.940690    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-snvgh\" (UniqueName: \"kubernetes.io/projected/36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74-kube-api-access-snvgh\") pod \"network-check-target-n442c\" (UID: \"36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74\") " pod="openshift-network-diagnostics/network-check-target-n442c"
May 28 09:32:33.943758 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:33.943735    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 28 09:32:33.943876 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:33.943801    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 28 09:32:33.951177 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:33.951153    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 28 09:32:33.951306 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:33.951215    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36d6c59d-f6ef-439d-8a97-58441ccdb9de-metrics-certs podName:36d6c59d-f6ef-439d-8a97-58441ccdb9de nodeName:}" failed. No retries permitted until 2026-05-28 09:33:37.951192214 +0000 UTC m=+130.410937838 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36d6c59d-f6ef-439d-8a97-58441ccdb9de-metrics-certs") pod "network-metrics-daemon-4jgb2" (UID: "36d6c59d-f6ef-439d-8a97-58441ccdb9de") : secret "metrics-daemon-secret" not found
May 28 09:32:33.953612 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:33.953590    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 28 09:32:33.963960 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:33.963938    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snvgh\" (UniqueName: \"kubernetes.io/projected/36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74-kube-api-access-snvgh\") pod \"network-check-target-n442c\" (UID: \"36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74\") " pod="openshift-network-diagnostics/network-check-target-n442c"
May 28 09:32:34.017902 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:34.017881    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-59hvh\""
May 28 09:32:34.025889 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:34.025874    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-n442c"
May 28 09:32:34.343474 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:34.343401    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3a32cf92-12af-459a-ad67-15d50ffbcb4a-cert\") pod \"ingress-canary-cl4cv\" (UID: \"3a32cf92-12af-459a-ad67-15d50ffbcb4a\") " pod="openshift-ingress-canary/ingress-canary-cl4cv"
May 28 09:32:34.343474 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:34.343437    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a6ff9851-21a3-400e-9444-0b26d8e695d0-registry-tls\") pod \"image-registry-84ff99d684-f4qwp\" (UID: \"a6ff9851-21a3-400e-9444-0b26d8e695d0\") " pod="openshift-image-registry/image-registry-84ff99d684-f4qwp"
May 28 09:32:34.343658 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:34.343496    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4f338af0-ba12-449a-9d1d-131a715463e9-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-ndlhq\" (UID: \"4f338af0-ba12-449a-9d1d-131a715463e9\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-ndlhq"
May 28 09:32:34.343658 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:34.343563    2578 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 09:32:34.343658 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:34.343587    2578 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 09:32:34.343658 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:34.343598    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 28 09:32:34.343658 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:34.343603    2578 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84ff99d684-f4qwp: secret "image-registry-tls" not found
May 28 09:32:34.343658 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:34.343657    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a32cf92-12af-459a-ad67-15d50ffbcb4a-cert podName:3a32cf92-12af-459a-ad67-15d50ffbcb4a nodeName:}" failed. No retries permitted until 2026-05-28 09:33:06.343640028 +0000 UTC m=+98.803385651 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3a32cf92-12af-459a-ad67-15d50ffbcb4a-cert") pod "ingress-canary-cl4cv" (UID: "3a32cf92-12af-459a-ad67-15d50ffbcb4a") : secret "canary-serving-cert" not found
May 28 09:32:34.343948 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:34.343692    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a6ff9851-21a3-400e-9444-0b26d8e695d0-registry-tls podName:a6ff9851-21a3-400e-9444-0b26d8e695d0 nodeName:}" failed. No retries permitted until 2026-05-28 09:33:06.343685261 +0000 UTC m=+98.803430884 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a6ff9851-21a3-400e-9444-0b26d8e695d0-registry-tls") pod "image-registry-84ff99d684-f4qwp" (UID: "a6ff9851-21a3-400e-9444-0b26d8e695d0") : secret "image-registry-tls" not found
May 28 09:32:34.343948 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:34.343708    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f338af0-ba12-449a-9d1d-131a715463e9-networking-console-plugin-cert podName:4f338af0-ba12-449a-9d1d-131a715463e9 nodeName:}" failed. No retries permitted until 2026-05-28 09:33:06.343699644 +0000 UTC m=+98.803445269 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4f338af0-ba12-449a-9d1d-131a715463e9-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-ndlhq" (UID: "4f338af0-ba12-449a-9d1d-131a715463e9") : secret "networking-console-plugin-cert" not found
May 28 09:32:34.444748 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:34.444708    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4bc2255b-95b4-4e5d-84ca-3b62b9da5519-metrics-tls\") pod \"dns-default-4jnrs\" (UID: \"4bc2255b-95b4-4e5d-84ca-3b62b9da5519\") " pod="openshift-dns/dns-default-4jnrs"
May 28 09:32:34.444934 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:34.444878    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 09:32:34.445007 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:32:34.444946    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bc2255b-95b4-4e5d-84ca-3b62b9da5519-metrics-tls podName:4bc2255b-95b4-4e5d-84ca-3b62b9da5519 nodeName:}" failed. No retries permitted until 2026-05-28 09:33:06.444925298 +0000 UTC m=+98.904670922 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4bc2255b-95b4-4e5d-84ca-3b62b9da5519-metrics-tls") pod "dns-default-4jnrs" (UID: "4bc2255b-95b4-4e5d-84ca-3b62b9da5519") : secret "dns-default-metrics-tls" not found
May 28 09:32:34.837943 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:34.837918    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-n442c"]
May 28 09:32:34.840459 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:32:34.840433    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36d4fbf6_bd2d_4aba_8dd5_5abe7958fb74.slice/crio-06bc1be9a5f12b4635103bb821f0342e77b3768020b700d11d91080b22e631ff WatchSource:0}: Error finding container 06bc1be9a5f12b4635103bb821f0342e77b3768020b700d11d91080b22e631ff: Status 404 returned error can't find the container with id 06bc1be9a5f12b4635103bb821f0342e77b3768020b700d11d91080b22e631ff
May 28 09:32:35.315757 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:35.315703    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n442c" event={"ID":"36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74","Type":"ContainerStarted","Data":"06bc1be9a5f12b4635103bb821f0342e77b3768020b700d11d91080b22e631ff"}
May 28 09:32:35.317265 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:35.317233    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f6bf4f776-86qfp" event={"ID":"666e1a9c-fdbf-477c-be7f-94b2f0afd792","Type":"ContainerStarted","Data":"9de1a07768ae82a52b32eb0859b8919ffb7a5b0b6bed17801b94be558e10511e"}
May 28 09:32:35.318618 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:35.318589    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-555dccc9b-8jzmx" event={"ID":"2d916dc6-fdea-4cbe-96d0-f1e84c6fc898","Type":"ContainerStarted","Data":"ab2a1dc5ea20f83aca1166a46afbd658ea8bf444d2728047cf45e5d46733476e"}
May 28 09:32:35.336373 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:35.336334    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-555dccc9b-8jzmx" podStartSLOduration=1.5729959999999998 podStartE2EDuration="6.33632151s" podCreationTimestamp="2026-05-28 09:32:29 +0000 UTC" firstStartedPulling="2026-05-28 09:32:30.446275784 +0000 UTC m=+62.906021407" lastFinishedPulling="2026-05-28 09:32:35.20960129 +0000 UTC m=+67.669346917" observedRunningTime="2026-05-28 09:32:35.336037813 +0000 UTC m=+67.795783462" watchObservedRunningTime="2026-05-28 09:32:35.33632151 +0000 UTC m=+67.796067155"
May 28 09:32:39.329035 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:39.328997    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-n442c" event={"ID":"36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74","Type":"ContainerStarted","Data":"dfbba6d6806889db870dfea2b9e107c192e10250781bf82f095530cd29788b70"}
May 28 09:32:39.329427 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:39.329066    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-n442c"
May 28 09:32:39.330588 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:39.330568    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f6bf4f776-86qfp" event={"ID":"666e1a9c-fdbf-477c-be7f-94b2f0afd792","Type":"ContainerStarted","Data":"5e0bb5981ee3a13238301b3bfc92df9ff373f9ebde0be37a1dacb290a0890e25"}
May 28 09:32:39.330683 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:39.330594    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f6bf4f776-86qfp" event={"ID":"666e1a9c-fdbf-477c-be7f-94b2f0afd792","Type":"ContainerStarted","Data":"50127c8a063b7a68e738625653b716a24d12c5ca01065bb0f43369c954e96951"}
May 28 09:32:39.345380 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:39.345343    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-n442c" podStartSLOduration=67.539856043 podStartE2EDuration="1m11.345330342s" podCreationTimestamp="2026-05-28 09:31:28 +0000 UTC" firstStartedPulling="2026-05-28 09:32:34.843117244 +0000 UTC m=+67.302862867" lastFinishedPulling="2026-05-28 09:32:38.648591542 +0000 UTC m=+71.108337166" observedRunningTime="2026-05-28 09:32:39.345246572 +0000 UTC m=+71.804992211" watchObservedRunningTime="2026-05-28 09:32:39.345330342 +0000 UTC m=+71.805075988"
May 28 09:32:39.364594 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:32:39.364555    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f6bf4f776-86qfp" podStartSLOduration=1.18551333 podStartE2EDuration="9.364542956s" podCreationTimestamp="2026-05-28 09:32:30 +0000 UTC" firstStartedPulling="2026-05-28 09:32:30.466536951 +0000 UTC m=+62.926282574" lastFinishedPulling="2026-05-28 09:32:38.645566577 +0000 UTC m=+71.105312200" observedRunningTime="2026-05-28 09:32:39.363540505 +0000 UTC m=+71.823286154" watchObservedRunningTime="2026-05-28 09:32:39.364542956 +0000 UTC m=+71.824288620"
May 28 09:33:06.368486 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:33:06.368455    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4f338af0-ba12-449a-9d1d-131a715463e9-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-ndlhq\" (UID: \"4f338af0-ba12-449a-9d1d-131a715463e9\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-ndlhq"
May 28 09:33:06.368898 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:33:06.368515    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3a32cf92-12af-459a-ad67-15d50ffbcb4a-cert\") pod \"ingress-canary-cl4cv\" (UID: \"3a32cf92-12af-459a-ad67-15d50ffbcb4a\") " pod="openshift-ingress-canary/ingress-canary-cl4cv"
May 28 09:33:06.368898 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:33:06.368545    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a6ff9851-21a3-400e-9444-0b26d8e695d0-registry-tls\") pod \"image-registry-84ff99d684-f4qwp\" (UID: \"a6ff9851-21a3-400e-9444-0b26d8e695d0\") " pod="openshift-image-registry/image-registry-84ff99d684-f4qwp"
May 28 09:33:06.368898 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:33:06.368597    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 28 09:33:06.368898 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:33:06.368634    2578 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 09:33:06.368898 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:33:06.368658    2578 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 09:33:06.368898 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:33:06.368669    2578 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84ff99d684-f4qwp: secret "image-registry-tls" not found
May 28 09:33:06.368898 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:33:06.368680    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f338af0-ba12-449a-9d1d-131a715463e9-networking-console-plugin-cert podName:4f338af0-ba12-449a-9d1d-131a715463e9 nodeName:}" failed. No retries permitted until 2026-05-28 09:34:10.368659673 +0000 UTC m=+162.828405311 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4f338af0-ba12-449a-9d1d-131a715463e9-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-ndlhq" (UID: "4f338af0-ba12-449a-9d1d-131a715463e9") : secret "networking-console-plugin-cert" not found
May 28 09:33:06.368898 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:33:06.368704    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a32cf92-12af-459a-ad67-15d50ffbcb4a-cert podName:3a32cf92-12af-459a-ad67-15d50ffbcb4a nodeName:}" failed. No retries permitted until 2026-05-28 09:34:10.368690401 +0000 UTC m=+162.828436025 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3a32cf92-12af-459a-ad67-15d50ffbcb4a-cert") pod "ingress-canary-cl4cv" (UID: "3a32cf92-12af-459a-ad67-15d50ffbcb4a") : secret "canary-serving-cert" not found
May 28 09:33:06.368898 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:33:06.368718    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a6ff9851-21a3-400e-9444-0b26d8e695d0-registry-tls podName:a6ff9851-21a3-400e-9444-0b26d8e695d0 nodeName:}" failed. No retries permitted until 2026-05-28 09:34:10.368709832 +0000 UTC m=+162.828455471 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a6ff9851-21a3-400e-9444-0b26d8e695d0-registry-tls") pod "image-registry-84ff99d684-f4qwp" (UID: "a6ff9851-21a3-400e-9444-0b26d8e695d0") : secret "image-registry-tls" not found
May 28 09:33:06.469098 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:33:06.469066    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4bc2255b-95b4-4e5d-84ca-3b62b9da5519-metrics-tls\") pod \"dns-default-4jnrs\" (UID: \"4bc2255b-95b4-4e5d-84ca-3b62b9da5519\") " pod="openshift-dns/dns-default-4jnrs"
May 28 09:33:06.469274 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:33:06.469170    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 09:33:06.469274 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:33:06.469258    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bc2255b-95b4-4e5d-84ca-3b62b9da5519-metrics-tls podName:4bc2255b-95b4-4e5d-84ca-3b62b9da5519 nodeName:}" failed. No retries permitted until 2026-05-28 09:34:10.469240601 +0000 UTC m=+162.928986238 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4bc2255b-95b4-4e5d-84ca-3b62b9da5519-metrics-tls") pod "dns-default-4jnrs" (UID: "4bc2255b-95b4-4e5d-84ca-3b62b9da5519") : secret "dns-default-metrics-tls" not found
May 28 09:33:10.335213 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:33:10.335184    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-n442c"
May 28 09:33:37.986691 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:33:37.986646    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36d6c59d-f6ef-439d-8a97-58441ccdb9de-metrics-certs\") pod \"network-metrics-daemon-4jgb2\" (UID: \"36d6c59d-f6ef-439d-8a97-58441ccdb9de\") " pod="openshift-multus/network-metrics-daemon-4jgb2"
May 28 09:33:37.987262 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:33:37.986804    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 28 09:33:37.987262 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:33:37.986884    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36d6c59d-f6ef-439d-8a97-58441ccdb9de-metrics-certs podName:36d6c59d-f6ef-439d-8a97-58441ccdb9de nodeName:}" failed. No retries permitted until 2026-05-28 09:35:39.986863469 +0000 UTC m=+252.446609092 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36d6c59d-f6ef-439d-8a97-58441ccdb9de-metrics-certs") pod "network-metrics-daemon-4jgb2" (UID: "36d6c59d-f6ef-439d-8a97-58441ccdb9de") : secret "metrics-daemon-secret" not found
May 28 09:34:05.483439 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:34:05.483382    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-84ff99d684-f4qwp" podUID="a6ff9851-21a3-400e-9444-0b26d8e695d0"
May 28 09:34:05.517273 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:34:05.517238    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-cl4cv" podUID="3a32cf92-12af-459a-ad67-15d50ffbcb4a"
May 28 09:34:05.520372 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:05.520354    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84ff99d684-f4qwp"
May 28 09:34:05.520477 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:05.520353    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cl4cv"
May 28 09:34:05.530783 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:34:05.530765    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-ndlhq" podUID="4f338af0-ba12-449a-9d1d-131a715463e9"
May 28 09:34:05.551915 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:34:05.551894    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-4jnrs" podUID="4bc2255b-95b4-4e5d-84ca-3b62b9da5519"
May 28 09:34:06.110164 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:34:06.110127    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-4jgb2" podUID="36d6c59d-f6ef-439d-8a97-58441ccdb9de"
May 28 09:34:06.522987 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:06.522958    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4jnrs"
May 28 09:34:06.523336 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:06.523022    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-ndlhq"
May 28 09:34:10.420047 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:10.420015    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3a32cf92-12af-459a-ad67-15d50ffbcb4a-cert\") pod \"ingress-canary-cl4cv\" (UID: \"3a32cf92-12af-459a-ad67-15d50ffbcb4a\") " pod="openshift-ingress-canary/ingress-canary-cl4cv"
May 28 09:34:10.420444 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:10.420055    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a6ff9851-21a3-400e-9444-0b26d8e695d0-registry-tls\") pod \"image-registry-84ff99d684-f4qwp\" (UID: \"a6ff9851-21a3-400e-9444-0b26d8e695d0\") " pod="openshift-image-registry/image-registry-84ff99d684-f4qwp"
May 28 09:34:10.420444 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:10.420097    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4f338af0-ba12-449a-9d1d-131a715463e9-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-ndlhq\" (UID: \"4f338af0-ba12-449a-9d1d-131a715463e9\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-ndlhq"
May 28 09:34:10.420444 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:34:10.420170    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 28 09:34:10.420444 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:34:10.420173    2578 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 09:34:10.420444 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:34:10.420235    2578 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 09:34:10.420444 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:34:10.420246    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4f338af0-ba12-449a-9d1d-131a715463e9-networking-console-plugin-cert podName:4f338af0-ba12-449a-9d1d-131a715463e9 nodeName:}" failed. No retries permitted until 2026-05-28 09:36:12.420230836 +0000 UTC m=+284.879976473 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4f338af0-ba12-449a-9d1d-131a715463e9-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-ndlhq" (UID: "4f338af0-ba12-449a-9d1d-131a715463e9") : secret "networking-console-plugin-cert" not found
May 28 09:34:10.420444 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:34:10.420250    2578 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-84ff99d684-f4qwp: secret "image-registry-tls" not found
May 28 09:34:10.420444 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:34:10.420287    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a6ff9851-21a3-400e-9444-0b26d8e695d0-registry-tls podName:a6ff9851-21a3-400e-9444-0b26d8e695d0 nodeName:}" failed. No retries permitted until 2026-05-28 09:36:12.420274721 +0000 UTC m=+284.880020345 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/a6ff9851-21a3-400e-9444-0b26d8e695d0-registry-tls") pod "image-registry-84ff99d684-f4qwp" (UID: "a6ff9851-21a3-400e-9444-0b26d8e695d0") : secret "image-registry-tls" not found
May 28 09:34:10.420978 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:34:10.420967    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a32cf92-12af-459a-ad67-15d50ffbcb4a-cert podName:3a32cf92-12af-459a-ad67-15d50ffbcb4a nodeName:}" failed. No retries permitted until 2026-05-28 09:36:12.420958301 +0000 UTC m=+284.880703936 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/3a32cf92-12af-459a-ad67-15d50ffbcb4a-cert") pod "ingress-canary-cl4cv" (UID: "3a32cf92-12af-459a-ad67-15d50ffbcb4a") : secret "canary-serving-cert" not found
May 28 09:34:10.521065 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:10.521027    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4bc2255b-95b4-4e5d-84ca-3b62b9da5519-metrics-tls\") pod \"dns-default-4jnrs\" (UID: \"4bc2255b-95b4-4e5d-84ca-3b62b9da5519\") " pod="openshift-dns/dns-default-4jnrs"
May 28 09:34:10.521244 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:34:10.521158    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 09:34:10.521244 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:34:10.521210    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bc2255b-95b4-4e5d-84ca-3b62b9da5519-metrics-tls podName:4bc2255b-95b4-4e5d-84ca-3b62b9da5519 nodeName:}" failed. No retries permitted until 2026-05-28 09:36:12.521195431 +0000 UTC m=+284.980941066 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4bc2255b-95b4-4e5d-84ca-3b62b9da5519-metrics-tls") pod "dns-default-4jnrs" (UID: "4bc2255b-95b4-4e5d-84ca-3b62b9da5519") : secret "dns-default-metrics-tls" not found
May 28 09:34:16.047728 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:16.047704    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zg2lk_17ebbce7-58aa-49ef-8367-03b9d9f52618/dns-node-resolver/0.log"
May 28 09:34:17.051835 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:17.051808    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nvjjz_e77da112-3527-431e-b09e-a5e7b1e6237a/node-ca/0.log"
May 28 09:34:18.101923 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:18.101889    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jgb2"
May 28 09:34:35.585137 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:35.585105    2578 generic.go:358] "Generic (PLEG): container finished" podID="2d916dc6-fdea-4cbe-96d0-f1e84c6fc898" containerID="ab2a1dc5ea20f83aca1166a46afbd658ea8bf444d2728047cf45e5d46733476e" exitCode=255
May 28 09:34:35.585524 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:35.585167    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-555dccc9b-8jzmx" event={"ID":"2d916dc6-fdea-4cbe-96d0-f1e84c6fc898","Type":"ContainerDied","Data":"ab2a1dc5ea20f83aca1166a46afbd658ea8bf444d2728047cf45e5d46733476e"}
May 28 09:34:35.585524 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:35.585483    2578 scope.go:117] "RemoveContainer" containerID="ab2a1dc5ea20f83aca1166a46afbd658ea8bf444d2728047cf45e5d46733476e"
May 28 09:34:36.049209 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:36.049180    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-g9nwp"]
May 28 09:34:36.052031 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:36.052016    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-g9nwp"
May 28 09:34:36.054735 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:36.054713    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 28 09:34:36.054856 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:36.054740    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 28 09:34:36.055935 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:36.055914    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gxpk9\""
May 28 09:34:36.056024 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:36.055916    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 28 09:34:36.056024 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:36.055964    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 28 09:34:36.063630 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:36.063613    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-g9nwp"]
May 28 09:34:36.206061 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:36.206034    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6ab2cf66-6221-4d97-98e0-6ddace4d1aa8-crio-socket\") pod \"insights-runtime-extractor-g9nwp\" (UID: \"6ab2cf66-6221-4d97-98e0-6ddace4d1aa8\") " pod="openshift-insights/insights-runtime-extractor-g9nwp"
May 28 09:34:36.206164 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:36.206062    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6ab2cf66-6221-4d97-98e0-6ddace4d1aa8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g9nwp\" (UID: \"6ab2cf66-6221-4d97-98e0-6ddace4d1aa8\") " pod="openshift-insights/insights-runtime-extractor-g9nwp"
May 28 09:34:36.206164 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:36.206086    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrcjk\" (UniqueName: \"kubernetes.io/projected/6ab2cf66-6221-4d97-98e0-6ddace4d1aa8-kube-api-access-xrcjk\") pod \"insights-runtime-extractor-g9nwp\" (UID: \"6ab2cf66-6221-4d97-98e0-6ddace4d1aa8\") " pod="openshift-insights/insights-runtime-extractor-g9nwp"
May 28 09:34:36.206164 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:36.206111    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ab2cf66-6221-4d97-98e0-6ddace4d1aa8-data-volume\") pod \"insights-runtime-extractor-g9nwp\" (UID: \"6ab2cf66-6221-4d97-98e0-6ddace4d1aa8\") " pod="openshift-insights/insights-runtime-extractor-g9nwp"
May 28 09:34:36.206288 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:36.206163    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6ab2cf66-6221-4d97-98e0-6ddace4d1aa8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g9nwp\" (UID: \"6ab2cf66-6221-4d97-98e0-6ddace4d1aa8\") " pod="openshift-insights/insights-runtime-extractor-g9nwp"
May 28 09:34:36.306744 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:36.306683    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6ab2cf66-6221-4d97-98e0-6ddace4d1aa8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g9nwp\" (UID: \"6ab2cf66-6221-4d97-98e0-6ddace4d1aa8\") " pod="openshift-insights/insights-runtime-extractor-g9nwp"
May 28 09:34:36.306861 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:36.306780    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6ab2cf66-6221-4d97-98e0-6ddace4d1aa8-crio-socket\") pod \"insights-runtime-extractor-g9nwp\" (UID: \"6ab2cf66-6221-4d97-98e0-6ddace4d1aa8\") " pod="openshift-insights/insights-runtime-extractor-g9nwp"
May 28 09:34:36.306861 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:36.306801    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6ab2cf66-6221-4d97-98e0-6ddace4d1aa8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g9nwp\" (UID: \"6ab2cf66-6221-4d97-98e0-6ddace4d1aa8\") " pod="openshift-insights/insights-runtime-extractor-g9nwp"
May 28 09:34:36.306861 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:36.306816    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xrcjk\" (UniqueName: \"kubernetes.io/projected/6ab2cf66-6221-4d97-98e0-6ddace4d1aa8-kube-api-access-xrcjk\") pod \"insights-runtime-extractor-g9nwp\" (UID: \"6ab2cf66-6221-4d97-98e0-6ddace4d1aa8\") " pod="openshift-insights/insights-runtime-extractor-g9nwp"
May 28 09:34:36.306861 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:36.306851    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ab2cf66-6221-4d97-98e0-6ddace4d1aa8-data-volume\") pod \"insights-runtime-extractor-g9nwp\" (UID: \"6ab2cf66-6221-4d97-98e0-6ddace4d1aa8\") " pod="openshift-insights/insights-runtime-extractor-g9nwp"
May 28 09:34:36.307052 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:36.306918    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6ab2cf66-6221-4d97-98e0-6ddace4d1aa8-crio-socket\") pod \"insights-runtime-extractor-g9nwp\" (UID: \"6ab2cf66-6221-4d97-98e0-6ddace4d1aa8\") " pod="openshift-insights/insights-runtime-extractor-g9nwp"
May 28 09:34:36.307215 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:36.307196    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6ab2cf66-6221-4d97-98e0-6ddace4d1aa8-data-volume\") pod \"insights-runtime-extractor-g9nwp\" (UID: \"6ab2cf66-6221-4d97-98e0-6ddace4d1aa8\") " pod="openshift-insights/insights-runtime-extractor-g9nwp"
May 28 09:34:36.307395 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:36.307379    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6ab2cf66-6221-4d97-98e0-6ddace4d1aa8-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g9nwp\" (UID: \"6ab2cf66-6221-4d97-98e0-6ddace4d1aa8\") " pod="openshift-insights/insights-runtime-extractor-g9nwp"
May 28 09:34:36.308835 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:36.308818    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6ab2cf66-6221-4d97-98e0-6ddace4d1aa8-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g9nwp\" (UID: \"6ab2cf66-6221-4d97-98e0-6ddace4d1aa8\") " pod="openshift-insights/insights-runtime-extractor-g9nwp"
May 28 09:34:36.317975 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:36.317953    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrcjk\" (UniqueName: \"kubernetes.io/projected/6ab2cf66-6221-4d97-98e0-6ddace4d1aa8-kube-api-access-xrcjk\") pod \"insights-runtime-extractor-g9nwp\" (UID: \"6ab2cf66-6221-4d97-98e0-6ddace4d1aa8\") " pod="openshift-insights/insights-runtime-extractor-g9nwp"
May 28 09:34:36.360397 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:36.360372    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-g9nwp"
May 28 09:34:36.484736 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:36.484707    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-g9nwp"]
May 28 09:34:36.487823 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:34:36.487791    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ab2cf66_6221_4d97_98e0_6ddace4d1aa8.slice/crio-53f3a311da51e95a653fa0b3ccea05316aeb1ed1bc6f091b5c3232feba6051dc WatchSource:0}: Error finding container 53f3a311da51e95a653fa0b3ccea05316aeb1ed1bc6f091b5c3232feba6051dc: Status 404 returned error can't find the container with id 53f3a311da51e95a653fa0b3ccea05316aeb1ed1bc6f091b5c3232feba6051dc
May 28 09:34:36.588567 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:36.588503    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-555dccc9b-8jzmx" event={"ID":"2d916dc6-fdea-4cbe-96d0-f1e84c6fc898","Type":"ContainerStarted","Data":"705ee7591a4df4b3f4c26296a9b7a6243a9abf09d4dce6e72f7b0a2d1a04b304"}
May 28 09:34:36.589715 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:36.589693    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g9nwp" event={"ID":"6ab2cf66-6221-4d97-98e0-6ddace4d1aa8","Type":"ContainerStarted","Data":"4dc41586dcfed71cf98bd7c8259c07594dd9c8eb412a66dd8e6573183612a372"}
May 28 09:34:36.589796 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:36.589722    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g9nwp" event={"ID":"6ab2cf66-6221-4d97-98e0-6ddace4d1aa8","Type":"ContainerStarted","Data":"53f3a311da51e95a653fa0b3ccea05316aeb1ed1bc6f091b5c3232feba6051dc"}
May 28 09:34:37.596785 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:37.596756    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g9nwp" event={"ID":"6ab2cf66-6221-4d97-98e0-6ddace4d1aa8","Type":"ContainerStarted","Data":"7bca788833d21f45d03f183891e6ec8e5471063d3d91035052ca3c0b1699945d"}
May 28 09:34:38.600235 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:38.600193    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g9nwp" event={"ID":"6ab2cf66-6221-4d97-98e0-6ddace4d1aa8","Type":"ContainerStarted","Data":"7db34336f90c1d3982e377fc2b0877d83fd2c0812286c97978ccc8d679c9cfd3"}
May 28 09:34:38.621792 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:38.621758    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-g9nwp" podStartSLOduration=0.69570891 podStartE2EDuration="2.621745702s" podCreationTimestamp="2026-05-28 09:34:36 +0000 UTC" firstStartedPulling="2026-05-28 09:34:36.544974758 +0000 UTC m=+189.004720384" lastFinishedPulling="2026-05-28 09:34:38.471011552 +0000 UTC m=+190.930757176" observedRunningTime="2026-05-28 09:34:38.621016157 +0000 UTC m=+191.080761801" watchObservedRunningTime="2026-05-28 09:34:38.621745702 +0000 UTC m=+191.081491346"
May 28 09:34:50.334345 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:50.334312    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8dflz"]
May 28 09:34:50.338732 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:50.337948    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8dflz"
May 28 09:34:50.340914 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:50.340886    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 28 09:34:50.341057 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:50.341029    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 28 09:34:50.341116 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:50.341102    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 28 09:34:50.342243 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:50.342211    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 28 09:34:50.342299 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:50.342243    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 28 09:34:50.342299 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:50.342247    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 28 09:34:50.342418 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:50.342232    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-nt95n\""
May 28 09:34:50.504752 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:50.504714    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8-node-exporter-accelerators-collector-config\") pod \"node-exporter-8dflz\" (UID: \"690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8\") " pod="openshift-monitoring/node-exporter-8dflz"
May 28 09:34:50.504752 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:50.504761    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8-node-exporter-tls\") pod \"node-exporter-8dflz\" (UID: \"690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8\") " pod="openshift-monitoring/node-exporter-8dflz"
May 28 09:34:50.504988 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:50.504779    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8-node-exporter-textfile\") pod \"node-exporter-8dflz\" (UID: \"690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8\") " pod="openshift-monitoring/node-exporter-8dflz"
May 28 09:34:50.504988 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:50.504833    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kn5dm\" (UniqueName: \"kubernetes.io/projected/690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8-kube-api-access-kn5dm\") pod \"node-exporter-8dflz\" (UID: \"690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8\") " pod="openshift-monitoring/node-exporter-8dflz"
May 28 09:34:50.504988 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:50.504870    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8-sys\") pod \"node-exporter-8dflz\" (UID: \"690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8\") " pod="openshift-monitoring/node-exporter-8dflz"
May 28 09:34:50.504988 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:50.504891    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8-node-exporter-wtmp\") pod \"node-exporter-8dflz\" (UID: \"690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8\") " pod="openshift-monitoring/node-exporter-8dflz"
May 28 09:34:50.504988 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:50.504913    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8-root\") pod \"node-exporter-8dflz\" (UID: \"690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8\") " pod="openshift-monitoring/node-exporter-8dflz"
May 28 09:34:50.504988 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:50.504929    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8-metrics-client-ca\") pod \"node-exporter-8dflz\" (UID: \"690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8\") " pod="openshift-monitoring/node-exporter-8dflz"
May 28 09:34:50.504988 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:50.504960    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8dflz\" (UID: \"690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8\") " pod="openshift-monitoring/node-exporter-8dflz"
May 28 09:34:50.606019 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:50.605947    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8-node-exporter-accelerators-collector-config\") pod \"node-exporter-8dflz\" (UID: \"690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8\") " pod="openshift-monitoring/node-exporter-8dflz"
May 28 09:34:50.606019 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:50.605980    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8-node-exporter-tls\") pod \"node-exporter-8dflz\" (UID: \"690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8\") " pod="openshift-monitoring/node-exporter-8dflz"
May 28 09:34:50.606019 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:50.605998    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8-node-exporter-textfile\") pod \"node-exporter-8dflz\" (UID: \"690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8\") " pod="openshift-monitoring/node-exporter-8dflz"
May 28 09:34:50.606019 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:50.606019    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kn5dm\" (UniqueName: \"kubernetes.io/projected/690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8-kube-api-access-kn5dm\") pod \"node-exporter-8dflz\" (UID: \"690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8\") " pod="openshift-monitoring/node-exporter-8dflz"
May 28 09:34:50.606316 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:50.606042    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8-sys\") pod \"node-exporter-8dflz\" (UID: \"690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8\") " pod="openshift-monitoring/node-exporter-8dflz"
May 28 09:34:50.606316 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:50.606069    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8-node-exporter-wtmp\") pod \"node-exporter-8dflz\" (UID: \"690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8\") " pod="openshift-monitoring/node-exporter-8dflz"
May 28 09:34:50.606316 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:50.606131    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8-sys\") pod \"node-exporter-8dflz\" (UID: \"690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8\") " pod="openshift-monitoring/node-exporter-8dflz"
May 28 09:34:50.606316 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:50.606199    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8-node-exporter-wtmp\") pod \"node-exporter-8dflz\" (UID: \"690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8\") " pod="openshift-monitoring/node-exporter-8dflz"
May 28 09:34:50.606316 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:50.606271    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8-root\") pod \"node-exporter-8dflz\" (UID: \"690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8\") " pod="openshift-monitoring/node-exporter-8dflz"
May 28 09:34:50.606316 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:50.606308    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8-metrics-client-ca\") pod \"node-exporter-8dflz\" (UID: \"690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8\") " pod="openshift-monitoring/node-exporter-8dflz"
May 28 09:34:50.606570 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:50.606341    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8-root\") pod \"node-exporter-8dflz\" (UID: \"690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8\") " pod="openshift-monitoring/node-exporter-8dflz"
May 28 09:34:50.606570 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:50.606342    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8dflz\" (UID: \"690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8\") " pod="openshift-monitoring/node-exporter-8dflz"
May 28 09:34:50.606570 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:50.606380    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8-node-exporter-textfile\") pod \"node-exporter-8dflz\" (UID: \"690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8\") " pod="openshift-monitoring/node-exporter-8dflz"
May 28 09:34:50.606676 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:50.606603    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8-node-exporter-accelerators-collector-config\") pod \"node-exporter-8dflz\" (UID: \"690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8\") " pod="openshift-monitoring/node-exporter-8dflz"
May 28 09:34:50.606728 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:50.606714    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8-metrics-client-ca\") pod \"node-exporter-8dflz\" (UID: \"690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8\") " pod="openshift-monitoring/node-exporter-8dflz"
May 28 09:34:50.608297 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:50.608276    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8-node-exporter-tls\") pod \"node-exporter-8dflz\" (UID: \"690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8\") " pod="openshift-monitoring/node-exporter-8dflz"
May 28 09:34:50.608386 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:50.608366    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8dflz\" (UID: \"690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8\") " pod="openshift-monitoring/node-exporter-8dflz"
May 28 09:34:50.615317 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:50.615295    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kn5dm\" (UniqueName: \"kubernetes.io/projected/690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8-kube-api-access-kn5dm\") pod \"node-exporter-8dflz\" (UID: \"690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8\") " pod="openshift-monitoring/node-exporter-8dflz"
May 28 09:34:50.647683 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:50.647664    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8dflz"
May 28 09:34:50.655002 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:34:50.654977    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod690a6a6c_b9c0_48bb_ad9c_2f5a1b0288b8.slice/crio-f0323204a4b74dae903445275d09929818f02b975efd845250f7723190034b79 WatchSource:0}: Error finding container f0323204a4b74dae903445275d09929818f02b975efd845250f7723190034b79: Status 404 returned error can't find the container with id f0323204a4b74dae903445275d09929818f02b975efd845250f7723190034b79
May 28 09:34:51.630413 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:51.630387    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8dflz" event={"ID":"690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8","Type":"ContainerStarted","Data":"e087680077ec5c88497fc7f99d0eed9cf40ff06ea337e6e30957e24672ac40da"}
May 28 09:34:51.630734 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:51.630424    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8dflz" event={"ID":"690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8","Type":"ContainerStarted","Data":"f0323204a4b74dae903445275d09929818f02b975efd845250f7723190034b79"}
May 28 09:34:52.636013 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:52.635982    2578 generic.go:358] "Generic (PLEG): container finished" podID="690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8" containerID="e087680077ec5c88497fc7f99d0eed9cf40ff06ea337e6e30957e24672ac40da" exitCode=0
May 28 09:34:52.636382 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:52.636032    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8dflz" event={"ID":"690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8","Type":"ContainerDied","Data":"e087680077ec5c88497fc7f99d0eed9cf40ff06ea337e6e30957e24672ac40da"}
May 28 09:34:53.640317 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:53.640286    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8dflz" event={"ID":"690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8","Type":"ContainerStarted","Data":"85a7362a1113143d0f3f629ebf9f2accf6c8d7468f232fb759204cd26ec641fb"}
May 28 09:34:53.640317 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:53.640319    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8dflz" event={"ID":"690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8","Type":"ContainerStarted","Data":"41c2cf3ed138f62ea84d159b4caa1a001133f5fdf3f0c2669eed516d839847a3"}
May 28 09:34:53.673455 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:53.673414    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8dflz" podStartSLOduration=2.770721474 podStartE2EDuration="3.673401574s" podCreationTimestamp="2026-05-28 09:34:50 +0000 UTC" firstStartedPulling="2026-05-28 09:34:50.656593016 +0000 UTC m=+203.116338639" lastFinishedPulling="2026-05-28 09:34:51.559273103 +0000 UTC m=+204.019018739" observedRunningTime="2026-05-28 09:34:53.671743887 +0000 UTC m=+206.131489530" watchObservedRunningTime="2026-05-28 09:34:53.673401574 +0000 UTC m=+206.133147250"
May 28 09:34:55.582233 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:55.582171    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-697fdcbfff-dj6rb"]
May 28 09:34:55.585179 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:55.585162    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-697fdcbfff-dj6rb"
May 28 09:34:55.587895 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:55.587871    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
May 28 09:34:55.587895 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:55.587878    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
May 28 09:34:55.588112 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:55.587902    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
May 28 09:34:55.588112 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:55.587881    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-5z6j7\""
May 28 09:34:55.588112 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:55.587958    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
May 28 09:34:55.588318 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:55.588195    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
May 28 09:34:55.593042 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:55.593025    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
May 28 09:34:55.596993 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:55.596974    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-697fdcbfff-dj6rb"]
May 28 09:34:55.749311 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:55.749284    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfw4b\" (UniqueName: \"kubernetes.io/projected/c5e6ca04-3465-47d4-86ab-2b47472b772b-kube-api-access-vfw4b\") pod \"telemeter-client-697fdcbfff-dj6rb\" (UID: \"c5e6ca04-3465-47d4-86ab-2b47472b772b\") " pod="openshift-monitoring/telemeter-client-697fdcbfff-dj6rb"
May 28 09:34:55.749486 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:55.749321    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5e6ca04-3465-47d4-86ab-2b47472b772b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-697fdcbfff-dj6rb\" (UID: \"c5e6ca04-3465-47d4-86ab-2b47472b772b\") " pod="openshift-monitoring/telemeter-client-697fdcbfff-dj6rb"
May 28 09:34:55.749486 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:55.749360    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5e6ca04-3465-47d4-86ab-2b47472b772b-metrics-client-ca\") pod \"telemeter-client-697fdcbfff-dj6rb\" (UID: \"c5e6ca04-3465-47d4-86ab-2b47472b772b\") " pod="openshift-monitoring/telemeter-client-697fdcbfff-dj6rb"
May 28 09:34:55.749486 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:55.749407    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c5e6ca04-3465-47d4-86ab-2b47472b772b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-697fdcbfff-dj6rb\" (UID: \"c5e6ca04-3465-47d4-86ab-2b47472b772b\") " pod="openshift-monitoring/telemeter-client-697fdcbfff-dj6rb"
May 28 09:34:55.749486 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:55.749463    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c5e6ca04-3465-47d4-86ab-2b47472b772b-secret-telemeter-client\") pod \"telemeter-client-697fdcbfff-dj6rb\" (UID: \"c5e6ca04-3465-47d4-86ab-2b47472b772b\") " pod="openshift-monitoring/telemeter-client-697fdcbfff-dj6rb"
May 28 09:34:55.749636 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:55.749497    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c5e6ca04-3465-47d4-86ab-2b47472b772b-telemeter-client-tls\") pod \"telemeter-client-697fdcbfff-dj6rb\" (UID: \"c5e6ca04-3465-47d4-86ab-2b47472b772b\") " pod="openshift-monitoring/telemeter-client-697fdcbfff-dj6rb"
May 28 09:34:55.749636 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:55.749523    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c5e6ca04-3465-47d4-86ab-2b47472b772b-federate-client-tls\") pod \"telemeter-client-697fdcbfff-dj6rb\" (UID: \"c5e6ca04-3465-47d4-86ab-2b47472b772b\") " pod="openshift-monitoring/telemeter-client-697fdcbfff-dj6rb"
May 28 09:34:55.749636 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:55.749585    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5e6ca04-3465-47d4-86ab-2b47472b772b-serving-certs-ca-bundle\") pod \"telemeter-client-697fdcbfff-dj6rb\" (UID: \"c5e6ca04-3465-47d4-86ab-2b47472b772b\") " pod="openshift-monitoring/telemeter-client-697fdcbfff-dj6rb"
May 28 09:34:55.850468 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:55.850401    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5e6ca04-3465-47d4-86ab-2b47472b772b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-697fdcbfff-dj6rb\" (UID: \"c5e6ca04-3465-47d4-86ab-2b47472b772b\") " pod="openshift-monitoring/telemeter-client-697fdcbfff-dj6rb"
May 28 09:34:55.850468 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:55.850455    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5e6ca04-3465-47d4-86ab-2b47472b772b-metrics-client-ca\") pod \"telemeter-client-697fdcbfff-dj6rb\" (UID: \"c5e6ca04-3465-47d4-86ab-2b47472b772b\") " pod="openshift-monitoring/telemeter-client-697fdcbfff-dj6rb"
May 28 09:34:55.850647 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:55.850625    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c5e6ca04-3465-47d4-86ab-2b47472b772b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-697fdcbfff-dj6rb\" (UID: \"c5e6ca04-3465-47d4-86ab-2b47472b772b\") " pod="openshift-monitoring/telemeter-client-697fdcbfff-dj6rb"
May 28 09:34:55.850707 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:55.850666    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c5e6ca04-3465-47d4-86ab-2b47472b772b-secret-telemeter-client\") pod \"telemeter-client-697fdcbfff-dj6rb\" (UID: \"c5e6ca04-3465-47d4-86ab-2b47472b772b\") " pod="openshift-monitoring/telemeter-client-697fdcbfff-dj6rb"
May 28 09:34:55.850763 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:55.850703    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c5e6ca04-3465-47d4-86ab-2b47472b772b-telemeter-client-tls\") pod \"telemeter-client-697fdcbfff-dj6rb\" (UID: \"c5e6ca04-3465-47d4-86ab-2b47472b772b\") " pod="openshift-monitoring/telemeter-client-697fdcbfff-dj6rb"
May 28 09:34:55.850763 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:55.850740    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c5e6ca04-3465-47d4-86ab-2b47472b772b-federate-client-tls\") pod \"telemeter-client-697fdcbfff-dj6rb\" (UID: \"c5e6ca04-3465-47d4-86ab-2b47472b772b\") " pod="openshift-monitoring/telemeter-client-697fdcbfff-dj6rb"
May 28 09:34:55.850859 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:55.850789    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5e6ca04-3465-47d4-86ab-2b47472b772b-serving-certs-ca-bundle\") pod \"telemeter-client-697fdcbfff-dj6rb\" (UID: \"c5e6ca04-3465-47d4-86ab-2b47472b772b\") " pod="openshift-monitoring/telemeter-client-697fdcbfff-dj6rb"
May 28 09:34:55.851320 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:55.850971    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vfw4b\" (UniqueName: \"kubernetes.io/projected/c5e6ca04-3465-47d4-86ab-2b47472b772b-kube-api-access-vfw4b\") pod \"telemeter-client-697fdcbfff-dj6rb\" (UID: \"c5e6ca04-3465-47d4-86ab-2b47472b772b\") " pod="openshift-monitoring/telemeter-client-697fdcbfff-dj6rb"
May 28 09:34:55.851320 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:55.851177    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5e6ca04-3465-47d4-86ab-2b47472b772b-metrics-client-ca\") pod \"telemeter-client-697fdcbfff-dj6rb\" (UID: \"c5e6ca04-3465-47d4-86ab-2b47472b772b\") " pod="openshift-monitoring/telemeter-client-697fdcbfff-dj6rb"
May 28 09:34:55.851492 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:55.851373    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5e6ca04-3465-47d4-86ab-2b47472b772b-serving-certs-ca-bundle\") pod \"telemeter-client-697fdcbfff-dj6rb\" (UID: \"c5e6ca04-3465-47d4-86ab-2b47472b772b\") " pod="openshift-monitoring/telemeter-client-697fdcbfff-dj6rb"
May 28 09:34:55.851547 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:55.851509    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5e6ca04-3465-47d4-86ab-2b47472b772b-telemeter-trusted-ca-bundle\") pod \"telemeter-client-697fdcbfff-dj6rb\" (UID: \"c5e6ca04-3465-47d4-86ab-2b47472b772b\") " pod="openshift-monitoring/telemeter-client-697fdcbfff-dj6rb"
May 28 09:34:55.853306 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:55.853283    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c5e6ca04-3465-47d4-86ab-2b47472b772b-secret-telemeter-client\") pod \"telemeter-client-697fdcbfff-dj6rb\" (UID: \"c5e6ca04-3465-47d4-86ab-2b47472b772b\") " pod="openshift-monitoring/telemeter-client-697fdcbfff-dj6rb"
May 28 09:34:55.853604 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:55.853587    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c5e6ca04-3465-47d4-86ab-2b47472b772b-federate-client-tls\") pod \"telemeter-client-697fdcbfff-dj6rb\" (UID: \"c5e6ca04-3465-47d4-86ab-2b47472b772b\") " pod="openshift-monitoring/telemeter-client-697fdcbfff-dj6rb"
May 28 09:34:55.853664 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:55.853628    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c5e6ca04-3465-47d4-86ab-2b47472b772b-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-697fdcbfff-dj6rb\" (UID: \"c5e6ca04-3465-47d4-86ab-2b47472b772b\") " pod="openshift-monitoring/telemeter-client-697fdcbfff-dj6rb"
May 28 09:34:55.853664 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:55.853651    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c5e6ca04-3465-47d4-86ab-2b47472b772b-telemeter-client-tls\") pod \"telemeter-client-697fdcbfff-dj6rb\" (UID: \"c5e6ca04-3465-47d4-86ab-2b47472b772b\") " pod="openshift-monitoring/telemeter-client-697fdcbfff-dj6rb"
May 28 09:34:55.866952 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:55.866928    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfw4b\" (UniqueName: \"kubernetes.io/projected/c5e6ca04-3465-47d4-86ab-2b47472b772b-kube-api-access-vfw4b\") pod \"telemeter-client-697fdcbfff-dj6rb\" (UID: \"c5e6ca04-3465-47d4-86ab-2b47472b772b\") " pod="openshift-monitoring/telemeter-client-697fdcbfff-dj6rb"
May 28 09:34:55.893827 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:55.893807    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-697fdcbfff-dj6rb"
May 28 09:34:56.013992 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:56.013968    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-697fdcbfff-dj6rb"]
May 28 09:34:56.016311 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:34:56.016284    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5e6ca04_3465_47d4_86ab_2b47472b772b.slice/crio-8b43c756aef9abc4f3a86f382d300f6b2384b55ea9a28a5f7d751b2a0eefd65c WatchSource:0}: Error finding container 8b43c756aef9abc4f3a86f382d300f6b2384b55ea9a28a5f7d751b2a0eefd65c: Status 404 returned error can't find the container with id 8b43c756aef9abc4f3a86f382d300f6b2384b55ea9a28a5f7d751b2a0eefd65c
May 28 09:34:56.649978 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:56.649945    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-697fdcbfff-dj6rb" event={"ID":"c5e6ca04-3465-47d4-86ab-2b47472b772b","Type":"ContainerStarted","Data":"8b43c756aef9abc4f3a86f382d300f6b2384b55ea9a28a5f7d751b2a0eefd65c"}
May 28 09:34:58.259994 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:58.259961    2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-84ff99d684-f4qwp"]
May 28 09:34:58.261034 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:34:58.260993    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-84ff99d684-f4qwp" podUID="a6ff9851-21a3-400e-9444-0b26d8e695d0"
May 28 09:34:58.657443 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:58.657367    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84ff99d684-f4qwp"
May 28 09:34:58.657443 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:58.657367    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-697fdcbfff-dj6rb" event={"ID":"c5e6ca04-3465-47d4-86ab-2b47472b772b","Type":"ContainerStarted","Data":"bf83617b927194adfc0c3ff59b05def00c568d7f8e74c4487c1638c1f1e3ac3d"}
May 28 09:34:58.661738 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:58.661720    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84ff99d684-f4qwp"
May 28 09:34:58.668835 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:58.668816    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a6ff9851-21a3-400e-9444-0b26d8e695d0-registry-certificates\") pod \"a6ff9851-21a3-400e-9444-0b26d8e695d0\" (UID: \"a6ff9851-21a3-400e-9444-0b26d8e695d0\") "
May 28 09:34:58.668959 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:58.668850    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a6ff9851-21a3-400e-9444-0b26d8e695d0-installation-pull-secrets\") pod \"a6ff9851-21a3-400e-9444-0b26d8e695d0\" (UID: \"a6ff9851-21a3-400e-9444-0b26d8e695d0\") "
May 28 09:34:58.668959 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:58.668877    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a6ff9851-21a3-400e-9444-0b26d8e695d0-trusted-ca\") pod \"a6ff9851-21a3-400e-9444-0b26d8e695d0\" (UID: \"a6ff9851-21a3-400e-9444-0b26d8e695d0\") "
May 28 09:34:58.668959 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:58.668928    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a6ff9851-21a3-400e-9444-0b26d8e695d0-bound-sa-token\") pod \"a6ff9851-21a3-400e-9444-0b26d8e695d0\" (UID: \"a6ff9851-21a3-400e-9444-0b26d8e695d0\") "
May 28 09:34:58.669116 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:58.668973    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a6ff9851-21a3-400e-9444-0b26d8e695d0-image-registry-private-configuration\") pod \"a6ff9851-21a3-400e-9444-0b26d8e695d0\" (UID: \"a6ff9851-21a3-400e-9444-0b26d8e695d0\") "
May 28 09:34:58.669116 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:58.669022    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bgzdn\" (UniqueName: \"kubernetes.io/projected/a6ff9851-21a3-400e-9444-0b26d8e695d0-kube-api-access-bgzdn\") pod \"a6ff9851-21a3-400e-9444-0b26d8e695d0\" (UID: \"a6ff9851-21a3-400e-9444-0b26d8e695d0\") "
May 28 09:34:58.669116 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:58.669054    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a6ff9851-21a3-400e-9444-0b26d8e695d0-ca-trust-extracted\") pod \"a6ff9851-21a3-400e-9444-0b26d8e695d0\" (UID: \"a6ff9851-21a3-400e-9444-0b26d8e695d0\") "
May 28 09:34:58.669297 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:58.669268    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6ff9851-21a3-400e-9444-0b26d8e695d0-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "a6ff9851-21a3-400e-9444-0b26d8e695d0" (UID: "a6ff9851-21a3-400e-9444-0b26d8e695d0"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 09:34:58.669369 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:58.669331    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6ff9851-21a3-400e-9444-0b26d8e695d0-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "a6ff9851-21a3-400e-9444-0b26d8e695d0" (UID: "a6ff9851-21a3-400e-9444-0b26d8e695d0"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 09:34:58.669512 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:58.669471    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a6ff9851-21a3-400e-9444-0b26d8e695d0-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "a6ff9851-21a3-400e-9444-0b26d8e695d0" (UID: "a6ff9851-21a3-400e-9444-0b26d8e695d0"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 09:34:58.671900 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:58.671831    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6ff9851-21a3-400e-9444-0b26d8e695d0-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "a6ff9851-21a3-400e-9444-0b26d8e695d0" (UID: "a6ff9851-21a3-400e-9444-0b26d8e695d0"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:34:58.672006 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:58.671918    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6ff9851-21a3-400e-9444-0b26d8e695d0-kube-api-access-bgzdn" (OuterVolumeSpecName: "kube-api-access-bgzdn") pod "a6ff9851-21a3-400e-9444-0b26d8e695d0" (UID: "a6ff9851-21a3-400e-9444-0b26d8e695d0"). InnerVolumeSpecName "kube-api-access-bgzdn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 09:34:58.672006 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:58.671961    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6ff9851-21a3-400e-9444-0b26d8e695d0-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "a6ff9851-21a3-400e-9444-0b26d8e695d0" (UID: "a6ff9851-21a3-400e-9444-0b26d8e695d0"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:34:58.672119 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:58.672047    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6ff9851-21a3-400e-9444-0b26d8e695d0-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "a6ff9851-21a3-400e-9444-0b26d8e695d0" (UID: "a6ff9851-21a3-400e-9444-0b26d8e695d0"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 09:34:58.769633 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:58.769604    2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a6ff9851-21a3-400e-9444-0b26d8e695d0-ca-trust-extracted\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 09:34:58.769633 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:58.769631    2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a6ff9851-21a3-400e-9444-0b26d8e695d0-registry-certificates\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 09:34:58.769633 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:58.769641    2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a6ff9851-21a3-400e-9444-0b26d8e695d0-installation-pull-secrets\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 09:34:58.769832 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:58.769651    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a6ff9851-21a3-400e-9444-0b26d8e695d0-trusted-ca\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 09:34:58.769832 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:58.769660    2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a6ff9851-21a3-400e-9444-0b26d8e695d0-bound-sa-token\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 09:34:58.769832 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:58.769669    2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a6ff9851-21a3-400e-9444-0b26d8e695d0-image-registry-private-configuration\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 09:34:58.769832 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:58.769678    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bgzdn\" (UniqueName: \"kubernetes.io/projected/a6ff9851-21a3-400e-9444-0b26d8e695d0-kube-api-access-bgzdn\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 09:34:59.661777 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:59.661749    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-84ff99d684-f4qwp"
May 28 09:34:59.662106 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:59.661780    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-697fdcbfff-dj6rb" event={"ID":"c5e6ca04-3465-47d4-86ab-2b47472b772b","Type":"ContainerStarted","Data":"8fb7f3289281a385b9db0b4c113072035bb03e8a995d7d08f5eb68666b5b7dc6"}
May 28 09:34:59.662106 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:59.661815    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-697fdcbfff-dj6rb" event={"ID":"c5e6ca04-3465-47d4-86ab-2b47472b772b","Type":"ContainerStarted","Data":"2697e00f2ffc48998a17245f281a484bb1ed4f6e4eba81ef5b46a042b86d0702"}
May 28 09:34:59.690806 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:59.690761    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-697fdcbfff-dj6rb" podStartSLOduration=1.891754899 podStartE2EDuration="4.69074663s" podCreationTimestamp="2026-05-28 09:34:55 +0000 UTC" firstStartedPulling="2026-05-28 09:34:56.018022752 +0000 UTC m=+208.477768376" lastFinishedPulling="2026-05-28 09:34:58.817014484 +0000 UTC m=+211.276760107" observedRunningTime="2026-05-28 09:34:59.688856771 +0000 UTC m=+212.148602415" watchObservedRunningTime="2026-05-28 09:34:59.69074663 +0000 UTC m=+212.150492276"
May 28 09:34:59.744915 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:59.744885    2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-84ff99d684-f4qwp"]
May 28 09:34:59.753764 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:59.753736    2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-84ff99d684-f4qwp"]
May 28 09:34:59.777227 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:34:59.777206    2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a6ff9851-21a3-400e-9444-0b26d8e695d0-registry-tls\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 09:35:00.105000 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:00.104974    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6ff9851-21a3-400e-9444-0b26d8e695d0" path="/var/lib/kubelet/pods/a6ff9851-21a3-400e-9444-0b26d8e695d0/volumes"
May 28 09:35:02.990937 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:02.990902    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-98b55bccd-m22s7"]
May 28 09:35:02.994245 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:02.994213    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-98b55bccd-m22s7"
May 28 09:35:02.996921 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:02.996897    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 28 09:35:02.997062 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:02.996937    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 28 09:35:02.997062 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:02.996950    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 28 09:35:02.997062 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:02.997029    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-jptm6\""
May 28 09:35:02.997251 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:02.997181    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 28 09:35:02.997251 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:02.997208    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 28 09:35:02.997425 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:02.997408    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 28 09:35:02.998266 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:02.998251    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 28 09:35:02.999445 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:02.999425    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/30b47c1d-0b19-4ff4-b904-47032d2f6765-console-config\") pod \"console-98b55bccd-m22s7\" (UID: \"30b47c1d-0b19-4ff4-b904-47032d2f6765\") " pod="openshift-console/console-98b55bccd-m22s7"
May 28 09:35:02.999543 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:02.999469    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/30b47c1d-0b19-4ff4-b904-47032d2f6765-service-ca\") pod \"console-98b55bccd-m22s7\" (UID: \"30b47c1d-0b19-4ff4-b904-47032d2f6765\") " pod="openshift-console/console-98b55bccd-m22s7"
May 28 09:35:02.999543 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:02.999507    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30b47c1d-0b19-4ff4-b904-47032d2f6765-trusted-ca-bundle\") pod \"console-98b55bccd-m22s7\" (UID: \"30b47c1d-0b19-4ff4-b904-47032d2f6765\") " pod="openshift-console/console-98b55bccd-m22s7"
May 28 09:35:02.999643 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:02.999574    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/30b47c1d-0b19-4ff4-b904-47032d2f6765-oauth-serving-cert\") pod \"console-98b55bccd-m22s7\" (UID: \"30b47c1d-0b19-4ff4-b904-47032d2f6765\") " pod="openshift-console/console-98b55bccd-m22s7"
May 28 09:35:02.999643 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:02.999603    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxpd8\" (UniqueName: \"kubernetes.io/projected/30b47c1d-0b19-4ff4-b904-47032d2f6765-kube-api-access-mxpd8\") pod \"console-98b55bccd-m22s7\" (UID: \"30b47c1d-0b19-4ff4-b904-47032d2f6765\") " pod="openshift-console/console-98b55bccd-m22s7"
May 28 09:35:02.999744 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:02.999638    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/30b47c1d-0b19-4ff4-b904-47032d2f6765-console-serving-cert\") pod \"console-98b55bccd-m22s7\" (UID: \"30b47c1d-0b19-4ff4-b904-47032d2f6765\") " pod="openshift-console/console-98b55bccd-m22s7"
May 28 09:35:02.999813 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:02.999794    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/30b47c1d-0b19-4ff4-b904-47032d2f6765-console-oauth-config\") pod \"console-98b55bccd-m22s7\" (UID: \"30b47c1d-0b19-4ff4-b904-47032d2f6765\") " pod="openshift-console/console-98b55bccd-m22s7"
May 28 09:35:03.002022 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:03.001989    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 28 09:35:03.003130 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:03.003114    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-98b55bccd-m22s7"]
May 28 09:35:03.100647 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:03.100622    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/30b47c1d-0b19-4ff4-b904-47032d2f6765-console-config\") pod \"console-98b55bccd-m22s7\" (UID: \"30b47c1d-0b19-4ff4-b904-47032d2f6765\") " pod="openshift-console/console-98b55bccd-m22s7"
May 28 09:35:03.100772 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:03.100657    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/30b47c1d-0b19-4ff4-b904-47032d2f6765-service-ca\") pod \"console-98b55bccd-m22s7\" (UID: \"30b47c1d-0b19-4ff4-b904-47032d2f6765\") " pod="openshift-console/console-98b55bccd-m22s7"
May 28 09:35:03.100772 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:03.100674    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30b47c1d-0b19-4ff4-b904-47032d2f6765-trusted-ca-bundle\") pod \"console-98b55bccd-m22s7\" (UID: \"30b47c1d-0b19-4ff4-b904-47032d2f6765\") " pod="openshift-console/console-98b55bccd-m22s7"
May 28 09:35:03.100881 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:03.100810    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/30b47c1d-0b19-4ff4-b904-47032d2f6765-oauth-serving-cert\") pod \"console-98b55bccd-m22s7\" (UID: \"30b47c1d-0b19-4ff4-b904-47032d2f6765\") " pod="openshift-console/console-98b55bccd-m22s7"
May 28 09:35:03.100881 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:03.100850    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mxpd8\" (UniqueName: \"kubernetes.io/projected/30b47c1d-0b19-4ff4-b904-47032d2f6765-kube-api-access-mxpd8\") pod \"console-98b55bccd-m22s7\" (UID: \"30b47c1d-0b19-4ff4-b904-47032d2f6765\") " pod="openshift-console/console-98b55bccd-m22s7"
May 28 09:35:03.100992 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:03.100879    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/30b47c1d-0b19-4ff4-b904-47032d2f6765-console-serving-cert\") pod \"console-98b55bccd-m22s7\" (UID: \"30b47c1d-0b19-4ff4-b904-47032d2f6765\") " pod="openshift-console/console-98b55bccd-m22s7"
May 28 09:35:03.100992 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:03.100979    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/30b47c1d-0b19-4ff4-b904-47032d2f6765-console-oauth-config\") pod \"console-98b55bccd-m22s7\" (UID: \"30b47c1d-0b19-4ff4-b904-47032d2f6765\") " pod="openshift-console/console-98b55bccd-m22s7"
May 28 09:35:03.101347 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:03.101325    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/30b47c1d-0b19-4ff4-b904-47032d2f6765-service-ca\") pod \"console-98b55bccd-m22s7\" (UID: \"30b47c1d-0b19-4ff4-b904-47032d2f6765\") " pod="openshift-console/console-98b55bccd-m22s7"
May 28 09:35:03.101410 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:03.101327    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/30b47c1d-0b19-4ff4-b904-47032d2f6765-console-config\") pod \"console-98b55bccd-m22s7\" (UID: \"30b47c1d-0b19-4ff4-b904-47032d2f6765\") " pod="openshift-console/console-98b55bccd-m22s7"
May 28 09:35:03.101530 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:03.101505    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30b47c1d-0b19-4ff4-b904-47032d2f6765-trusted-ca-bundle\") pod \"console-98b55bccd-m22s7\" (UID: \"30b47c1d-0b19-4ff4-b904-47032d2f6765\") " pod="openshift-console/console-98b55bccd-m22s7"
May 28 09:35:03.101635 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:03.101511    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/30b47c1d-0b19-4ff4-b904-47032d2f6765-oauth-serving-cert\") pod \"console-98b55bccd-m22s7\" (UID: \"30b47c1d-0b19-4ff4-b904-47032d2f6765\") " pod="openshift-console/console-98b55bccd-m22s7"
May 28 09:35:03.103256 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:03.103214    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/30b47c1d-0b19-4ff4-b904-47032d2f6765-console-oauth-config\") pod \"console-98b55bccd-m22s7\" (UID: \"30b47c1d-0b19-4ff4-b904-47032d2f6765\") " pod="openshift-console/console-98b55bccd-m22s7"
May 28 09:35:03.103329 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:03.103319    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/30b47c1d-0b19-4ff4-b904-47032d2f6765-console-serving-cert\") pod \"console-98b55bccd-m22s7\" (UID: \"30b47c1d-0b19-4ff4-b904-47032d2f6765\") " pod="openshift-console/console-98b55bccd-m22s7"
May 28 09:35:03.112934 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:03.112912    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxpd8\" (UniqueName: \"kubernetes.io/projected/30b47c1d-0b19-4ff4-b904-47032d2f6765-kube-api-access-mxpd8\") pod \"console-98b55bccd-m22s7\" (UID: \"30b47c1d-0b19-4ff4-b904-47032d2f6765\") " pod="openshift-console/console-98b55bccd-m22s7"
May 28 09:35:03.303533 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:03.303463    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-98b55bccd-m22s7"
May 28 09:35:03.434252 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:03.434206    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-98b55bccd-m22s7"]
May 28 09:35:03.437275 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:35:03.437245    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30b47c1d_0b19_4ff4_b904_47032d2f6765.slice/crio-971fd1d0bad48c227f5f43ee3d02473abc171d8146baff0010f669c4419bf370 WatchSource:0}: Error finding container 971fd1d0bad48c227f5f43ee3d02473abc171d8146baff0010f669c4419bf370: Status 404 returned error can't find the container with id 971fd1d0bad48c227f5f43ee3d02473abc171d8146baff0010f669c4419bf370
May 28 09:35:03.672624 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:03.672543    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-98b55bccd-m22s7" event={"ID":"30b47c1d-0b19-4ff4-b904-47032d2f6765","Type":"ContainerStarted","Data":"971fd1d0bad48c227f5f43ee3d02473abc171d8146baff0010f669c4419bf370"}
May 28 09:35:06.686331 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:06.686299    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-98b55bccd-m22s7" event={"ID":"30b47c1d-0b19-4ff4-b904-47032d2f6765","Type":"ContainerStarted","Data":"8d50a2b133a74adce0c6990b76986cae41b33d204af6861a4c6db1474376ada2"}
May 28 09:35:06.708026 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:06.707980    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-98b55bccd-m22s7" podStartSLOduration=2.318912458 podStartE2EDuration="4.707969156s" podCreationTimestamp="2026-05-28 09:35:02 +0000 UTC" firstStartedPulling="2026-05-28 09:35:03.439134951 +0000 UTC m=+215.898880574" lastFinishedPulling="2026-05-28 09:35:05.828191645 +0000 UTC m=+218.287937272" observedRunningTime="2026-05-28 09:35:06.706358022 +0000 UTC m=+219.166103678" watchObservedRunningTime="2026-05-28 09:35:06.707969156 +0000 UTC m=+219.167714802"
May 28 09:35:13.303710 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:13.303671    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-98b55bccd-m22s7"
May 28 09:35:13.304109 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:13.303728    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-98b55bccd-m22s7"
May 28 09:35:13.308439 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:13.308417    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-98b55bccd-m22s7"
May 28 09:35:13.706600 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:13.706572    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-98b55bccd-m22s7"
May 28 09:35:30.334460 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:30.334417    2578 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f6bf4f776-86qfp" podUID="666e1a9c-fdbf-477c-be7f-94b2f0afd792" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 28 09:35:39.987139 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:39.987055    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36d6c59d-f6ef-439d-8a97-58441ccdb9de-metrics-certs\") pod \"network-metrics-daemon-4jgb2\" (UID: \"36d6c59d-f6ef-439d-8a97-58441ccdb9de\") " pod="openshift-multus/network-metrics-daemon-4jgb2"
May 28 09:35:39.989265 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:39.989240    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36d6c59d-f6ef-439d-8a97-58441ccdb9de-metrics-certs\") pod \"network-metrics-daemon-4jgb2\" (UID: \"36d6c59d-f6ef-439d-8a97-58441ccdb9de\") " pod="openshift-multus/network-metrics-daemon-4jgb2"
May 28 09:35:40.005663 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:40.005642    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-rxqxx\""
May 28 09:35:40.013734 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:40.013717    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4jgb2"
May 28 09:35:40.138743 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:40.138715    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4jgb2"]
May 28 09:35:40.141404 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:35:40.141376    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36d6c59d_f6ef_439d_8a97_58441ccdb9de.slice/crio-c27359e2f57ac039d755911c72900a433a3d8ca64bc37fde99e4a9ab1f4ceeba WatchSource:0}: Error finding container c27359e2f57ac039d755911c72900a433a3d8ca64bc37fde99e4a9ab1f4ceeba: Status 404 returned error can't find the container with id c27359e2f57ac039d755911c72900a433a3d8ca64bc37fde99e4a9ab1f4ceeba
May 28 09:35:40.334495 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:40.334422    2578 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f6bf4f776-86qfp" podUID="666e1a9c-fdbf-477c-be7f-94b2f0afd792" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 28 09:35:40.775538 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:40.775503    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4jgb2" event={"ID":"36d6c59d-f6ef-439d-8a97-58441ccdb9de","Type":"ContainerStarted","Data":"c27359e2f57ac039d755911c72900a433a3d8ca64bc37fde99e4a9ab1f4ceeba"}
May 28 09:35:41.779174 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:41.779133    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4jgb2" event={"ID":"36d6c59d-f6ef-439d-8a97-58441ccdb9de","Type":"ContainerStarted","Data":"2de64ca372b7c93051cf04c945e471a44d4d8e19cbb7673a92b221008030339a"}
May 28 09:35:41.779174 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:41.779166    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4jgb2" event={"ID":"36d6c59d-f6ef-439d-8a97-58441ccdb9de","Type":"ContainerStarted","Data":"34b74f00db1929f9d864167befc69cd073c9e3abbd6831adf9e126ed3dcc9ded"}
May 28 09:35:41.796430 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:41.796387    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4jgb2" podStartSLOduration=252.882508877 podStartE2EDuration="4m13.796375534s" podCreationTimestamp="2026-05-28 09:31:28 +0000 UTC" firstStartedPulling="2026-05-28 09:35:40.143153953 +0000 UTC m=+252.602899591" lastFinishedPulling="2026-05-28 09:35:41.057020615 +0000 UTC m=+253.516766248" observedRunningTime="2026-05-28 09:35:41.795194548 +0000 UTC m=+254.254940192" watchObservedRunningTime="2026-05-28 09:35:41.796375534 +0000 UTC m=+254.256121179"
May 28 09:35:50.334697 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:50.334659    2578 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f6bf4f776-86qfp" podUID="666e1a9c-fdbf-477c-be7f-94b2f0afd792" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500"
May 28 09:35:50.335036 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:50.334724    2578 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f6bf4f776-86qfp"
May 28 09:35:50.335160 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:50.335132    2578 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"5e0bb5981ee3a13238301b3bfc92df9ff373f9ebde0be37a1dacb290a0890e25"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f6bf4f776-86qfp" containerMessage="Container service-proxy failed liveness probe, will be restarted"
May 28 09:35:50.335198 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:50.335178    2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f6bf4f776-86qfp" podUID="666e1a9c-fdbf-477c-be7f-94b2f0afd792" containerName="service-proxy" containerID="cri-o://5e0bb5981ee3a13238301b3bfc92df9ff373f9ebde0be37a1dacb290a0890e25" gracePeriod=30
May 28 09:35:50.806831 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:50.806801    2578 generic.go:358] "Generic (PLEG): container finished" podID="666e1a9c-fdbf-477c-be7f-94b2f0afd792" containerID="5e0bb5981ee3a13238301b3bfc92df9ff373f9ebde0be37a1dacb290a0890e25" exitCode=2
May 28 09:35:50.806995 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:50.806848    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f6bf4f776-86qfp" event={"ID":"666e1a9c-fdbf-477c-be7f-94b2f0afd792","Type":"ContainerDied","Data":"5e0bb5981ee3a13238301b3bfc92df9ff373f9ebde0be37a1dacb290a0890e25"}
May 28 09:35:50.806995 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:35:50.806876    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-f6bf4f776-86qfp" event={"ID":"666e1a9c-fdbf-477c-be7f-94b2f0afd792","Type":"ContainerStarted","Data":"41e4ad8b8b5cbc61843faf9318d7cb0d935a8e600c10a9f495cfcd1a7f911751"}
May 28 09:36:08.521782 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:36:08.521741    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-cl4cv" podUID="3a32cf92-12af-459a-ad67-15d50ffbcb4a"
May 28 09:36:08.851500 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:08.851426    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cl4cv"
May 28 09:36:09.523559 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:36:09.523507    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-4jnrs" podUID="4bc2255b-95b4-4e5d-84ca-3b62b9da5519"
May 28 09:36:09.523559 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:36:09.523513    2578 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-ndlhq" podUID="4f338af0-ba12-449a-9d1d-131a715463e9"
May 28 09:36:09.854356 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:09.854285    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-ndlhq"
May 28 09:36:09.854356 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:09.854328    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4jnrs"
May 28 09:36:12.423822 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:12.423783    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4f338af0-ba12-449a-9d1d-131a715463e9-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-ndlhq\" (UID: \"4f338af0-ba12-449a-9d1d-131a715463e9\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-ndlhq"
May 28 09:36:12.424297 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:12.423833    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3a32cf92-12af-459a-ad67-15d50ffbcb4a-cert\") pod \"ingress-canary-cl4cv\" (UID: \"3a32cf92-12af-459a-ad67-15d50ffbcb4a\") " pod="openshift-ingress-canary/ingress-canary-cl4cv"
May 28 09:36:12.426103 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:12.426072    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3a32cf92-12af-459a-ad67-15d50ffbcb4a-cert\") pod \"ingress-canary-cl4cv\" (UID: \"3a32cf92-12af-459a-ad67-15d50ffbcb4a\") " pod="openshift-ingress-canary/ingress-canary-cl4cv"
May 28 09:36:12.426197 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:12.426145    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4f338af0-ba12-449a-9d1d-131a715463e9-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-ndlhq\" (UID: \"4f338af0-ba12-449a-9d1d-131a715463e9\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-ndlhq"
May 28 09:36:12.454951 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:12.454928    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5x7r9\""
May 28 09:36:12.462137 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:12.462117    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cl4cv"
May 28 09:36:12.524361 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:12.524330    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4bc2255b-95b4-4e5d-84ca-3b62b9da5519-metrics-tls\") pod \"dns-default-4jnrs\" (UID: \"4bc2255b-95b4-4e5d-84ca-3b62b9da5519\") " pod="openshift-dns/dns-default-4jnrs"
May 28 09:36:12.526359 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:12.526318    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4bc2255b-95b4-4e5d-84ca-3b62b9da5519-metrics-tls\") pod \"dns-default-4jnrs\" (UID: \"4bc2255b-95b4-4e5d-84ca-3b62b9da5519\") " pod="openshift-dns/dns-default-4jnrs"
May 28 09:36:12.558450 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:12.558429    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-m6hd2\""
May 28 09:36:12.558551 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:12.558538    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-59hlf\""
May 28 09:36:12.565533 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:12.565508    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-ndlhq"
May 28 09:36:12.565533 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:12.565530    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-4jnrs"
May 28 09:36:12.584439 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:12.584406    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cl4cv"]
May 28 09:36:12.587095 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:36:12.587071    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a32cf92_12af_459a_ad67_15d50ffbcb4a.slice/crio-57542a2b7ddd2edab4c9fbead8248cae1c9c7f1d637d999268be09d573962103 WatchSource:0}: Error finding container 57542a2b7ddd2edab4c9fbead8248cae1c9c7f1d637d999268be09d573962103: Status 404 returned error can't find the container with id 57542a2b7ddd2edab4c9fbead8248cae1c9c7f1d637d999268be09d573962103
May 28 09:36:12.733400 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:12.733374    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-ndlhq"]
May 28 09:36:12.736085 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:36:12.736054    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f338af0_ba12_449a_9d1d_131a715463e9.slice/crio-5841373e439f648d20f41b90c3eccbf96f0d7bb63c3c9aa04fd65f633b24effc WatchSource:0}: Error finding container 5841373e439f648d20f41b90c3eccbf96f0d7bb63c3c9aa04fd65f633b24effc: Status 404 returned error can't find the container with id 5841373e439f648d20f41b90c3eccbf96f0d7bb63c3c9aa04fd65f633b24effc
May 28 09:36:12.738902 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:12.738877    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-4jnrs"]
May 28 09:36:12.742746 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:36:12.742724    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bc2255b_95b4_4e5d_84ca_3b62b9da5519.slice/crio-3a82150a84f5732bf90568e2ae1fe3671f573d96dcc07f7679da35d4ae951fd7 WatchSource:0}: Error finding container 3a82150a84f5732bf90568e2ae1fe3671f573d96dcc07f7679da35d4ae951fd7: Status 404 returned error can't find the container with id 3a82150a84f5732bf90568e2ae1fe3671f573d96dcc07f7679da35d4ae951fd7
May 28 09:36:12.862779 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:12.862752    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4jnrs" event={"ID":"4bc2255b-95b4-4e5d-84ca-3b62b9da5519","Type":"ContainerStarted","Data":"3a82150a84f5732bf90568e2ae1fe3671f573d96dcc07f7679da35d4ae951fd7"}
May 28 09:36:12.863636 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:12.863615    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-ndlhq" event={"ID":"4f338af0-ba12-449a-9d1d-131a715463e9","Type":"ContainerStarted","Data":"5841373e439f648d20f41b90c3eccbf96f0d7bb63c3c9aa04fd65f633b24effc"}
May 28 09:36:12.864568 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:12.864548    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cl4cv" event={"ID":"3a32cf92-12af-459a-ad67-15d50ffbcb4a","Type":"ContainerStarted","Data":"57542a2b7ddd2edab4c9fbead8248cae1c9c7f1d637d999268be09d573962103"}
May 28 09:36:14.872258 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:14.872191    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4jnrs" event={"ID":"4bc2255b-95b4-4e5d-84ca-3b62b9da5519","Type":"ContainerStarted","Data":"ae7e874933e1d6c1479e686e06f7c5e209c913c067df615f90d958d52c9b152c"}
May 28 09:36:14.873775 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:14.873729    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-ndlhq" event={"ID":"4f338af0-ba12-449a-9d1d-131a715463e9","Type":"ContainerStarted","Data":"d39c4709d722862c65e2a6186cc9360c281a646c2708c7238e35b1c4f3dc6174"}
May 28 09:36:14.883537 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:14.883514    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-548556cf45-nvz7q"]
May 28 09:36:14.886882 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:14.886847    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-548556cf45-nvz7q"
May 28 09:36:14.893167 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:14.893117    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-ndlhq" podStartSLOduration=260.820313183 podStartE2EDuration="4m21.893100914s" podCreationTimestamp="2026-05-28 09:31:53 +0000 UTC" firstStartedPulling="2026-05-28 09:36:12.738843975 +0000 UTC m=+285.198589598" lastFinishedPulling="2026-05-28 09:36:13.811631686 +0000 UTC m=+286.271377329" observedRunningTime="2026-05-28 09:36:14.890431217 +0000 UTC m=+287.350176863" watchObservedRunningTime="2026-05-28 09:36:14.893100914 +0000 UTC m=+287.352846559"
May 28 09:36:14.896096 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:14.895957    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-548556cf45-nvz7q"]
May 28 09:36:15.044535 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:15.044503    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1-service-ca\") pod \"console-548556cf45-nvz7q\" (UID: \"7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1\") " pod="openshift-console/console-548556cf45-nvz7q"
May 28 09:36:15.044687 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:15.044544    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clfnt\" (UniqueName: \"kubernetes.io/projected/7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1-kube-api-access-clfnt\") pod \"console-548556cf45-nvz7q\" (UID: \"7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1\") " pod="openshift-console/console-548556cf45-nvz7q"
May 28 09:36:15.044687 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:15.044653    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1-oauth-serving-cert\") pod \"console-548556cf45-nvz7q\" (UID: \"7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1\") " pod="openshift-console/console-548556cf45-nvz7q"
May 28 09:36:15.044799 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:15.044693    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1-console-oauth-config\") pod \"console-548556cf45-nvz7q\" (UID: \"7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1\") " pod="openshift-console/console-548556cf45-nvz7q"
May 28 09:36:15.044799 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:15.044727    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1-trusted-ca-bundle\") pod \"console-548556cf45-nvz7q\" (UID: \"7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1\") " pod="openshift-console/console-548556cf45-nvz7q"
May 28 09:36:15.044799 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:15.044768    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1-console-config\") pod \"console-548556cf45-nvz7q\" (UID: \"7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1\") " pod="openshift-console/console-548556cf45-nvz7q"
May 28 09:36:15.044908 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:15.044867    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1-console-serving-cert\") pod \"console-548556cf45-nvz7q\" (UID: \"7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1\") " pod="openshift-console/console-548556cf45-nvz7q"
May 28 09:36:15.145995 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:15.145902    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1-console-serving-cert\") pod \"console-548556cf45-nvz7q\" (UID: \"7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1\") " pod="openshift-console/console-548556cf45-nvz7q"
May 28 09:36:15.145995 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:15.145948    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1-service-ca\") pod \"console-548556cf45-nvz7q\" (UID: \"7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1\") " pod="openshift-console/console-548556cf45-nvz7q"
May 28 09:36:15.145995 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:15.145968    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-clfnt\" (UniqueName: \"kubernetes.io/projected/7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1-kube-api-access-clfnt\") pod \"console-548556cf45-nvz7q\" (UID: \"7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1\") " pod="openshift-console/console-548556cf45-nvz7q"
May 28 09:36:15.146216 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:15.146006    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1-oauth-serving-cert\") pod \"console-548556cf45-nvz7q\" (UID: \"7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1\") " pod="openshift-console/console-548556cf45-nvz7q"
May 28 09:36:15.146216 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:15.146025    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1-console-oauth-config\") pod \"console-548556cf45-nvz7q\" (UID: \"7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1\") " pod="openshift-console/console-548556cf45-nvz7q"
May 28 09:36:15.146216 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:15.146043    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1-trusted-ca-bundle\") pod \"console-548556cf45-nvz7q\" (UID: \"7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1\") " pod="openshift-console/console-548556cf45-nvz7q"
May 28 09:36:15.146216 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:15.146076    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1-console-config\") pod \"console-548556cf45-nvz7q\" (UID: \"7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1\") " pod="openshift-console/console-548556cf45-nvz7q"
May 28 09:36:15.146791 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:15.146765    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1-service-ca\") pod \"console-548556cf45-nvz7q\" (UID: \"7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1\") " pod="openshift-console/console-548556cf45-nvz7q"
May 28 09:36:15.146911 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:15.146833    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1-console-config\") pod \"console-548556cf45-nvz7q\" (UID: \"7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1\") " pod="openshift-console/console-548556cf45-nvz7q"
May 28 09:36:15.146911 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:15.146830    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1-oauth-serving-cert\") pod \"console-548556cf45-nvz7q\" (UID: \"7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1\") " pod="openshift-console/console-548556cf45-nvz7q"
May 28 09:36:15.147377 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:15.147352    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1-trusted-ca-bundle\") pod \"console-548556cf45-nvz7q\" (UID: \"7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1\") " pod="openshift-console/console-548556cf45-nvz7q"
May 28 09:36:15.148525 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:15.148502    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1-console-serving-cert\") pod \"console-548556cf45-nvz7q\" (UID: \"7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1\") " pod="openshift-console/console-548556cf45-nvz7q"
May 28 09:36:15.148618 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:15.148562    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1-console-oauth-config\") pod \"console-548556cf45-nvz7q\" (UID: \"7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1\") " pod="openshift-console/console-548556cf45-nvz7q"
May 28 09:36:15.159889 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:15.159862    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-clfnt\" (UniqueName: \"kubernetes.io/projected/7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1-kube-api-access-clfnt\") pod \"console-548556cf45-nvz7q\" (UID: \"7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1\") " pod="openshift-console/console-548556cf45-nvz7q"
May 28 09:36:15.198808 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:15.198784    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-548556cf45-nvz7q"
May 28 09:36:15.320006 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:15.319984    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-548556cf45-nvz7q"]
May 28 09:36:15.321907 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:36:15.321883    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7df7e4cf_38ea_4a0b_acef_5a3ec99c1af1.slice/crio-0bd20399654f95e890d0a0917f41065a32b6a17c805aab6459441c49f7ab10bd WatchSource:0}: Error finding container 0bd20399654f95e890d0a0917f41065a32b6a17c805aab6459441c49f7ab10bd: Status 404 returned error can't find the container with id 0bd20399654f95e890d0a0917f41065a32b6a17c805aab6459441c49f7ab10bd
May 28 09:36:15.878005 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:15.877970    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-4jnrs" event={"ID":"4bc2255b-95b4-4e5d-84ca-3b62b9da5519","Type":"ContainerStarted","Data":"dad2456f5a21746f1f88a2385d7f2d522de5d98460c00423ee85dd7120a25b84"}
May 28 09:36:15.878422 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:15.878073    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-4jnrs"
May 28 09:36:15.879356 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:15.879330    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cl4cv" event={"ID":"3a32cf92-12af-459a-ad67-15d50ffbcb4a","Type":"ContainerStarted","Data":"f6a93f75daddb4369093d0cdb7fb7562a81c39ee156c738b0a137eaffd7026fd"}
May 28 09:36:15.880563 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:15.880542    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-548556cf45-nvz7q" event={"ID":"7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1","Type":"ContainerStarted","Data":"fe78938822390cd89cfc5b08755325b76a7a3531128422fc438e81673381ff66"}
May 28 09:36:15.880656 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:15.880565    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-548556cf45-nvz7q" event={"ID":"7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1","Type":"ContainerStarted","Data":"0bd20399654f95e890d0a0917f41065a32b6a17c805aab6459441c49f7ab10bd"}
May 28 09:36:15.896481 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:15.896443    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-4jnrs" podStartSLOduration=252.26582339 podStartE2EDuration="4m13.896429405s" podCreationTimestamp="2026-05-28 09:32:02 +0000 UTC" firstStartedPulling="2026-05-28 09:36:12.744732479 +0000 UTC m=+285.204478103" lastFinishedPulling="2026-05-28 09:36:14.375338484 +0000 UTC m=+286.835084118" observedRunningTime="2026-05-28 09:36:15.895577373 +0000 UTC m=+288.355323018" watchObservedRunningTime="2026-05-28 09:36:15.896429405 +0000 UTC m=+288.356175054"
May 28 09:36:15.917773 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:15.917737    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-548556cf45-nvz7q" podStartSLOduration=1.917727213 podStartE2EDuration="1.917727213s" podCreationTimestamp="2026-05-28 09:36:14 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 09:36:15.917053961 +0000 UTC m=+288.376799606" watchObservedRunningTime="2026-05-28 09:36:15.917727213 +0000 UTC m=+288.377472857"
May 28 09:36:15.933463 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:15.933424    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-cl4cv" podStartSLOduration=251.567196113 podStartE2EDuration="4m13.933414748s" podCreationTimestamp="2026-05-28 09:32:02 +0000 UTC" firstStartedPulling="2026-05-28 09:36:12.588907012 +0000 UTC m=+285.048652635" lastFinishedPulling="2026-05-28 09:36:14.955125646 +0000 UTC m=+287.414871270" observedRunningTime="2026-05-28 09:36:15.932613962 +0000 UTC m=+288.392359608" watchObservedRunningTime="2026-05-28 09:36:15.933414748 +0000 UTC m=+288.393160421"
May 28 09:36:25.199852 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:25.199806    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-548556cf45-nvz7q"
May 28 09:36:25.199852 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:25.199864    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-548556cf45-nvz7q"
May 28 09:36:25.204565 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:25.204531    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-548556cf45-nvz7q"
May 28 09:36:25.886128 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:25.886097    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-4jnrs"
May 28 09:36:25.909582 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:25.909557    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-548556cf45-nvz7q"
May 28 09:36:25.973027 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:25.973002    2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-98b55bccd-m22s7"]
May 28 09:36:28.056851 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:28.056821    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wqcwd_397304a8-87ab-49c0-9fc0-a3ca99f04032/ovn-acl-logging/0.log"
May 28 09:36:28.057317 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:28.057033    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wqcwd_397304a8-87ab-49c0-9fc0-a3ca99f04032/ovn-acl-logging/0.log"
May 28 09:36:28.060928 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:28.060908    2578 kubelet.go:1628] "Image garbage collection succeeded"
May 28 09:36:50.992748 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:50.992684    2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-98b55bccd-m22s7" podUID="30b47c1d-0b19-4ff4-b904-47032d2f6765" containerName="console" containerID="cri-o://8d50a2b133a74adce0c6990b76986cae41b33d204af6861a4c6db1474376ada2" gracePeriod=15
May 28 09:36:51.224507 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:51.224486    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-98b55bccd-m22s7_30b47c1d-0b19-4ff4-b904-47032d2f6765/console/0.log"
May 28 09:36:51.224621 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:51.224554    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-98b55bccd-m22s7"
May 28 09:36:51.293574 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:51.293512    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/30b47c1d-0b19-4ff4-b904-47032d2f6765-console-config\") pod \"30b47c1d-0b19-4ff4-b904-47032d2f6765\" (UID: \"30b47c1d-0b19-4ff4-b904-47032d2f6765\") "
May 28 09:36:51.293574 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:51.293551    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30b47c1d-0b19-4ff4-b904-47032d2f6765-trusted-ca-bundle\") pod \"30b47c1d-0b19-4ff4-b904-47032d2f6765\" (UID: \"30b47c1d-0b19-4ff4-b904-47032d2f6765\") "
May 28 09:36:51.293753 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:51.293580    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mxpd8\" (UniqueName: \"kubernetes.io/projected/30b47c1d-0b19-4ff4-b904-47032d2f6765-kube-api-access-mxpd8\") pod \"30b47c1d-0b19-4ff4-b904-47032d2f6765\" (UID: \"30b47c1d-0b19-4ff4-b904-47032d2f6765\") "
May 28 09:36:51.293753 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:51.293619    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/30b47c1d-0b19-4ff4-b904-47032d2f6765-oauth-serving-cert\") pod \"30b47c1d-0b19-4ff4-b904-47032d2f6765\" (UID: \"30b47c1d-0b19-4ff4-b904-47032d2f6765\") "
May 28 09:36:51.293852 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:51.293771    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/30b47c1d-0b19-4ff4-b904-47032d2f6765-console-serving-cert\") pod \"30b47c1d-0b19-4ff4-b904-47032d2f6765\" (UID: \"30b47c1d-0b19-4ff4-b904-47032d2f6765\") "
May 28 09:36:51.293852 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:51.293844    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/30b47c1d-0b19-4ff4-b904-47032d2f6765-service-ca\") pod \"30b47c1d-0b19-4ff4-b904-47032d2f6765\" (UID: \"30b47c1d-0b19-4ff4-b904-47032d2f6765\") "
May 28 09:36:51.293954 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:51.293870    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/30b47c1d-0b19-4ff4-b904-47032d2f6765-console-oauth-config\") pod \"30b47c1d-0b19-4ff4-b904-47032d2f6765\" (UID: \"30b47c1d-0b19-4ff4-b904-47032d2f6765\") "
May 28 09:36:51.293954 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:51.293886    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30b47c1d-0b19-4ff4-b904-47032d2f6765-console-config" (OuterVolumeSpecName: "console-config") pod "30b47c1d-0b19-4ff4-b904-47032d2f6765" (UID: "30b47c1d-0b19-4ff4-b904-47032d2f6765"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 09:36:51.294044 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:51.293971    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30b47c1d-0b19-4ff4-b904-47032d2f6765-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "30b47c1d-0b19-4ff4-b904-47032d2f6765" (UID: "30b47c1d-0b19-4ff4-b904-47032d2f6765"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 09:36:51.294044 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:51.293980    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30b47c1d-0b19-4ff4-b904-47032d2f6765-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "30b47c1d-0b19-4ff4-b904-47032d2f6765" (UID: "30b47c1d-0b19-4ff4-b904-47032d2f6765"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 09:36:51.294234 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:51.294185    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30b47c1d-0b19-4ff4-b904-47032d2f6765-service-ca" (OuterVolumeSpecName: "service-ca") pod "30b47c1d-0b19-4ff4-b904-47032d2f6765" (UID: "30b47c1d-0b19-4ff4-b904-47032d2f6765"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 09:36:51.294234 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:51.294205    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/30b47c1d-0b19-4ff4-b904-47032d2f6765-console-config\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 09:36:51.294396 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:51.294251    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/30b47c1d-0b19-4ff4-b904-47032d2f6765-trusted-ca-bundle\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 09:36:51.294396 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:51.294270    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/30b47c1d-0b19-4ff4-b904-47032d2f6765-oauth-serving-cert\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 09:36:51.295835 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:51.295808    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30b47c1d-0b19-4ff4-b904-47032d2f6765-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "30b47c1d-0b19-4ff4-b904-47032d2f6765" (UID: "30b47c1d-0b19-4ff4-b904-47032d2f6765"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:36:51.295921 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:51.295858    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30b47c1d-0b19-4ff4-b904-47032d2f6765-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "30b47c1d-0b19-4ff4-b904-47032d2f6765" (UID: "30b47c1d-0b19-4ff4-b904-47032d2f6765"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:36:51.295921 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:51.295861    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30b47c1d-0b19-4ff4-b904-47032d2f6765-kube-api-access-mxpd8" (OuterVolumeSpecName: "kube-api-access-mxpd8") pod "30b47c1d-0b19-4ff4-b904-47032d2f6765" (UID: "30b47c1d-0b19-4ff4-b904-47032d2f6765"). InnerVolumeSpecName "kube-api-access-mxpd8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 09:36:51.395523 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:51.395490    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/30b47c1d-0b19-4ff4-b904-47032d2f6765-service-ca\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 09:36:51.395523 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:51.395521    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/30b47c1d-0b19-4ff4-b904-47032d2f6765-console-oauth-config\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 09:36:51.395523 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:51.395531    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mxpd8\" (UniqueName: \"kubernetes.io/projected/30b47c1d-0b19-4ff4-b904-47032d2f6765-kube-api-access-mxpd8\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 09:36:51.395667 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:51.395540    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/30b47c1d-0b19-4ff4-b904-47032d2f6765-console-serving-cert\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 09:36:51.974640 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:51.974614    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-98b55bccd-m22s7_30b47c1d-0b19-4ff4-b904-47032d2f6765/console/0.log"
May 28 09:36:51.974797 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:51.974652    2578 generic.go:358] "Generic (PLEG): container finished" podID="30b47c1d-0b19-4ff4-b904-47032d2f6765" containerID="8d50a2b133a74adce0c6990b76986cae41b33d204af6861a4c6db1474376ada2" exitCode=2
May 28 09:36:51.974797 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:51.974684    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-98b55bccd-m22s7" event={"ID":"30b47c1d-0b19-4ff4-b904-47032d2f6765","Type":"ContainerDied","Data":"8d50a2b133a74adce0c6990b76986cae41b33d204af6861a4c6db1474376ada2"}
May 28 09:36:51.974797 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:51.974727    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-98b55bccd-m22s7"
May 28 09:36:51.974797 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:51.974744    2578 scope.go:117] "RemoveContainer" containerID="8d50a2b133a74adce0c6990b76986cae41b33d204af6861a4c6db1474376ada2"
May 28 09:36:51.974945 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:51.974731    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-98b55bccd-m22s7" event={"ID":"30b47c1d-0b19-4ff4-b904-47032d2f6765","Type":"ContainerDied","Data":"971fd1d0bad48c227f5f43ee3d02473abc171d8146baff0010f669c4419bf370"}
May 28 09:36:51.982395 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:51.982377    2578 scope.go:117] "RemoveContainer" containerID="8d50a2b133a74adce0c6990b76986cae41b33d204af6861a4c6db1474376ada2"
May 28 09:36:51.982683 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:36:51.982663    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8d50a2b133a74adce0c6990b76986cae41b33d204af6861a4c6db1474376ada2\": container with ID starting with 8d50a2b133a74adce0c6990b76986cae41b33d204af6861a4c6db1474376ada2 not found: ID does not exist" containerID="8d50a2b133a74adce0c6990b76986cae41b33d204af6861a4c6db1474376ada2"
May 28 09:36:51.982738 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:51.982691    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8d50a2b133a74adce0c6990b76986cae41b33d204af6861a4c6db1474376ada2"} err="failed to get container status \"8d50a2b133a74adce0c6990b76986cae41b33d204af6861a4c6db1474376ada2\": rpc error: code = NotFound desc = could not find container \"8d50a2b133a74adce0c6990b76986cae41b33d204af6861a4c6db1474376ada2\": container with ID starting with 8d50a2b133a74adce0c6990b76986cae41b33d204af6861a4c6db1474376ada2 not found: ID does not exist"
May 28 09:36:51.996678 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:51.996656    2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-98b55bccd-m22s7"]
May 28 09:36:52.003400 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:52.003383    2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-98b55bccd-m22s7"]
May 28 09:36:52.104153 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:36:52.104120    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30b47c1d-0b19-4ff4-b904-47032d2f6765" path="/var/lib/kubelet/pods/30b47c1d-0b19-4ff4-b904-47032d2f6765/volumes"
May 28 09:40:30.635642 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:40:30.635607    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-b998457fd-d64j8"]
May 28 09:40:30.636053 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:40:30.635872    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30b47c1d-0b19-4ff4-b904-47032d2f6765" containerName="console"
May 28 09:40:30.636053 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:40:30.635883    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="30b47c1d-0b19-4ff4-b904-47032d2f6765" containerName="console"
May 28 09:40:30.636053 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:40:30.635926    2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="30b47c1d-0b19-4ff4-b904-47032d2f6765" containerName="console"
May 28 09:40:30.638703 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:40:30.638687    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b998457fd-d64j8"
May 28 09:40:30.647449 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:40:30.647414    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b998457fd-d64j8"]
May 28 09:40:30.652945 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:40:30.652924    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/649c9d16-e8bd-4431-a700-f67fc6c3e9de-service-ca\") pod \"console-b998457fd-d64j8\" (UID: \"649c9d16-e8bd-4431-a700-f67fc6c3e9de\") " pod="openshift-console/console-b998457fd-d64j8"
May 28 09:40:30.653062 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:40:30.652955    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dn25\" (UniqueName: \"kubernetes.io/projected/649c9d16-e8bd-4431-a700-f67fc6c3e9de-kube-api-access-7dn25\") pod \"console-b998457fd-d64j8\" (UID: \"649c9d16-e8bd-4431-a700-f67fc6c3e9de\") " pod="openshift-console/console-b998457fd-d64j8"
May 28 09:40:30.653062 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:40:30.652990    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/649c9d16-e8bd-4431-a700-f67fc6c3e9de-console-oauth-config\") pod \"console-b998457fd-d64j8\" (UID: \"649c9d16-e8bd-4431-a700-f67fc6c3e9de\") " pod="openshift-console/console-b998457fd-d64j8"
May 28 09:40:30.653143 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:40:30.653057    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/649c9d16-e8bd-4431-a700-f67fc6c3e9de-console-config\") pod \"console-b998457fd-d64j8\" (UID: \"649c9d16-e8bd-4431-a700-f67fc6c3e9de\") " pod="openshift-console/console-b998457fd-d64j8"
May 28 09:40:30.653143 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:40:30.653086    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/649c9d16-e8bd-4431-a700-f67fc6c3e9de-oauth-serving-cert\") pod \"console-b998457fd-d64j8\" (UID: \"649c9d16-e8bd-4431-a700-f67fc6c3e9de\") " pod="openshift-console/console-b998457fd-d64j8"
May 28 09:40:30.653143 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:40:30.653127    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/649c9d16-e8bd-4431-a700-f67fc6c3e9de-trusted-ca-bundle\") pod \"console-b998457fd-d64j8\" (UID: \"649c9d16-e8bd-4431-a700-f67fc6c3e9de\") " pod="openshift-console/console-b998457fd-d64j8"
May 28 09:40:30.653261 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:40:30.653151    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/649c9d16-e8bd-4431-a700-f67fc6c3e9de-console-serving-cert\") pod \"console-b998457fd-d64j8\" (UID: \"649c9d16-e8bd-4431-a700-f67fc6c3e9de\") " pod="openshift-console/console-b998457fd-d64j8"
May 28 09:40:30.753435 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:40:30.753412    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/649c9d16-e8bd-4431-a700-f67fc6c3e9de-console-serving-cert\") pod \"console-b998457fd-d64j8\" (UID: \"649c9d16-e8bd-4431-a700-f67fc6c3e9de\") " pod="openshift-console/console-b998457fd-d64j8"
May 28 09:40:30.753559 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:40:30.753454    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/649c9d16-e8bd-4431-a700-f67fc6c3e9de-service-ca\") pod \"console-b998457fd-d64j8\" (UID: \"649c9d16-e8bd-4431-a700-f67fc6c3e9de\") " pod="openshift-console/console-b998457fd-d64j8"
May 28 09:40:30.753559 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:40:30.753479    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7dn25\" (UniqueName: \"kubernetes.io/projected/649c9d16-e8bd-4431-a700-f67fc6c3e9de-kube-api-access-7dn25\") pod \"console-b998457fd-d64j8\" (UID: \"649c9d16-e8bd-4431-a700-f67fc6c3e9de\") " pod="openshift-console/console-b998457fd-d64j8"
May 28 09:40:30.753559 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:40:30.753509    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/649c9d16-e8bd-4431-a700-f67fc6c3e9de-console-oauth-config\") pod \"console-b998457fd-d64j8\" (UID: \"649c9d16-e8bd-4431-a700-f67fc6c3e9de\") " pod="openshift-console/console-b998457fd-d64j8"
May 28 09:40:30.753559 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:40:30.753542    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/649c9d16-e8bd-4431-a700-f67fc6c3e9de-console-config\") pod \"console-b998457fd-d64j8\" (UID: \"649c9d16-e8bd-4431-a700-f67fc6c3e9de\") " pod="openshift-console/console-b998457fd-d64j8"
May 28 09:40:30.753744 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:40:30.753569    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/649c9d16-e8bd-4431-a700-f67fc6c3e9de-oauth-serving-cert\") pod \"console-b998457fd-d64j8\" (UID: \"649c9d16-e8bd-4431-a700-f67fc6c3e9de\") " pod="openshift-console/console-b998457fd-d64j8"
May 28 09:40:30.753744 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:40:30.753598    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/649c9d16-e8bd-4431-a700-f67fc6c3e9de-trusted-ca-bundle\") pod \"console-b998457fd-d64j8\" (UID: \"649c9d16-e8bd-4431-a700-f67fc6c3e9de\") " pod="openshift-console/console-b998457fd-d64j8"
May 28 09:40:30.754142 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:40:30.754115    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/649c9d16-e8bd-4431-a700-f67fc6c3e9de-service-ca\") pod \"console-b998457fd-d64j8\" (UID: \"649c9d16-e8bd-4431-a700-f67fc6c3e9de\") " pod="openshift-console/console-b998457fd-d64j8"
May 28 09:40:30.754270 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:40:30.754213    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/649c9d16-e8bd-4431-a700-f67fc6c3e9de-oauth-serving-cert\") pod \"console-b998457fd-d64j8\" (UID: \"649c9d16-e8bd-4431-a700-f67fc6c3e9de\") " pod="openshift-console/console-b998457fd-d64j8"
May 28 09:40:30.754270 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:40:30.754253    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/649c9d16-e8bd-4431-a700-f67fc6c3e9de-console-config\") pod \"console-b998457fd-d64j8\" (UID: \"649c9d16-e8bd-4431-a700-f67fc6c3e9de\") " pod="openshift-console/console-b998457fd-d64j8"
May 28 09:40:30.754716 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:40:30.754696    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/649c9d16-e8bd-4431-a700-f67fc6c3e9de-trusted-ca-bundle\") pod \"console-b998457fd-d64j8\" (UID: \"649c9d16-e8bd-4431-a700-f67fc6c3e9de\") " pod="openshift-console/console-b998457fd-d64j8"
May 28 09:40:30.755851 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:40:30.755823    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/649c9d16-e8bd-4431-a700-f67fc6c3e9de-console-serving-cert\") pod \"console-b998457fd-d64j8\" (UID: \"649c9d16-e8bd-4431-a700-f67fc6c3e9de\") " pod="openshift-console/console-b998457fd-d64j8"
May 28 09:40:30.756028 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:40:30.756007    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/649c9d16-e8bd-4431-a700-f67fc6c3e9de-console-oauth-config\") pod \"console-b998457fd-d64j8\" (UID: \"649c9d16-e8bd-4431-a700-f67fc6c3e9de\") " pod="openshift-console/console-b998457fd-d64j8"
May 28 09:40:30.763083 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:40:30.763060    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dn25\" (UniqueName: \"kubernetes.io/projected/649c9d16-e8bd-4431-a700-f67fc6c3e9de-kube-api-access-7dn25\") pod \"console-b998457fd-d64j8\" (UID: \"649c9d16-e8bd-4431-a700-f67fc6c3e9de\") " pod="openshift-console/console-b998457fd-d64j8"
May 28 09:40:30.947709 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:40:30.947678    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b998457fd-d64j8"
May 28 09:40:31.067366 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:40:31.067337    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b998457fd-d64j8"]
May 28 09:40:31.070232 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:40:31.070197    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod649c9d16_e8bd_4431_a700_f67fc6c3e9de.slice/crio-965cea6267b212d47c64aa6c8d957fdda4951356ac9a446f43fd4448926dc220 WatchSource:0}: Error finding container 965cea6267b212d47c64aa6c8d957fdda4951356ac9a446f43fd4448926dc220: Status 404 returned error can't find the container with id 965cea6267b212d47c64aa6c8d957fdda4951356ac9a446f43fd4448926dc220
May 28 09:40:31.071967 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:40:31.071951    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 09:40:31.518750 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:40:31.518717    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b998457fd-d64j8" event={"ID":"649c9d16-e8bd-4431-a700-f67fc6c3e9de","Type":"ContainerStarted","Data":"32b99855fc994dc7408e2b0c02e92f553577818d828bf04ec354b94b93091829"}
May 28 09:40:31.518750 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:40:31.518753    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b998457fd-d64j8" event={"ID":"649c9d16-e8bd-4431-a700-f67fc6c3e9de","Type":"ContainerStarted","Data":"965cea6267b212d47c64aa6c8d957fdda4951356ac9a446f43fd4448926dc220"}
May 28 09:40:31.540367 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:40:31.540295    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-b998457fd-d64j8" podStartSLOduration=1.5402728479999999 podStartE2EDuration="1.540272848s" podCreationTimestamp="2026-05-28 09:40:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 09:40:31.53995501 +0000 UTC m=+543.999700657" watchObservedRunningTime="2026-05-28 09:40:31.540272848 +0000 UTC m=+544.000018495"
May 28 09:40:40.948673 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:40:40.948632    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b998457fd-d64j8"
May 28 09:40:40.948673 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:40:40.948676    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b998457fd-d64j8"
May 28 09:40:40.953145 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:40:40.953122    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b998457fd-d64j8"
May 28 09:40:41.552474 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:40:41.552448    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b998457fd-d64j8"
May 28 09:40:41.613313 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:40:41.613283    2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-548556cf45-nvz7q"]
May 28 09:41:06.631894 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:41:06.631855    2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-548556cf45-nvz7q" podUID="7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1" containerName="console" containerID="cri-o://fe78938822390cd89cfc5b08755325b76a7a3531128422fc438e81673381ff66" gracePeriod=15
May 28 09:41:06.862422 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:41:06.862403    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-548556cf45-nvz7q_7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1/console/0.log"
May 28 09:41:06.862522 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:41:06.862458    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-548556cf45-nvz7q"
May 28 09:41:07.001142 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:41:07.001122    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1-console-serving-cert\") pod \"7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1\" (UID: \"7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1\") "
May 28 09:41:07.001290 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:41:07.001165    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1-console-oauth-config\") pod \"7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1\" (UID: \"7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1\") "
May 28 09:41:07.001290 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:41:07.001186    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1-trusted-ca-bundle\") pod \"7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1\" (UID: \"7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1\") "
May 28 09:41:07.001290 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:41:07.001237    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1-oauth-serving-cert\") pod \"7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1\" (UID: \"7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1\") "
May 28 09:41:07.001454 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:41:07.001389    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1-service-ca\") pod \"7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1\" (UID: \"7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1\") "
May 28 09:41:07.001454 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:41:07.001414    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1-console-config\") pod \"7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1\" (UID: \"7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1\") "
May 28 09:41:07.001454 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:41:07.001444    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-clfnt\" (UniqueName: \"kubernetes.io/projected/7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1-kube-api-access-clfnt\") pod \"7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1\" (UID: \"7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1\") "
May 28 09:41:07.001714 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:41:07.001617    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1" (UID: "7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 09:41:07.001714 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:41:07.001679    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1" (UID: "7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 09:41:07.001874 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:41:07.001777    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1-service-ca" (OuterVolumeSpecName: "service-ca") pod "7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1" (UID: "7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 09:41:07.001874 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:41:07.001786    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1-console-config" (OuterVolumeSpecName: "console-config") pod "7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1" (UID: "7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 09:41:07.003340 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:41:07.003316    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1" (UID: "7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:41:07.003412 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:41:07.003361    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1" (UID: "7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:41:07.003450 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:41:07.003430    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1-kube-api-access-clfnt" (OuterVolumeSpecName: "kube-api-access-clfnt") pod "7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1" (UID: "7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1"). InnerVolumeSpecName "kube-api-access-clfnt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 09:41:07.102197 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:41:07.102177    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1-oauth-serving-cert\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 09:41:07.102197 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:41:07.102195    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1-service-ca\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 09:41:07.102317 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:41:07.102204    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1-console-config\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 09:41:07.102317 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:41:07.102213    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-clfnt\" (UniqueName: \"kubernetes.io/projected/7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1-kube-api-access-clfnt\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 09:41:07.102317 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:41:07.102236    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1-console-serving-cert\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 09:41:07.102317 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:41:07.102244    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1-console-oauth-config\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 09:41:07.102317 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:41:07.102252    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1-trusted-ca-bundle\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 09:41:07.614481 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:41:07.614406    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-548556cf45-nvz7q_7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1/console/0.log"
May 28 09:41:07.614481 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:41:07.614443    2578 generic.go:358] "Generic (PLEG): container finished" podID="7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1" containerID="fe78938822390cd89cfc5b08755325b76a7a3531128422fc438e81673381ff66" exitCode=2
May 28 09:41:07.614638 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:41:07.614478    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-548556cf45-nvz7q" event={"ID":"7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1","Type":"ContainerDied","Data":"fe78938822390cd89cfc5b08755325b76a7a3531128422fc438e81673381ff66"}
May 28 09:41:07.614638 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:41:07.614507    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-548556cf45-nvz7q"
May 28 09:41:07.614638 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:41:07.614516    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-548556cf45-nvz7q" event={"ID":"7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1","Type":"ContainerDied","Data":"0bd20399654f95e890d0a0917f41065a32b6a17c805aab6459441c49f7ab10bd"}
May 28 09:41:07.614638 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:41:07.614531    2578 scope.go:117] "RemoveContainer" containerID="fe78938822390cd89cfc5b08755325b76a7a3531128422fc438e81673381ff66"
May 28 09:41:07.622527 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:41:07.622437    2578 scope.go:117] "RemoveContainer" containerID="fe78938822390cd89cfc5b08755325b76a7a3531128422fc438e81673381ff66"
May 28 09:41:07.622766 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:41:07.622739    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe78938822390cd89cfc5b08755325b76a7a3531128422fc438e81673381ff66\": container with ID starting with fe78938822390cd89cfc5b08755325b76a7a3531128422fc438e81673381ff66 not found: ID does not exist" containerID="fe78938822390cd89cfc5b08755325b76a7a3531128422fc438e81673381ff66"
May 28 09:41:07.622864 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:41:07.622777    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe78938822390cd89cfc5b08755325b76a7a3531128422fc438e81673381ff66"} err="failed to get container status \"fe78938822390cd89cfc5b08755325b76a7a3531128422fc438e81673381ff66\": rpc error: code = NotFound desc = could not find container \"fe78938822390cd89cfc5b08755325b76a7a3531128422fc438e81673381ff66\": container with ID starting with fe78938822390cd89cfc5b08755325b76a7a3531128422fc438e81673381ff66 not found: ID does not exist"
May 28 09:41:07.641921 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:41:07.641902    2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-548556cf45-nvz7q"]
May 28 09:41:07.647146 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:41:07.647129    2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-548556cf45-nvz7q"]
May 28 09:41:08.104620 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:41:08.104589    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1" path="/var/lib/kubelet/pods/7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1/volumes"
May 28 09:41:28.073592 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:41:28.073567    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wqcwd_397304a8-87ab-49c0-9fc0-a3ca99f04032/ovn-acl-logging/0.log"
May 28 09:41:28.074937 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:41:28.074914    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wqcwd_397304a8-87ab-49c0-9fc0-a3ca99f04032/ovn-acl-logging/0.log"
May 28 09:45:09.581829 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:45:09.581759    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/redis-854544c579-gjmgh"]
May 28 09:45:09.582461 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:45:09.582036    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1" containerName="console"
May 28 09:45:09.582461 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:45:09.582049    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1" containerName="console"
May 28 09:45:09.582461 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:45:09.582096    2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="7df7e4cf-38ea-4a0b-acef-5a3ec99c1af1" containerName="console"
May 28 09:45:09.584690 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:45:09.584674    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-gjmgh"
May 28 09:45:09.587168 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:45:09.587146    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-cgfkx\""
May 28 09:45:09.587312 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:45:09.587198    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 28 09:45:09.587312 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:45:09.587257    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 28 09:45:09.592547 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:45:09.592525    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-854544c579-gjmgh"]
May 28 09:45:09.745586 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:45:09.745552    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdbwd\" (UniqueName: \"kubernetes.io/projected/21fc0163-c18f-4db9-a014-4dcb08015d5a-kube-api-access-fdbwd\") pod \"redis-854544c579-gjmgh\" (UID: \"21fc0163-c18f-4db9-a014-4dcb08015d5a\") " pod="test-ns-feast/redis-854544c579-gjmgh"
May 28 09:45:09.846544 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:45:09.846466    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fdbwd\" (UniqueName: \"kubernetes.io/projected/21fc0163-c18f-4db9-a014-4dcb08015d5a-kube-api-access-fdbwd\") pod \"redis-854544c579-gjmgh\" (UID: \"21fc0163-c18f-4db9-a014-4dcb08015d5a\") " pod="test-ns-feast/redis-854544c579-gjmgh"
May 28 09:45:09.855744 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:45:09.855707    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdbwd\" (UniqueName: \"kubernetes.io/projected/21fc0163-c18f-4db9-a014-4dcb08015d5a-kube-api-access-fdbwd\") pod \"redis-854544c579-gjmgh\" (UID: \"21fc0163-c18f-4db9-a014-4dcb08015d5a\") " pod="test-ns-feast/redis-854544c579-gjmgh"
May 28 09:45:09.895536 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:45:09.895502    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-gjmgh"
May 28 09:45:10.013252 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:45:10.013206    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-854544c579-gjmgh"]
May 28 09:45:10.016342 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:45:10.016309    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod21fc0163_c18f_4db9_a014_4dcb08015d5a.slice/crio-1032b981fb833672c67aaf24e433af4f2717c078db67376d88a3be116b4f8a64 WatchSource:0}: Error finding container 1032b981fb833672c67aaf24e433af4f2717c078db67376d88a3be116b4f8a64: Status 404 returned error can't find the container with id 1032b981fb833672c67aaf24e433af4f2717c078db67376d88a3be116b4f8a64
May 28 09:45:10.229958 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:45:10.229934    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-gjmgh" event={"ID":"21fc0163-c18f-4db9-a014-4dcb08015d5a","Type":"ContainerStarted","Data":"1032b981fb833672c67aaf24e433af4f2717c078db67376d88a3be116b4f8a64"}
May 28 09:45:12.235147 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:45:12.235105    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-gjmgh" event={"ID":"21fc0163-c18f-4db9-a014-4dcb08015d5a","Type":"ContainerStarted","Data":"41d548c46a5f705597ab7c69089f1fc679755d9adcb2b67cac10adf7395966c2"}
May 28 09:45:12.254374 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:45:12.254327    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/redis-854544c579-gjmgh" podStartSLOduration=1.908666636 podStartE2EDuration="3.254314419s" podCreationTimestamp="2026-05-28 09:45:09 +0000 UTC" firstStartedPulling="2026-05-28 09:45:10.018298272 +0000 UTC m=+822.478043895" lastFinishedPulling="2026-05-28 09:45:11.363946051 +0000 UTC m=+823.823691678" observedRunningTime="2026-05-28 09:45:12.252241919 +0000 UTC m=+824.711987559" watchObservedRunningTime="2026-05-28 09:45:12.254314419 +0000 UTC m=+824.714060064"
May 28 09:45:43.006443 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:45:43.006403    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-test-apply-cmxp8"]
May 28 09:45:43.009636 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:45:43.009614    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-cmxp8"
May 28 09:45:43.012458 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:45:43.012437    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\""
May 28 09:45:43.012549 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:45:43.012502    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-q6rzg\""
May 28 09:45:43.017084 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:45:43.017064    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-cmxp8"]
May 28 09:45:43.067131 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:45:43.067107    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2qv7\" (UniqueName: \"kubernetes.io/projected/054a0117-052d-4ccf-a96c-3ec53c00fa8a-kube-api-access-r2qv7\") pod \"feast-test-apply-cmxp8\" (UID: \"054a0117-052d-4ccf-a96c-3ec53c00fa8a\") " pod="test-ns-feast/feast-test-apply-cmxp8"
May 28 09:45:43.167547 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:45:43.167521    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r2qv7\" (UniqueName: \"kubernetes.io/projected/054a0117-052d-4ccf-a96c-3ec53c00fa8a-kube-api-access-r2qv7\") pod \"feast-test-apply-cmxp8\" (UID: \"054a0117-052d-4ccf-a96c-3ec53c00fa8a\") " pod="test-ns-feast/feast-test-apply-cmxp8"
May 28 09:45:43.177371 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:45:43.177351    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2qv7\" (UniqueName: \"kubernetes.io/projected/054a0117-052d-4ccf-a96c-3ec53c00fa8a-kube-api-access-r2qv7\") pod \"feast-test-apply-cmxp8\" (UID: \"054a0117-052d-4ccf-a96c-3ec53c00fa8a\") " pod="test-ns-feast/feast-test-apply-cmxp8"
May 28 09:45:43.318898 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:45:43.318838    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-cmxp8"
May 28 09:45:43.438947 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:45:43.438919    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-test-apply-cmxp8"]
May 28 09:45:43.441975 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:45:43.441948    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod054a0117_052d_4ccf_a96c_3ec53c00fa8a.slice/crio-c2b8c7f608aa4d24b3ef2432cda646478511e48ff7f315074af6d561c51fc693 WatchSource:0}: Error finding container c2b8c7f608aa4d24b3ef2432cda646478511e48ff7f315074af6d561c51fc693: Status 404 returned error can't find the container with id c2b8c7f608aa4d24b3ef2432cda646478511e48ff7f315074af6d561c51fc693
May 28 09:45:43.443683 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:45:43.443669    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 09:45:44.318031 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:45:44.317990    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-cmxp8" event={"ID":"054a0117-052d-4ccf-a96c-3ec53c00fa8a","Type":"ContainerStarted","Data":"c2b8c7f608aa4d24b3ef2432cda646478511e48ff7f315074af6d561c51fc693"}
May 28 09:45:48.329499 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:45:48.329464    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-cmxp8" event={"ID":"054a0117-052d-4ccf-a96c-3ec53c00fa8a","Type":"ContainerStarted","Data":"b94dd073b54c0d08b537914fc275027351257f5f0862e76ca42b0be0fb5afc1b"}
May 28 09:45:54.346375 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:45:54.346298    2578 generic.go:358] "Generic (PLEG): container finished" podID="054a0117-052d-4ccf-a96c-3ec53c00fa8a" containerID="b94dd073b54c0d08b537914fc275027351257f5f0862e76ca42b0be0fb5afc1b" exitCode=0
May 28 09:45:54.346375 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:45:54.346363    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-cmxp8" event={"ID":"054a0117-052d-4ccf-a96c-3ec53c00fa8a","Type":"ContainerDied","Data":"b94dd073b54c0d08b537914fc275027351257f5f0862e76ca42b0be0fb5afc1b"}
May 28 09:45:55.350407 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:45:55.350375    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-cmxp8" event={"ID":"054a0117-052d-4ccf-a96c-3ec53c00fa8a","Type":"ContainerStarted","Data":"c9725b632f1888c430d0570bdfdab74a281e2aaa90e481c55d4c657e1cefc486"}
May 28 09:45:55.368211 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:45:55.368160    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-test-apply-cmxp8" podStartSLOduration=8.923189209 podStartE2EDuration="13.368144735s" podCreationTimestamp="2026-05-28 09:45:42 +0000 UTC" firstStartedPulling="2026-05-28 09:45:43.44382013 +0000 UTC m=+855.903565753" lastFinishedPulling="2026-05-28 09:45:47.888775636 +0000 UTC m=+860.348521279" observedRunningTime="2026-05-28 09:45:55.366742488 +0000 UTC m=+867.826488143" watchObservedRunningTime="2026-05-28 09:45:55.368144735 +0000 UTC m=+867.827890383"
May 28 09:46:03.372482 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:46:03.372453    2578 generic.go:358] "Generic (PLEG): container finished" podID="054a0117-052d-4ccf-a96c-3ec53c00fa8a" containerID="c9725b632f1888c430d0570bdfdab74a281e2aaa90e481c55d4c657e1cefc486" exitCode=0
May 28 09:46:03.372752 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:46:03.372524    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-cmxp8" event={"ID":"054a0117-052d-4ccf-a96c-3ec53c00fa8a","Type":"ContainerDied","Data":"c9725b632f1888c430d0570bdfdab74a281e2aaa90e481c55d4c657e1cefc486"}
May 28 09:46:04.497065 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:46:04.497045    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-cmxp8"
May 28 09:46:04.623287 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:46:04.623257    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2qv7\" (UniqueName: \"kubernetes.io/projected/054a0117-052d-4ccf-a96c-3ec53c00fa8a-kube-api-access-r2qv7\") pod \"054a0117-052d-4ccf-a96c-3ec53c00fa8a\" (UID: \"054a0117-052d-4ccf-a96c-3ec53c00fa8a\") "
May 28 09:46:04.625372 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:46:04.625350    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/054a0117-052d-4ccf-a96c-3ec53c00fa8a-kube-api-access-r2qv7" (OuterVolumeSpecName: "kube-api-access-r2qv7") pod "054a0117-052d-4ccf-a96c-3ec53c00fa8a" (UID: "054a0117-052d-4ccf-a96c-3ec53c00fa8a"). InnerVolumeSpecName "kube-api-access-r2qv7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 09:46:04.723853 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:46:04.723827    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r2qv7\" (UniqueName: \"kubernetes.io/projected/054a0117-052d-4ccf-a96c-3ec53c00fa8a-kube-api-access-r2qv7\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 09:46:05.378929 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:46:05.378890    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-test-apply-cmxp8" event={"ID":"054a0117-052d-4ccf-a96c-3ec53c00fa8a","Type":"ContainerDied","Data":"c2b8c7f608aa4d24b3ef2432cda646478511e48ff7f315074af6d561c51fc693"}
May 28 09:46:05.378929 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:46:05.378913    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-test-apply-cmxp8"
May 28 09:46:05.378929 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:46:05.378922    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c2b8c7f608aa4d24b3ef2432cda646478511e48ff7f315074af6d561c51fc693"
May 28 09:46:05.563188 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:46:05.563156    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-cmxp8_054a0117-052d-4ccf-a96c-3ec53c00fa8a/feast-0/0.log"
May 28 09:46:05.569582 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:46:05.569560    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/test-ns-feast_feast-test-apply-cmxp8_054a0117-052d-4ccf-a96c-3ec53c00fa8a/feast-1/0.log"
May 28 09:46:28.090593 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:46:28.090566    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wqcwd_397304a8-87ab-49c0-9fc0-a3ca99f04032/ovn-acl-logging/0.log"
May 28 09:46:28.093098 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:46:28.093072    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wqcwd_397304a8-87ab-49c0-9fc0-a3ca99f04032/ovn-acl-logging/0.log"
May 28 09:46:41.287143 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:46:41.287110    2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-test-apply-cmxp8"]
May 28 09:46:41.292703 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:46:41.292677    2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-test-apply-cmxp8"]
May 28 09:46:41.305563 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:46:41.305540    2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-854544c579-gjmgh"]
May 28 09:46:41.305756 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:46:41.305716    2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/redis-854544c579-gjmgh" podUID="21fc0163-c18f-4db9-a014-4dcb08015d5a" containerName="redis" containerID="cri-o://41d548c46a5f705597ab7c69089f1fc679755d9adcb2b67cac10adf7395966c2" gracePeriod=30
May 28 09:46:41.465968 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:46:41.465938    2578 generic.go:358] "Generic (PLEG): container finished" podID="21fc0163-c18f-4db9-a014-4dcb08015d5a" containerID="41d548c46a5f705597ab7c69089f1fc679755d9adcb2b67cac10adf7395966c2" exitCode=0
May 28 09:46:41.466117 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:46:41.466006    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-gjmgh" event={"ID":"21fc0163-c18f-4db9-a014-4dcb08015d5a","Type":"ContainerDied","Data":"41d548c46a5f705597ab7c69089f1fc679755d9adcb2b67cac10adf7395966c2"}
May 28 09:46:41.546168 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:46:41.546118    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-gjmgh"
May 28 09:46:41.667071 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:46:41.667045    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fdbwd\" (UniqueName: \"kubernetes.io/projected/21fc0163-c18f-4db9-a014-4dcb08015d5a-kube-api-access-fdbwd\") pod \"21fc0163-c18f-4db9-a014-4dcb08015d5a\" (UID: \"21fc0163-c18f-4db9-a014-4dcb08015d5a\") "
May 28 09:46:41.669024 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:46:41.668999    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21fc0163-c18f-4db9-a014-4dcb08015d5a-kube-api-access-fdbwd" (OuterVolumeSpecName: "kube-api-access-fdbwd") pod "21fc0163-c18f-4db9-a014-4dcb08015d5a" (UID: "21fc0163-c18f-4db9-a014-4dcb08015d5a"). InnerVolumeSpecName "kube-api-access-fdbwd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 09:46:41.768204 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:46:41.768174    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fdbwd\" (UniqueName: \"kubernetes.io/projected/21fc0163-c18f-4db9-a014-4dcb08015d5a-kube-api-access-fdbwd\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 09:46:42.104822 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:46:42.104782    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="054a0117-052d-4ccf-a96c-3ec53c00fa8a" path="/var/lib/kubelet/pods/054a0117-052d-4ccf-a96c-3ec53c00fa8a/volumes"
May 28 09:46:42.469651 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:46:42.469622    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-854544c579-gjmgh"
May 28 09:46:42.470018 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:46:42.469628    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-854544c579-gjmgh" event={"ID":"21fc0163-c18f-4db9-a014-4dcb08015d5a","Type":"ContainerDied","Data":"1032b981fb833672c67aaf24e433af4f2717c078db67376d88a3be116b4f8a64"}
May 28 09:46:42.470018 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:46:42.469742    2578 scope.go:117] "RemoveContainer" containerID="41d548c46a5f705597ab7c69089f1fc679755d9adcb2b67cac10adf7395966c2"
May 28 09:46:42.487678 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:46:42.487654    2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-854544c579-gjmgh"]
May 28 09:46:42.489990 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:46:42.489970    2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/redis-854544c579-gjmgh"]
May 28 09:46:44.104651 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:46:44.104621    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21fc0163-c18f-4db9-a014-4dcb08015d5a" path="/var/lib/kubelet/pods/21fc0163-c18f-4db9-a014-4dcb08015d5a/volumes"
May 28 09:51:28.108679 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:28.108638    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wqcwd_397304a8-87ab-49c0-9fc0-a3ca99f04032/ovn-acl-logging/0.log"
May 28 09:51:28.115010 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:28.111467    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wqcwd_397304a8-87ab-49c0-9fc0-a3ca99f04032/ovn-acl-logging/0.log"
May 28 09:51:32.522814 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:32.522776    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-4d4sw"]
May 28 09:51:32.523181 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:32.523014    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21fc0163-c18f-4db9-a014-4dcb08015d5a" containerName="redis"
May 28 09:51:32.523181 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:32.523026    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="21fc0163-c18f-4db9-a014-4dcb08015d5a" containerName="redis"
May 28 09:51:32.523181 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:32.523039    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="054a0117-052d-4ccf-a96c-3ec53c00fa8a" containerName="feast-1"
May 28 09:51:32.523181 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:32.523044    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="054a0117-052d-4ccf-a96c-3ec53c00fa8a" containerName="feast-1"
May 28 09:51:32.523181 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:32.523061    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="054a0117-052d-4ccf-a96c-3ec53c00fa8a" containerName="feast-0"
May 28 09:51:32.523181 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:32.523067    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="054a0117-052d-4ccf-a96c-3ec53c00fa8a" containerName="feast-0"
May 28 09:51:32.523181 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:32.523104    2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="054a0117-052d-4ccf-a96c-3ec53c00fa8a" containerName="feast-1"
May 28 09:51:32.523181 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:32.523112    2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="21fc0163-c18f-4db9-a014-4dcb08015d5a" containerName="redis"
May 28 09:51:32.525769 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:32.525753    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-4d4sw"
May 28 09:51:32.529977 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:32.529955    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
May 28 09:51:32.530139 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:32.530013    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-rldtp\""
May 28 09:51:32.531113 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:32.531091    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
May 28 09:51:32.538656 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:32.538638    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-4d4sw"]
May 28 09:51:32.612647 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:32.612621    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2zjv\" (UniqueName: \"kubernetes.io/projected/e1c4c61e-b1e8-4e9b-af03-8a28f9a2f8ce-kube-api-access-q2zjv\") pod \"feast-operator-controller-manager-cf99db75-4d4sw\" (UID: \"e1c4c61e-b1e8-4e9b-af03-8a28f9a2f8ce\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-4d4sw"
May 28 09:51:32.713436 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:32.713406    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q2zjv\" (UniqueName: \"kubernetes.io/projected/e1c4c61e-b1e8-4e9b-af03-8a28f9a2f8ce-kube-api-access-q2zjv\") pod \"feast-operator-controller-manager-cf99db75-4d4sw\" (UID: \"e1c4c61e-b1e8-4e9b-af03-8a28f9a2f8ce\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-4d4sw"
May 28 09:51:32.726090 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:32.726062    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2zjv\" (UniqueName: \"kubernetes.io/projected/e1c4c61e-b1e8-4e9b-af03-8a28f9a2f8ce-kube-api-access-q2zjv\") pod \"feast-operator-controller-manager-cf99db75-4d4sw\" (UID: \"e1c4c61e-b1e8-4e9b-af03-8a28f9a2f8ce\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-4d4sw"
May 28 09:51:32.835463 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:32.835404    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-4d4sw"
May 28 09:51:32.956573 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:32.956537    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-4d4sw"]
May 28 09:51:32.959108 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:51:32.959079    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1c4c61e_b1e8_4e9b_af03_8a28f9a2f8ce.slice/crio-d8d62bb4595e185ef66e9c21fdb1297c8531325736bdfc9e88249ff61c2740d0 WatchSource:0}: Error finding container d8d62bb4595e185ef66e9c21fdb1297c8531325736bdfc9e88249ff61c2740d0: Status 404 returned error can't find the container with id d8d62bb4595e185ef66e9c21fdb1297c8531325736bdfc9e88249ff61c2740d0
May 28 09:51:32.960762 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:32.960748    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 09:51:33.206062 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:33.206034    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-4d4sw" event={"ID":"e1c4c61e-b1e8-4e9b-af03-8a28f9a2f8ce","Type":"ContainerStarted","Data":"d8d62bb4595e185ef66e9c21fdb1297c8531325736bdfc9e88249ff61c2740d0"}
May 28 09:51:36.214970 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:36.214938    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-4d4sw" event={"ID":"e1c4c61e-b1e8-4e9b-af03-8a28f9a2f8ce","Type":"ContainerStarted","Data":"9e6d10c9d44230a06550b73c5d16f4d3eba4e0beadfa60a8997eccf0ade87573"}
May 28 09:51:36.215367 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:36.215155    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-4d4sw"
May 28 09:51:36.237618 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:36.237576    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-4d4sw" podStartSLOduration=2.025364774 podStartE2EDuration="4.237562554s" podCreationTimestamp="2026-05-28 09:51:32 +0000 UTC" firstStartedPulling="2026-05-28 09:51:32.960865367 +0000 UTC m=+1205.420610991" lastFinishedPulling="2026-05-28 09:51:35.173063134 +0000 UTC m=+1207.632808771" observedRunningTime="2026-05-28 09:51:36.237341275 +0000 UTC m=+1208.697086920" watchObservedRunningTime="2026-05-28 09:51:36.237562554 +0000 UTC m=+1208.697308199"
May 28 09:51:47.220469 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:47.220438    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-4d4sw"
May 28 09:51:49.233281 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:49.233254    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9"]
May 28 09:51:49.236567 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:49.236547    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9"
May 28 09:51:49.238978 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:49.238958    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
May 28 09:51:49.239116 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:49.238958    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
May 28 09:51:49.239116 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:49.238976    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
May 28 09:51:49.239319 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:49.239171    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
May 28 09:51:49.239319 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:49.238987    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 28 09:51:49.239319 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:49.239187    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-qhzfh\""
May 28 09:51:49.239319 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:49.239203    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 28 09:51:49.248509 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:49.248485    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9"]
May 28 09:51:49.334476 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:49.334440    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4qpg\" (UniqueName: \"kubernetes.io/projected/b808b654-7da2-4099-a706-231324f04b89-kube-api-access-x4qpg\") pod \"feast-simple-feast-setup-664fcfcc58-gpjm9\" (UID: \"b808b654-7da2-4099-a706-231324f04b89\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9"
May 28 09:51:49.334651 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:49.334492    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b808b654-7da2-4099-a706-231324f04b89-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-gpjm9\" (UID: \"b808b654-7da2-4099-a706-231324f04b89\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9"
May 28 09:51:49.334651 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:49.334524    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b808b654-7da2-4099-a706-231324f04b89-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-gpjm9\" (UID: \"b808b654-7da2-4099-a706-231324f04b89\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9"
May 28 09:51:49.334651 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:49.334561    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b808b654-7da2-4099-a706-231324f04b89-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-gpjm9\" (UID: \"b808b654-7da2-4099-a706-231324f04b89\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9"
May 28 09:51:49.334651 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:49.334588    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b808b654-7da2-4099-a706-231324f04b89-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-gpjm9\" (UID: \"b808b654-7da2-4099-a706-231324f04b89\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9"
May 28 09:51:49.334651 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:49.334608    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b808b654-7da2-4099-a706-231324f04b89-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-gpjm9\" (UID: \"b808b654-7da2-4099-a706-231324f04b89\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9"
May 28 09:51:49.435258 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:49.435201    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x4qpg\" (UniqueName: \"kubernetes.io/projected/b808b654-7da2-4099-a706-231324f04b89-kube-api-access-x4qpg\") pod \"feast-simple-feast-setup-664fcfcc58-gpjm9\" (UID: \"b808b654-7da2-4099-a706-231324f04b89\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9"
May 28 09:51:49.435437 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:49.435264    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b808b654-7da2-4099-a706-231324f04b89-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-gpjm9\" (UID: \"b808b654-7da2-4099-a706-231324f04b89\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9"
May 28 09:51:49.435437 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:49.435304    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b808b654-7da2-4099-a706-231324f04b89-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-gpjm9\" (UID: \"b808b654-7da2-4099-a706-231324f04b89\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9"
May 28 09:51:49.435437 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:49.435334    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b808b654-7da2-4099-a706-231324f04b89-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-gpjm9\" (UID: \"b808b654-7da2-4099-a706-231324f04b89\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9"
May 28 09:51:49.435573 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:49.435430    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b808b654-7da2-4099-a706-231324f04b89-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-gpjm9\" (UID: \"b808b654-7da2-4099-a706-231324f04b89\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9"
May 28 09:51:49.435573 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:49.435469    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b808b654-7da2-4099-a706-231324f04b89-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-gpjm9\" (UID: \"b808b654-7da2-4099-a706-231324f04b89\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9"
May 28 09:51:49.435876 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:49.435846    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b808b654-7da2-4099-a706-231324f04b89-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-gpjm9\" (UID: \"b808b654-7da2-4099-a706-231324f04b89\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9"
May 28 09:51:49.437981 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:49.437959    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b808b654-7da2-4099-a706-231324f04b89-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-gpjm9\" (UID: \"b808b654-7da2-4099-a706-231324f04b89\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9"
May 28 09:51:49.438082 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:49.438059    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b808b654-7da2-4099-a706-231324f04b89-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-gpjm9\" (UID: \"b808b654-7da2-4099-a706-231324f04b89\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9"
May 28 09:51:49.438124 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:49.438090    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b808b654-7da2-4099-a706-231324f04b89-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-gpjm9\" (UID: \"b808b654-7da2-4099-a706-231324f04b89\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9"
May 28 09:51:49.438124 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:49.438108    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b808b654-7da2-4099-a706-231324f04b89-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-gpjm9\" (UID: \"b808b654-7da2-4099-a706-231324f04b89\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9"
May 28 09:51:49.443826 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:49.443795    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4qpg\" (UniqueName: \"kubernetes.io/projected/b808b654-7da2-4099-a706-231324f04b89-kube-api-access-x4qpg\") pod \"feast-simple-feast-setup-664fcfcc58-gpjm9\" (UID: \"b808b654-7da2-4099-a706-231324f04b89\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9"
May 28 09:51:49.545346 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:49.545252    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9"
May 28 09:51:49.671506 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:49.671471    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9"]
May 28 09:51:49.674551 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:51:49.674522    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb808b654_7da2_4099_a706_231324f04b89.slice/crio-51c053c0c05b770532d6fc3d69c3ccce3f0c34c4a6d5e2c6bc12a4b1a1296d84 WatchSource:0}: Error finding container 51c053c0c05b770532d6fc3d69c3ccce3f0c34c4a6d5e2c6bc12a4b1a1296d84: Status 404 returned error can't find the container with id 51c053c0c05b770532d6fc3d69c3ccce3f0c34c4a6d5e2c6bc12a4b1a1296d84
May 28 09:51:50.253986 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:51:50.253951    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9" event={"ID":"b808b654-7da2-4099-a706-231324f04b89","Type":"ContainerStarted","Data":"51c053c0c05b770532d6fc3d69c3ccce3f0c34c4a6d5e2c6bc12a4b1a1296d84"}
May 28 09:52:04.296008 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:52:04.295965    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9" event={"ID":"b808b654-7da2-4099-a706-231324f04b89","Type":"ContainerStarted","Data":"f89ea309d1daf8db151b11245dcaeff129eedcedc875d2c074c4b5257273e0ca"}
May 28 09:52:09.311180 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:52:09.311141    2578 generic.go:358] "Generic (PLEG): container finished" podID="b808b654-7da2-4099-a706-231324f04b89" containerID="f89ea309d1daf8db151b11245dcaeff129eedcedc875d2c074c4b5257273e0ca" exitCode=0
May 28 09:52:09.311646 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:52:09.311201    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9" event={"ID":"b808b654-7da2-4099-a706-231324f04b89","Type":"ContainerDied","Data":"f89ea309d1daf8db151b11245dcaeff129eedcedc875d2c074c4b5257273e0ca"}
May 28 09:52:10.315142 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:52:10.315111    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9" event={"ID":"b808b654-7da2-4099-a706-231324f04b89","Type":"ContainerStarted","Data":"2d20f026c955a73ef1730e2edcd1ab4e105c6a174ba9e8f2bd75cbfb5c6dec69"}
May 28 09:52:15.338081 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:52:15.338048    2578 generic.go:358] "Generic (PLEG): container finished" podID="b808b654-7da2-4099-a706-231324f04b89" containerID="2d20f026c955a73ef1730e2edcd1ab4e105c6a174ba9e8f2bd75cbfb5c6dec69" exitCode=0
May 28 09:52:15.338470 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:52:15.338118    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9" event={"ID":"b808b654-7da2-4099-a706-231324f04b89","Type":"ContainerDied","Data":"2d20f026c955a73ef1730e2edcd1ab4e105c6a174ba9e8f2bd75cbfb5c6dec69"}
May 28 09:52:16.345027 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:52:16.344970    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9" event={"ID":"b808b654-7da2-4099-a706-231324f04b89","Type":"ContainerStarted","Data":"bf0388ef8612cebad59e2710c0b1fb1d5e10f4a8f4faf29f044397d5bb9bde56"}
May 28 09:52:16.345534 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:52:16.345035    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9" event={"ID":"b808b654-7da2-4099-a706-231324f04b89","Type":"ContainerStarted","Data":"5a5070d878f3d7828a2b18012984b64b1b86f6486936e50be0656a47a75ac4fe"}
May 28 09:52:16.345534 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:52:16.345051    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9" event={"ID":"b808b654-7da2-4099-a706-231324f04b89","Type":"ContainerStarted","Data":"642b487a4ce3527939dd56b2dc9b17cc1826275a8286f2e3eab96f01df58e177"}
May 28 09:52:16.345534 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:52:16.345063    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9" event={"ID":"b808b654-7da2-4099-a706-231324f04b89","Type":"ContainerStarted","Data":"a26949ec526ac9b49cb0c083fb86469da59c5a2be594db22d6f7a6c2c64e2ffa"}
May 28 09:52:16.370761 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:52:16.370707    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9" podStartSLOduration=12.921701382 podStartE2EDuration="27.370688748s" podCreationTimestamp="2026-05-28 09:51:49 +0000 UTC" firstStartedPulling="2026-05-28 09:51:49.676282264 +0000 UTC m=+1222.136027888" lastFinishedPulling="2026-05-28 09:52:04.125269631 +0000 UTC m=+1236.585015254" observedRunningTime="2026-05-28 09:52:16.370059821 +0000 UTC m=+1248.829805514" watchObservedRunningTime="2026-05-28 09:52:16.370688748 +0000 UTC m=+1248.830434393"
May 28 09:52:16.546240 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:52:16.546007    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9"
May 28 09:52:16.546240 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:52:16.546057    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9"
May 28 09:52:16.546240 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:52:16.546073    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9"
May 28 09:52:16.546240 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:52:16.546206    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9"
May 28 09:52:16.548480 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:52:16.548427    2578 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9" podUID="b808b654-7da2-4099-a706-231324f04b89" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.20:6571: connect: connection refused"
May 28 09:52:16.548480 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:52:16.548458    2578 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9" podUID="b808b654-7da2-4099-a706-231324f04b89" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.20:8816: connect: connection refused"
May 28 09:52:16.548480 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:52:16.548473    2578 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9" podUID="b808b654-7da2-4099-a706-231324f04b89" containerName="online" probeResult="failure" output="Get \"https://10.132.0.20:6567/health\": dial tcp 10.132.0.20:6567: connect: connection refused"
May 28 09:52:16.548719 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:52:16.548531    2578 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9" podUID="b808b654-7da2-4099-a706-231324f04b89" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.20:8443: connect: connection refused"
May 28 09:52:19.545533 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:52:19.545493    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9"
May 28 09:52:19.546043 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:52:19.546021    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9"
May 28 09:52:19.546043 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:52:19.546044    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9"
May 28 09:52:19.546207 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:52:19.546057    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9"
May 28 09:52:19.546207 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:52:19.545882    2578 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9" podUID="b808b654-7da2-4099-a706-231324f04b89" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.20:6571: connect: connection refused"
May 28 09:52:19.546207 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:52:19.545793    2578 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9" podUID="b808b654-7da2-4099-a706-231324f04b89" containerName="online" probeResult="failure" output="Get \"https://10.132.0.20:6567/health\": dial tcp 10.132.0.20:6567: connect: connection refused"
May 28 09:52:19.546411 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:52:19.545864    2578 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9" podUID="b808b654-7da2-4099-a706-231324f04b89" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.20:8443: connect: connection refused"
May 28 09:52:19.546572 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:52:19.545738    2578 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9" podUID="b808b654-7da2-4099-a706-231324f04b89" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.20:8816: connect: connection refused"
May 28 09:52:22.546443 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:52:22.546413    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9"
May 28 09:52:22.546947 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:52:22.546580    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9"
May 28 09:52:22.547140 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:52:22.547118    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9"
May 28 09:52:22.547337 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:52:22.547317    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9"
May 28 09:52:22.547406 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:52:22.547375    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9"
May 28 09:52:22.551047 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:52:22.551030    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9"
May 28 09:52:23.367392 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:52:23.367361    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9"
May 28 09:52:23.369728 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:52:23.369712    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9"
May 28 09:52:28.121026 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:52:28.120998    2578 scope.go:117] "RemoveContainer" containerID="c9725b632f1888c430d0570bdfdab74a281e2aaa90e481c55d4c657e1cefc486"
May 28 09:52:28.128325 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:52:28.128300    2578 scope.go:117] "RemoveContainer" containerID="b94dd073b54c0d08b537914fc275027351257f5f0862e76ca42b0be0fb5afc1b"
May 28 09:53:25.034406 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:25.034373    2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9"]
May 28 09:53:25.035284 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:25.034789    2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9" podUID="b808b654-7da2-4099-a706-231324f04b89" containerName="registry" containerID="cri-o://a26949ec526ac9b49cb0c083fb86469da59c5a2be594db22d6f7a6c2c64e2ffa" gracePeriod=30
May 28 09:53:25.035284 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:25.034833    2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9" podUID="b808b654-7da2-4099-a706-231324f04b89" containerName="ui" containerID="cri-o://bf0388ef8612cebad59e2710c0b1fb1d5e10f4a8f4faf29f044397d5bb9bde56" gracePeriod=30
May 28 09:53:25.035284 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:25.034859    2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9" podUID="b808b654-7da2-4099-a706-231324f04b89" containerName="offline" containerID="cri-o://5a5070d878f3d7828a2b18012984b64b1b86f6486936e50be0656a47a75ac4fe" gracePeriod=30
May 28 09:53:25.035284 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:25.034958    2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9" podUID="b808b654-7da2-4099-a706-231324f04b89" containerName="online" containerID="cri-o://642b487a4ce3527939dd56b2dc9b17cc1826275a8286f2e3eab96f01df58e177" gracePeriod=30
May 28 09:53:25.435461 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:25.435422    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl"]
May 28 09:53:25.438850 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:25.438831    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl"
May 28 09:53:25.441253 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:25.441213    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-r7bng\""
May 28 09:53:25.452362 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:25.452341    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl"]
May 28 09:53:25.521008 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:25.520969    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/eddbb5cd-d7fc-4f47-8272-278d71ed91b9-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-m8pvl\" (UID: \"eddbb5cd-d7fc-4f47-8272-278d71ed91b9\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl"
May 28 09:53:25.521199 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:25.521031    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/eddbb5cd-d7fc-4f47-8272-278d71ed91b9-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-m8pvl\" (UID: \"eddbb5cd-d7fc-4f47-8272-278d71ed91b9\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl"
May 28 09:53:25.521199 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:25.521079    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/eddbb5cd-d7fc-4f47-8272-278d71ed91b9-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-m8pvl\" (UID: \"eddbb5cd-d7fc-4f47-8272-278d71ed91b9\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl"
May 28 09:53:25.521199 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:25.521108    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-djqsb\" (UniqueName: \"kubernetes.io/projected/eddbb5cd-d7fc-4f47-8272-278d71ed91b9-kube-api-access-djqsb\") pod \"feast-simple-feast-setup-664fcfcc58-m8pvl\" (UID: \"eddbb5cd-d7fc-4f47-8272-278d71ed91b9\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl"
May 28 09:53:25.521199 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:25.521158    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/eddbb5cd-d7fc-4f47-8272-278d71ed91b9-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-m8pvl\" (UID: \"eddbb5cd-d7fc-4f47-8272-278d71ed91b9\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl"
May 28 09:53:25.521199 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:25.521186    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/eddbb5cd-d7fc-4f47-8272-278d71ed91b9-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-m8pvl\" (UID: \"eddbb5cd-d7fc-4f47-8272-278d71ed91b9\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl"
May 28 09:53:25.527604 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:25.527572    2578 generic.go:358] "Generic (PLEG): container finished" podID="b808b654-7da2-4099-a706-231324f04b89" containerID="bf0388ef8612cebad59e2710c0b1fb1d5e10f4a8f4faf29f044397d5bb9bde56" exitCode=0
May 28 09:53:25.527784 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:25.527624    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9" event={"ID":"b808b654-7da2-4099-a706-231324f04b89","Type":"ContainerDied","Data":"bf0388ef8612cebad59e2710c0b1fb1d5e10f4a8f4faf29f044397d5bb9bde56"}
May 28 09:53:25.621969 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:25.621918    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/eddbb5cd-d7fc-4f47-8272-278d71ed91b9-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-m8pvl\" (UID: \"eddbb5cd-d7fc-4f47-8272-278d71ed91b9\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl"
May 28 09:53:25.621969 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:25.621962    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/eddbb5cd-d7fc-4f47-8272-278d71ed91b9-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-m8pvl\" (UID: \"eddbb5cd-d7fc-4f47-8272-278d71ed91b9\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl"
May 28 09:53:25.622256 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:25.622009    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/eddbb5cd-d7fc-4f47-8272-278d71ed91b9-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-m8pvl\" (UID: \"eddbb5cd-d7fc-4f47-8272-278d71ed91b9\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl"
May 28 09:53:25.622256 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:25.622030    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/eddbb5cd-d7fc-4f47-8272-278d71ed91b9-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-m8pvl\" (UID: \"eddbb5cd-d7fc-4f47-8272-278d71ed91b9\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl"
May 28 09:53:25.622256 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:25.622055    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/eddbb5cd-d7fc-4f47-8272-278d71ed91b9-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-m8pvl\" (UID: \"eddbb5cd-d7fc-4f47-8272-278d71ed91b9\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl"
May 28 09:53:25.622256 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:25.622076    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-djqsb\" (UniqueName: \"kubernetes.io/projected/eddbb5cd-d7fc-4f47-8272-278d71ed91b9-kube-api-access-djqsb\") pod \"feast-simple-feast-setup-664fcfcc58-m8pvl\" (UID: \"eddbb5cd-d7fc-4f47-8272-278d71ed91b9\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl"
May 28 09:53:25.622256 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:53:25.622193    2578 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
May 28 09:53:25.622497 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:53:25.622309    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eddbb5cd-d7fc-4f47-8272-278d71ed91b9-ui-tls podName:eddbb5cd-d7fc-4f47-8272-278d71ed91b9 nodeName:}" failed. No retries permitted until 2026-05-28 09:53:26.12228406 +0000 UTC m=+1318.582029720 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/eddbb5cd-d7fc-4f47-8272-278d71ed91b9-ui-tls") pod "feast-simple-feast-setup-664fcfcc58-m8pvl" (UID: "eddbb5cd-d7fc-4f47-8272-278d71ed91b9") : secret "feast-simple-feast-setup-ui-tls" not found
May 28 09:53:25.622497 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:25.622460    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/eddbb5cd-d7fc-4f47-8272-278d71ed91b9-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-m8pvl\" (UID: \"eddbb5cd-d7fc-4f47-8272-278d71ed91b9\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl"
May 28 09:53:25.624479 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:25.624457    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/eddbb5cd-d7fc-4f47-8272-278d71ed91b9-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-m8pvl\" (UID: \"eddbb5cd-d7fc-4f47-8272-278d71ed91b9\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl"
May 28 09:53:25.624622 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:25.624564    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/eddbb5cd-d7fc-4f47-8272-278d71ed91b9-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-m8pvl\" (UID: \"eddbb5cd-d7fc-4f47-8272-278d71ed91b9\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl"
May 28 09:53:25.624690 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:25.624619    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/eddbb5cd-d7fc-4f47-8272-278d71ed91b9-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-m8pvl\" (UID: \"eddbb5cd-d7fc-4f47-8272-278d71ed91b9\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl"
May 28 09:53:25.635202 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:25.635178    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-djqsb\" (UniqueName: \"kubernetes.io/projected/eddbb5cd-d7fc-4f47-8272-278d71ed91b9-kube-api-access-djqsb\") pod \"feast-simple-feast-setup-664fcfcc58-m8pvl\" (UID: \"eddbb5cd-d7fc-4f47-8272-278d71ed91b9\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl"
May 28 09:53:26.127493 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:26.127418    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/eddbb5cd-d7fc-4f47-8272-278d71ed91b9-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-m8pvl\" (UID: \"eddbb5cd-d7fc-4f47-8272-278d71ed91b9\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl"
May 28 09:53:26.129636 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:26.129618    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/eddbb5cd-d7fc-4f47-8272-278d71ed91b9-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-m8pvl\" (UID: \"eddbb5cd-d7fc-4f47-8272-278d71ed91b9\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl"
May 28 09:53:26.348317 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:26.348289    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl"
May 28 09:53:26.477384 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:26.477343    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl"]
May 28 09:53:26.478676 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:53:26.478650    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeddbb5cd_d7fc_4f47_8272_278d71ed91b9.slice/crio-3cfd13ed56bc3c5657ab92d71795b352de18bb5c39374bd5ed47ca3f984c4400 WatchSource:0}: Error finding container 3cfd13ed56bc3c5657ab92d71795b352de18bb5c39374bd5ed47ca3f984c4400: Status 404 returned error can't find the container with id 3cfd13ed56bc3c5657ab92d71795b352de18bb5c39374bd5ed47ca3f984c4400
May 28 09:53:26.532947 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:26.532922    2578 generic.go:358] "Generic (PLEG): container finished" podID="b808b654-7da2-4099-a706-231324f04b89" containerID="642b487a4ce3527939dd56b2dc9b17cc1826275a8286f2e3eab96f01df58e177" exitCode=0
May 28 09:53:26.533044 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:26.532982    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9" event={"ID":"b808b654-7da2-4099-a706-231324f04b89","Type":"ContainerDied","Data":"642b487a4ce3527939dd56b2dc9b17cc1826275a8286f2e3eab96f01df58e177"}
May 28 09:53:26.534234 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:26.534204    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl" event={"ID":"eddbb5cd-d7fc-4f47-8272-278d71ed91b9","Type":"ContainerStarted","Data":"3cfd13ed56bc3c5657ab92d71795b352de18bb5c39374bd5ed47ca3f984c4400"}
May 28 09:53:27.537773 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:27.537737    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl" event={"ID":"eddbb5cd-d7fc-4f47-8272-278d71ed91b9","Type":"ContainerStarted","Data":"14037bb4e6bcf1c49d314831d6877ed0ecedba65b9f8cc5e77888059e3bf84fa"}
May 28 09:53:31.548996 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:31.548965    2578 generic.go:358] "Generic (PLEG): container finished" podID="eddbb5cd-d7fc-4f47-8272-278d71ed91b9" containerID="14037bb4e6bcf1c49d314831d6877ed0ecedba65b9f8cc5e77888059e3bf84fa" exitCode=0
May 28 09:53:31.549410 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:31.549016    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl" event={"ID":"eddbb5cd-d7fc-4f47-8272-278d71ed91b9","Type":"ContainerDied","Data":"14037bb4e6bcf1c49d314831d6877ed0ecedba65b9f8cc5e77888059e3bf84fa"}
May 28 09:53:32.553363 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:32.553330    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl" event={"ID":"eddbb5cd-d7fc-4f47-8272-278d71ed91b9","Type":"ContainerStarted","Data":"b7b463603bfb2167fedbc88c91d683431ecb1f7fc46f5f618f4e2c5f4450b74e"}
May 28 09:53:33.367571 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:33.367537    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9" podUID="b808b654-7da2-4099-a706-231324f04b89" containerName="online" probeResult="failure" output="Get \"https://10.132.0.20:6567/health\": dial tcp 10.132.0.20:6567: connect: connection refused"
May 28 09:53:33.367733 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:33.367530    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9" podUID="b808b654-7da2-4099-a706-231324f04b89" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.20:8443: connect: connection refused"
May 28 09:53:37.569288 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:37.569199    2578 generic.go:358] "Generic (PLEG): container finished" podID="eddbb5cd-d7fc-4f47-8272-278d71ed91b9" containerID="b7b463603bfb2167fedbc88c91d683431ecb1f7fc46f5f618f4e2c5f4450b74e" exitCode=0
May 28 09:53:37.569288 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:37.569270    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl" event={"ID":"eddbb5cd-d7fc-4f47-8272-278d71ed91b9","Type":"ContainerDied","Data":"b7b463603bfb2167fedbc88c91d683431ecb1f7fc46f5f618f4e2c5f4450b74e"}
May 28 09:53:38.576340 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:38.576291    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl" event={"ID":"eddbb5cd-d7fc-4f47-8272-278d71ed91b9","Type":"ContainerStarted","Data":"006587e1495f44edc93d9e8750a8b44dffe2810dd5d61aa9c5753a39005fcb6e"}
May 28 09:53:38.576340 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:38.576344    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl" event={"ID":"eddbb5cd-d7fc-4f47-8272-278d71ed91b9","Type":"ContainerStarted","Data":"646da3324880704515171d01b2fea20659a6d0f6f0f7860db6f1968e3a9fbd99"}
May 28 09:53:38.576876 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:38.576359    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl" event={"ID":"eddbb5cd-d7fc-4f47-8272-278d71ed91b9","Type":"ContainerStarted","Data":"ee0e8ea550c4559c1d84605bcd1a601a6a7f9d390a9194362c1733cbad2c7b3b"}
May 28 09:53:38.576876 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:38.576373    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl" event={"ID":"eddbb5cd-d7fc-4f47-8272-278d71ed91b9","Type":"ContainerStarted","Data":"6998bc056d007d68a16ec5cc5297d42d781d6c015512b80d186a7affc03c0ef7"}
May 28 09:53:38.601778 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:38.601718    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl" podStartSLOduration=13.601697116 podStartE2EDuration="13.601697116s" podCreationTimestamp="2026-05-28 09:53:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 09:53:38.600104774 +0000 UTC m=+1331.059850422" watchObservedRunningTime="2026-05-28 09:53:38.601697116 +0000 UTC m=+1331.061442762"
May 28 09:53:41.350416 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:41.349478    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl"
May 28 09:53:41.350416 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:41.349527    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl"
May 28 09:53:41.350416 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:41.349543    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl"
May 28 09:53:41.350416 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:41.349555    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl"
May 28 09:53:41.351193 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:41.351151    2578 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl" podUID="eddbb5cd-d7fc-4f47-8272-278d71ed91b9" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.21:8816: connect: connection refused"
May 28 09:53:41.351193 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:41.351174    2578 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl" podUID="eddbb5cd-d7fc-4f47-8272-278d71ed91b9" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.21:6571: connect: connection refused"
May 28 09:53:41.351393 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:41.351239    2578 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl" podUID="eddbb5cd-d7fc-4f47-8272-278d71ed91b9" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.21:8443: connect: connection refused"
May 28 09:53:41.351393 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:41.351285    2578 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl" podUID="eddbb5cd-d7fc-4f47-8272-278d71ed91b9" containerName="online" probeResult="failure" output="Get \"https://10.132.0.21:6567/health\": dial tcp 10.132.0.21:6567: connect: connection refused"
May 28 09:53:43.367286 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:43.367240    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9" podUID="b808b654-7da2-4099-a706-231324f04b89" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.20:8443: connect: connection refused"
May 28 09:53:43.367720 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:43.367243    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9" podUID="b808b654-7da2-4099-a706-231324f04b89" containerName="online" probeResult="failure" output="Get \"https://10.132.0.20:6567/health\": dial tcp 10.132.0.20:6567: connect: connection refused"
May 28 09:53:44.350171 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:44.350142    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl"
May 28 09:53:44.350360 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:44.350275    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl"
May 28 09:53:44.350615 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:44.350591    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl"
May 28 09:53:44.350728 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:44.350625    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl"
May 28 09:53:44.350728 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:44.350639    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl"
May 28 09:53:44.350728 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:44.350652    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl"
May 28 09:53:44.351011 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:44.350991    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl"
May 28 09:53:44.351067 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:44.351040    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl"
May 28 09:53:44.351099 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:44.351068    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl"
May 28 09:53:44.354564 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:44.354548    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl"
May 28 09:53:44.598049 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:44.598022    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl"
May 28 09:53:44.600892 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:44.600844    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl"
May 28 09:53:53.367635 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:53.367593    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9" podUID="b808b654-7da2-4099-a706-231324f04b89" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.20:8443: connect: connection refused"
May 28 09:53:53.368082 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:53.367603    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9" podUID="b808b654-7da2-4099-a706-231324f04b89" containerName="online" probeResult="failure" output="Get \"https://10.132.0.20:6567/health\": dial tcp 10.132.0.20:6567: connect: connection refused"
May 28 09:53:53.368082 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:53.367726    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9"
May 28 09:53:53.368082 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:53.367797    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9"
May 28 09:53:55.631620 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:55.631590    2578 generic.go:358] "Generic (PLEG): container finished" podID="b808b654-7da2-4099-a706-231324f04b89" containerID="5a5070d878f3d7828a2b18012984b64b1b86f6486936e50be0656a47a75ac4fe" exitCode=137
May 28 09:53:55.631620 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:55.631616    2578 generic.go:358] "Generic (PLEG): container finished" podID="b808b654-7da2-4099-a706-231324f04b89" containerID="a26949ec526ac9b49cb0c083fb86469da59c5a2be594db22d6f7a6c2c64e2ffa" exitCode=137
May 28 09:53:55.631981 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:55.631642    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9" event={"ID":"b808b654-7da2-4099-a706-231324f04b89","Type":"ContainerDied","Data":"5a5070d878f3d7828a2b18012984b64b1b86f6486936e50be0656a47a75ac4fe"}
May 28 09:53:55.631981 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:55.631666    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9" event={"ID":"b808b654-7da2-4099-a706-231324f04b89","Type":"ContainerDied","Data":"a26949ec526ac9b49cb0c083fb86469da59c5a2be594db22d6f7a6c2c64e2ffa"}
May 28 09:53:55.679144 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:55.679123    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9"
May 28 09:53:55.756791 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:55.756763    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b808b654-7da2-4099-a706-231324f04b89-ui-tls\") pod \"b808b654-7da2-4099-a706-231324f04b89\" (UID: \"b808b654-7da2-4099-a706-231324f04b89\") "
May 28 09:53:55.756900 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:55.756800    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4qpg\" (UniqueName: \"kubernetes.io/projected/b808b654-7da2-4099-a706-231324f04b89-kube-api-access-x4qpg\") pod \"b808b654-7da2-4099-a706-231324f04b89\" (UID: \"b808b654-7da2-4099-a706-231324f04b89\") "
May 28 09:53:55.756900 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:55.756827    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b808b654-7da2-4099-a706-231324f04b89-feast-data\") pod \"b808b654-7da2-4099-a706-231324f04b89\" (UID: \"b808b654-7da2-4099-a706-231324f04b89\") "
May 28 09:53:55.756900 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:55.756861    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b808b654-7da2-4099-a706-231324f04b89-registry-tls\") pod \"b808b654-7da2-4099-a706-231324f04b89\" (UID: \"b808b654-7da2-4099-a706-231324f04b89\") "
May 28 09:53:55.756900 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:55.756881    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b808b654-7da2-4099-a706-231324f04b89-online-tls\") pod \"b808b654-7da2-4099-a706-231324f04b89\" (UID: \"b808b654-7da2-4099-a706-231324f04b89\") "
May 28 09:53:55.757109 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:55.756924    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b808b654-7da2-4099-a706-231324f04b89-offline-tls\") pod \"b808b654-7da2-4099-a706-231324f04b89\" (UID: \"b808b654-7da2-4099-a706-231324f04b89\") "
May 28 09:53:55.757393 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:55.757363    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b808b654-7da2-4099-a706-231324f04b89-feast-data" (OuterVolumeSpecName: "feast-data") pod "b808b654-7da2-4099-a706-231324f04b89" (UID: "b808b654-7da2-4099-a706-231324f04b89"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 09:53:55.759059 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:55.759029    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b808b654-7da2-4099-a706-231324f04b89-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "b808b654-7da2-4099-a706-231324f04b89" (UID: "b808b654-7da2-4099-a706-231324f04b89"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:53:55.759059 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:55.759048    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b808b654-7da2-4099-a706-231324f04b89-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b808b654-7da2-4099-a706-231324f04b89" (UID: "b808b654-7da2-4099-a706-231324f04b89"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:53:55.759191 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:55.759088    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b808b654-7da2-4099-a706-231324f04b89-kube-api-access-x4qpg" (OuterVolumeSpecName: "kube-api-access-x4qpg") pod "b808b654-7da2-4099-a706-231324f04b89" (UID: "b808b654-7da2-4099-a706-231324f04b89"). InnerVolumeSpecName "kube-api-access-x4qpg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 09:53:55.759267 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:55.759236    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b808b654-7da2-4099-a706-231324f04b89-online-tls" (OuterVolumeSpecName: "online-tls") pod "b808b654-7da2-4099-a706-231324f04b89" (UID: "b808b654-7da2-4099-a706-231324f04b89"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:53:55.759267 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:55.759210    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b808b654-7da2-4099-a706-231324f04b89-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "b808b654-7da2-4099-a706-231324f04b89" (UID: "b808b654-7da2-4099-a706-231324f04b89"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:53:55.857768 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:55.857715    2578 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b808b654-7da2-4099-a706-231324f04b89-offline-tls\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 09:53:55.857768 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:55.857737    2578 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b808b654-7da2-4099-a706-231324f04b89-ui-tls\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 09:53:55.857768 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:55.857746    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4qpg\" (UniqueName: \"kubernetes.io/projected/b808b654-7da2-4099-a706-231324f04b89-kube-api-access-x4qpg\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 09:53:55.857768 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:55.857756    2578 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b808b654-7da2-4099-a706-231324f04b89-feast-data\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 09:53:55.857768 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:55.857764    2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/b808b654-7da2-4099-a706-231324f04b89-registry-tls\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 09:53:55.857967 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:55.857772    2578 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b808b654-7da2-4099-a706-231324f04b89-online-tls\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 09:53:56.637406 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:56.637371    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9" event={"ID":"b808b654-7da2-4099-a706-231324f04b89","Type":"ContainerDied","Data":"51c053c0c05b770532d6fc3d69c3ccce3f0c34c4a6d5e2c6bc12a4b1a1296d84"}
May 28 09:53:56.637406 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:56.637414    2578 scope.go:117] "RemoveContainer" containerID="bf0388ef8612cebad59e2710c0b1fb1d5e10f4a8f4faf29f044397d5bb9bde56"
May 28 09:53:56.637819 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:56.637424    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9"
May 28 09:53:56.644959 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:56.644931    2578 scope.go:117] "RemoveContainer" containerID="5a5070d878f3d7828a2b18012984b64b1b86f6486936e50be0656a47a75ac4fe"
May 28 09:53:56.651669 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:56.651654    2578 scope.go:117] "RemoveContainer" containerID="642b487a4ce3527939dd56b2dc9b17cc1826275a8286f2e3eab96f01df58e177"
May 28 09:53:56.658932 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:56.658907    2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9"]
May 28 09:53:56.659332 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:56.659314    2578 scope.go:117] "RemoveContainer" containerID="a26949ec526ac9b49cb0c083fb86469da59c5a2be594db22d6f7a6c2c64e2ffa"
May 28 09:53:56.664549 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:56.664527    2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-gpjm9"]
May 28 09:53:56.666071 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:56.666056    2578 scope.go:117] "RemoveContainer" containerID="2d20f026c955a73ef1730e2edcd1ab4e105c6a174ba9e8f2bd75cbfb5c6dec69"
May 28 09:53:56.672396 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:56.672380    2578 scope.go:117] "RemoveContainer" containerID="f89ea309d1daf8db151b11245dcaeff129eedcedc875d2c074c4b5257273e0ca"
May 28 09:53:58.104976 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:53:58.104925    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b808b654-7da2-4099-a706-231324f04b89" path="/var/lib/kubelet/pods/b808b654-7da2-4099-a706-231324f04b89/volumes"
May 28 09:54:47.092110 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:47.092077    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6"]
May 28 09:54:47.092577 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:47.092361    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b808b654-7da2-4099-a706-231324f04b89" containerName="online"
May 28 09:54:47.092577 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:47.092376    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b808b654-7da2-4099-a706-231324f04b89" containerName="online"
May 28 09:54:47.092577 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:47.092400    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b808b654-7da2-4099-a706-231324f04b89" containerName="feast-init"
May 28 09:54:47.092577 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:47.092408    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b808b654-7da2-4099-a706-231324f04b89" containerName="feast-init"
May 28 09:54:47.092577 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:47.092420    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b808b654-7da2-4099-a706-231324f04b89" containerName="feast-apply"
May 28 09:54:47.092577 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:47.092429    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b808b654-7da2-4099-a706-231324f04b89" containerName="feast-apply"
May 28 09:54:47.092577 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:47.092438    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b808b654-7da2-4099-a706-231324f04b89" containerName="registry"
May 28 09:54:47.092577 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:47.092447    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b808b654-7da2-4099-a706-231324f04b89" containerName="registry"
May 28 09:54:47.092577 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:47.092456    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b808b654-7da2-4099-a706-231324f04b89" containerName="ui"
May 28 09:54:47.092577 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:47.092463    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b808b654-7da2-4099-a706-231324f04b89" containerName="ui"
May 28 09:54:47.092577 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:47.092474    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b808b654-7da2-4099-a706-231324f04b89" containerName="offline"
May 28 09:54:47.092577 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:47.092481    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b808b654-7da2-4099-a706-231324f04b89" containerName="offline"
May 28 09:54:47.092577 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:47.092543    2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="b808b654-7da2-4099-a706-231324f04b89" containerName="offline"
May 28 09:54:47.092577 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:47.092556    2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="b808b654-7da2-4099-a706-231324f04b89" containerName="online"
May 28 09:54:47.092577 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:47.092566    2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="b808b654-7da2-4099-a706-231324f04b89" containerName="ui"
May 28 09:54:47.092577 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:47.092577    2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="b808b654-7da2-4099-a706-231324f04b89" containerName="registry"
May 28 09:54:47.096032 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:47.096010    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6"
May 28 09:54:47.098564 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:47.098541    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
May 28 09:54:47.098686 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:47.098609    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
May 28 09:54:47.098686 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:47.098611    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
May 28 09:54:47.098802 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:47.098660    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
May 28 09:54:47.098802 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:47.098658    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-7thp8\""
May 28 09:54:47.098802 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:47.098659    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
May 28 09:54:47.099033 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:47.099017    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
May 28 09:54:47.107642 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:47.107620    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6"]
May 28 09:54:47.117255 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:47.117216    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jjsp\" (UniqueName: \"kubernetes.io/projected/30761ab3-4581-4bb4-b6b6-9a4c90b4990c-kube-api-access-6jjsp\") pod \"feast-simple-feast-remote-setup-5cff94746b-lx2d6\" (UID: \"30761ab3-4581-4bb4-b6b6-9a4c90b4990c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6"
May 28 09:54:47.117336 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:47.117271    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/30761ab3-4581-4bb4-b6b6-9a4c90b4990c-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-lx2d6\" (UID: \"30761ab3-4581-4bb4-b6b6-9a4c90b4990c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6"
May 28 09:54:47.117336 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:47.117291    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/30761ab3-4581-4bb4-b6b6-9a4c90b4990c-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-lx2d6\" (UID: \"30761ab3-4581-4bb4-b6b6-9a4c90b4990c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6"
May 28 09:54:47.117336 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:47.117324    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/30761ab3-4581-4bb4-b6b6-9a4c90b4990c-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-lx2d6\" (UID: \"30761ab3-4581-4bb4-b6b6-9a4c90b4990c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6"
May 28 09:54:47.117456 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:47.117398    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/30761ab3-4581-4bb4-b6b6-9a4c90b4990c-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-lx2d6\" (UID: \"30761ab3-4581-4bb4-b6b6-9a4c90b4990c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6"
May 28 09:54:47.117510 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:47.117458    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/30761ab3-4581-4bb4-b6b6-9a4c90b4990c-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-lx2d6\" (UID: \"30761ab3-4581-4bb4-b6b6-9a4c90b4990c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6"
May 28 09:54:47.218296 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:47.218271    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/30761ab3-4581-4bb4-b6b6-9a4c90b4990c-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-lx2d6\" (UID: \"30761ab3-4581-4bb4-b6b6-9a4c90b4990c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6"
May 28 09:54:47.218408 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:47.218301    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6jjsp\" (UniqueName: \"kubernetes.io/projected/30761ab3-4581-4bb4-b6b6-9a4c90b4990c-kube-api-access-6jjsp\") pod \"feast-simple-feast-remote-setup-5cff94746b-lx2d6\" (UID: \"30761ab3-4581-4bb4-b6b6-9a4c90b4990c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6"
May 28 09:54:47.218408 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:47.218324    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/30761ab3-4581-4bb4-b6b6-9a4c90b4990c-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-lx2d6\" (UID: \"30761ab3-4581-4bb4-b6b6-9a4c90b4990c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6"
May 28 09:54:47.218408 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:47.218347    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/30761ab3-4581-4bb4-b6b6-9a4c90b4990c-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-lx2d6\" (UID: \"30761ab3-4581-4bb4-b6b6-9a4c90b4990c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6"
May 28 09:54:47.218408 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:47.218396    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/30761ab3-4581-4bb4-b6b6-9a4c90b4990c-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-lx2d6\" (UID: \"30761ab3-4581-4bb4-b6b6-9a4c90b4990c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6"
May 28 09:54:47.218624 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:47.218453    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/30761ab3-4581-4bb4-b6b6-9a4c90b4990c-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-lx2d6\" (UID: \"30761ab3-4581-4bb4-b6b6-9a4c90b4990c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6"
May 28 09:54:47.218624 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:54:47.218453    2578 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found
May 28 09:54:47.218624 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:54:47.218546    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30761ab3-4581-4bb4-b6b6-9a4c90b4990c-ui-tls podName:30761ab3-4581-4bb4-b6b6-9a4c90b4990c nodeName:}" failed. No retries permitted until 2026-05-28 09:54:47.718526927 +0000 UTC m=+1400.178272552 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/30761ab3-4581-4bb4-b6b6-9a4c90b4990c-ui-tls") pod "feast-simple-feast-remote-setup-5cff94746b-lx2d6" (UID: "30761ab3-4581-4bb4-b6b6-9a4c90b4990c") : secret "feast-simple-feast-remote-setup-ui-tls" not found
May 28 09:54:47.218624 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:54:47.218545    2578 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-online-tls: secret "feast-simple-feast-remote-setup-online-tls" not found
May 28 09:54:47.218624 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:54:47.218581    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30761ab3-4581-4bb4-b6b6-9a4c90b4990c-online-tls podName:30761ab3-4581-4bb4-b6b6-9a4c90b4990c nodeName:}" failed. No retries permitted until 2026-05-28 09:54:47.718572292 +0000 UTC m=+1400.178317916 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/30761ab3-4581-4bb4-b6b6-9a4c90b4990c-online-tls") pod "feast-simple-feast-remote-setup-5cff94746b-lx2d6" (UID: "30761ab3-4581-4bb4-b6b6-9a4c90b4990c") : secret "feast-simple-feast-remote-setup-online-tls" not found
May 28 09:54:47.218837 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:47.218781    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/30761ab3-4581-4bb4-b6b6-9a4c90b4990c-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-lx2d6\" (UID: \"30761ab3-4581-4bb4-b6b6-9a4c90b4990c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6"
May 28 09:54:47.218993 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:47.218975    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/30761ab3-4581-4bb4-b6b6-9a4c90b4990c-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-lx2d6\" (UID: \"30761ab3-4581-4bb4-b6b6-9a4c90b4990c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6"
May 28 09:54:47.220735 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:47.220713    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/30761ab3-4581-4bb4-b6b6-9a4c90b4990c-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-lx2d6\" (UID: \"30761ab3-4581-4bb4-b6b6-9a4c90b4990c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6"
May 28 09:54:47.227178 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:47.227155    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jjsp\" (UniqueName: \"kubernetes.io/projected/30761ab3-4581-4bb4-b6b6-9a4c90b4990c-kube-api-access-6jjsp\") pod \"feast-simple-feast-remote-setup-5cff94746b-lx2d6\" (UID: \"30761ab3-4581-4bb4-b6b6-9a4c90b4990c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6"
May 28 09:54:47.721874 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:47.721844    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/30761ab3-4581-4bb4-b6b6-9a4c90b4990c-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-lx2d6\" (UID: \"30761ab3-4581-4bb4-b6b6-9a4c90b4990c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6"
May 28 09:54:47.722019 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:47.721901    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/30761ab3-4581-4bb4-b6b6-9a4c90b4990c-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-lx2d6\" (UID: \"30761ab3-4581-4bb4-b6b6-9a4c90b4990c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6"
May 28 09:54:47.724201 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:47.724175    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/30761ab3-4581-4bb4-b6b6-9a4c90b4990c-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-lx2d6\" (UID: \"30761ab3-4581-4bb4-b6b6-9a4c90b4990c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6"
May 28 09:54:47.724323 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:47.724216    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/30761ab3-4581-4bb4-b6b6-9a4c90b4990c-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-lx2d6\" (UID: \"30761ab3-4581-4bb4-b6b6-9a4c90b4990c\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6"
May 28 09:54:48.004608 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:48.004535    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6"
May 28 09:54:48.133966 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:48.133942    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6"]
May 28 09:54:48.135297 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:54:48.135274    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod30761ab3_4581_4bb4_b6b6_9a4c90b4990c.slice/crio-f2cf47e6be242697364c1f919583185a6bc08b7ea5b6119c29152df0d26a8469 WatchSource:0}: Error finding container f2cf47e6be242697364c1f919583185a6bc08b7ea5b6119c29152df0d26a8469: Status 404 returned error can't find the container with id f2cf47e6be242697364c1f919583185a6bc08b7ea5b6119c29152df0d26a8469
May 28 09:54:48.773694 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:48.773660    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6" event={"ID":"30761ab3-4581-4bb4-b6b6-9a4c90b4990c","Type":"ContainerStarted","Data":"8c419fe757328d33e2a1cbe38cb8f128d294d8ebc728d4c07e8c03fea40ae67b"}
May 28 09:54:48.773867 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:48.773701    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6" event={"ID":"30761ab3-4581-4bb4-b6b6-9a4c90b4990c","Type":"ContainerStarted","Data":"f2cf47e6be242697364c1f919583185a6bc08b7ea5b6119c29152df0d26a8469"}
May 28 09:54:52.786642 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:52.786570    2578 generic.go:358] "Generic (PLEG): container finished" podID="30761ab3-4581-4bb4-b6b6-9a4c90b4990c" containerID="8c419fe757328d33e2a1cbe38cb8f128d294d8ebc728d4c07e8c03fea40ae67b" exitCode=0
May 28 09:54:52.786957 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:52.786640    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6" event={"ID":"30761ab3-4581-4bb4-b6b6-9a4c90b4990c","Type":"ContainerDied","Data":"8c419fe757328d33e2a1cbe38cb8f128d294d8ebc728d4c07e8c03fea40ae67b"}
May 28 09:54:53.790616 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:53.790579    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6" event={"ID":"30761ab3-4581-4bb4-b6b6-9a4c90b4990c","Type":"ContainerStarted","Data":"3d433a58d6112792917e8d46180d50bb80165cefb7973b33120f7a200413f57f"}
May 28 09:54:58.809389 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:58.809355    2578 generic.go:358] "Generic (PLEG): container finished" podID="30761ab3-4581-4bb4-b6b6-9a4c90b4990c" containerID="3d433a58d6112792917e8d46180d50bb80165cefb7973b33120f7a200413f57f" exitCode=0
May 28 09:54:58.809736 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:58.809421    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6" event={"ID":"30761ab3-4581-4bb4-b6b6-9a4c90b4990c","Type":"ContainerDied","Data":"3d433a58d6112792917e8d46180d50bb80165cefb7973b33120f7a200413f57f"}
May 28 09:54:59.815235 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:59.815192    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6" event={"ID":"30761ab3-4581-4bb4-b6b6-9a4c90b4990c","Type":"ContainerStarted","Data":"7dfc56466c242eb53e2a9178d78f4eb36e27d8b3d703f4bb82c949178551ddb1"}
May 28 09:54:59.815668 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:59.815261    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6" event={"ID":"30761ab3-4581-4bb4-b6b6-9a4c90b4990c","Type":"ContainerStarted","Data":"a5067eb59febe1ee159847495880ba0c6fe1ad7cd623dd0bb0016793bfecf9aa"}
May 28 09:54:59.815668 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:59.815276    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6" event={"ID":"30761ab3-4581-4bb4-b6b6-9a4c90b4990c","Type":"ContainerStarted","Data":"2c9ec300f0ceb7b843b46bbbb9fd738e4eb284e3f88e77b328ef6c5203a2f036"}
May 28 09:54:59.842770 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:54:59.842715    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6" podStartSLOduration=12.842693773 podStartE2EDuration="12.842693773s" podCreationTimestamp="2026-05-28 09:54:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 09:54:59.839675477 +0000 UTC m=+1412.299421135" watchObservedRunningTime="2026-05-28 09:54:59.842693773 +0000 UTC m=+1412.302439420"
May 28 09:55:00.005384 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:55:00.005347    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6"
May 28 09:55:00.005384 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:55:00.005392    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6"
May 28 09:55:00.005622 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:55:00.005405    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6"
May 28 09:55:00.006920 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:55:00.006885    2578 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6" podUID="30761ab3-4581-4bb4-b6b6-9a4c90b4990c" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.22:8816: connect: connection refused"
May 28 09:55:00.007046 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:55:00.006951    2578 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6" podUID="30761ab3-4581-4bb4-b6b6-9a4c90b4990c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused"
May 28 09:55:00.007046 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:55:00.006887    2578 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6" podUID="30761ab3-4581-4bb4-b6b6-9a4c90b4990c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.22:8443: connect: connection refused"
May 28 09:55:03.004940 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:55:03.004890    2578 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6" podUID="30761ab3-4581-4bb4-b6b6-9a4c90b4990c" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.22:8816: connect: connection refused"
May 28 09:55:03.005368 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:55:03.004887    2578 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6" podUID="30761ab3-4581-4bb4-b6b6-9a4c90b4990c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.22:8443: connect: connection refused"
May 28 09:55:03.005368 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:55:03.004985    2578 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6" podUID="30761ab3-4581-4bb4-b6b6-9a4c90b4990c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused"
May 28 09:55:06.006519 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:55:06.006484    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6"
May 28 09:55:06.006861 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:55:06.006643    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6"
May 28 09:55:06.007124 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:55:06.007100    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6"
May 28 09:55:06.007304 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:55:06.007285    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6"
May 28 09:55:06.007382 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:55:06.007348    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6"
May 28 09:55:06.007425 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:55:06.007386    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6"
May 28 09:55:06.010661 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:55:06.010635    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6"
May 28 09:55:06.836005 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:55:06.835969    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6"
May 28 09:55:06.838859 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:55:06.838846    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6"
May 28 09:56:08.252625 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:08.252589    2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6"]
May 28 09:56:08.253147 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:08.252906    2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6" podUID="30761ab3-4581-4bb4-b6b6-9a4c90b4990c" containerName="online" containerID="cri-o://2c9ec300f0ceb7b843b46bbbb9fd738e4eb284e3f88e77b328ef6c5203a2f036" gracePeriod=30
May 28 09:56:08.253147 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:08.252973    2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6" podUID="30761ab3-4581-4bb4-b6b6-9a4c90b4990c" containerName="offline" containerID="cri-o://a5067eb59febe1ee159847495880ba0c6fe1ad7cd623dd0bb0016793bfecf9aa" gracePeriod=30
May 28 09:56:08.253147 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:08.253097    2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6" podUID="30761ab3-4581-4bb4-b6b6-9a4c90b4990c" containerName="ui" containerID="cri-o://7dfc56466c242eb53e2a9178d78f4eb36e27d8b3d703f4bb82c949178551ddb1" gracePeriod=30
May 28 09:56:08.399364 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:08.399329    2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl"]
May 28 09:56:08.399880 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:08.399848    2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl" podUID="eddbb5cd-d7fc-4f47-8272-278d71ed91b9" containerName="registry" containerID="cri-o://6998bc056d007d68a16ec5cc5297d42d781d6c015512b80d186a7affc03c0ef7" gracePeriod=30
May 28 09:56:08.400000 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:08.399904    2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl" podUID="eddbb5cd-d7fc-4f47-8272-278d71ed91b9" containerName="offline" containerID="cri-o://646da3324880704515171d01b2fea20659a6d0f6f0f7860db6f1968e3a9fbd99" gracePeriod=30
May 28 09:56:08.400000 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:08.399903    2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl" podUID="eddbb5cd-d7fc-4f47-8272-278d71ed91b9" containerName="ui" containerID="cri-o://006587e1495f44edc93d9e8750a8b44dffe2810dd5d61aa9c5753a39005fcb6e" gracePeriod=30
May 28 09:56:08.400248 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:08.400182    2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl" podUID="eddbb5cd-d7fc-4f47-8272-278d71ed91b9" containerName="online" containerID="cri-o://ee0e8ea550c4559c1d84605bcd1a601a6a7f9d390a9194362c1733cbad2c7b3b" gracePeriod=30
May 28 09:56:09.006978 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:09.006948    2578 generic.go:358] "Generic (PLEG): container finished" podID="eddbb5cd-d7fc-4f47-8272-278d71ed91b9" containerID="006587e1495f44edc93d9e8750a8b44dffe2810dd5d61aa9c5753a39005fcb6e" exitCode=0
May 28 09:56:09.007136 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:09.007013    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl" event={"ID":"eddbb5cd-d7fc-4f47-8272-278d71ed91b9","Type":"ContainerDied","Data":"006587e1495f44edc93d9e8750a8b44dffe2810dd5d61aa9c5753a39005fcb6e"}
May 28 09:56:09.009362 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:09.009342    2578 generic.go:358] "Generic (PLEG): container finished" podID="30761ab3-4581-4bb4-b6b6-9a4c90b4990c" containerID="7dfc56466c242eb53e2a9178d78f4eb36e27d8b3d703f4bb82c949178551ddb1" exitCode=0
May 28 09:56:09.009362 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:09.009360    2578 generic.go:358] "Generic (PLEG): container finished" podID="30761ab3-4581-4bb4-b6b6-9a4c90b4990c" containerID="2c9ec300f0ceb7b843b46bbbb9fd738e4eb284e3f88e77b328ef6c5203a2f036" exitCode=0
May 28 09:56:09.009503 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:09.009382    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6" event={"ID":"30761ab3-4581-4bb4-b6b6-9a4c90b4990c","Type":"ContainerDied","Data":"7dfc56466c242eb53e2a9178d78f4eb36e27d8b3d703f4bb82c949178551ddb1"}
May 28 09:56:09.009503 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:09.009400    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6" event={"ID":"30761ab3-4581-4bb4-b6b6-9a4c90b4990c","Type":"ContainerDied","Data":"2c9ec300f0ceb7b843b46bbbb9fd738e4eb284e3f88e77b328ef6c5203a2f036"}
May 28 09:56:10.014814 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:10.014783    2578 generic.go:358] "Generic (PLEG): container finished" podID="eddbb5cd-d7fc-4f47-8272-278d71ed91b9" containerID="ee0e8ea550c4559c1d84605bcd1a601a6a7f9d390a9194362c1733cbad2c7b3b" exitCode=0
May 28 09:56:10.015178 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:10.014860    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl" event={"ID":"eddbb5cd-d7fc-4f47-8272-278d71ed91b9","Type":"ContainerDied","Data":"ee0e8ea550c4559c1d84605bcd1a601a6a7f9d390a9194362c1733cbad2c7b3b"}
May 28 09:56:14.351437 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:14.351382    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl" podUID="eddbb5cd-d7fc-4f47-8272-278d71ed91b9" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.21:8443: connect: connection refused"
May 28 09:56:14.599104 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:14.599057    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl" podUID="eddbb5cd-d7fc-4f47-8272-278d71ed91b9" containerName="online" probeResult="failure" output="Get \"https://10.132.0.21:6567/health\": dial tcp 10.132.0.21:6567: connect: connection refused"
May 28 09:56:16.007839 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:16.007794    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6" podUID="30761ab3-4581-4bb4-b6b6-9a4c90b4990c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.22:8443: connect: connection refused"
May 28 09:56:16.836648 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:16.836604    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6" podUID="30761ab3-4581-4bb4-b6b6-9a4c90b4990c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused"
May 28 09:56:24.350986 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:24.350940    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl" podUID="eddbb5cd-d7fc-4f47-8272-278d71ed91b9" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.21:8443: connect: connection refused"
May 28 09:56:24.598939 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:24.598900    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl" podUID="eddbb5cd-d7fc-4f47-8272-278d71ed91b9" containerName="online" probeResult="failure" output="Get \"https://10.132.0.21:6567/health\": dial tcp 10.132.0.21:6567: connect: connection refused"
May 28 09:56:26.007792 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:26.007734    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6" podUID="30761ab3-4581-4bb4-b6b6-9a4c90b4990c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.22:8443: connect: connection refused"
May 28 09:56:26.836662 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:26.836622    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6" podUID="30761ab3-4581-4bb4-b6b6-9a4c90b4990c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused"
May 28 09:56:28.131495 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:28.131467    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wqcwd_397304a8-87ab-49c0-9fc0-a3ca99f04032/ovn-acl-logging/0.log"
May 28 09:56:28.136639 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:28.136622    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wqcwd_397304a8-87ab-49c0-9fc0-a3ca99f04032/ovn-acl-logging/0.log"
May 28 09:56:34.351068 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:34.351018    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl" podUID="eddbb5cd-d7fc-4f47-8272-278d71ed91b9" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.21:8443: connect: connection refused"
May 28 09:56:34.351498 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:34.351186    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl"
May 28 09:56:34.598683 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:34.598641    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl" podUID="eddbb5cd-d7fc-4f47-8272-278d71ed91b9" containerName="online" probeResult="failure" output="Get \"https://10.132.0.21:6567/health\": dial tcp 10.132.0.21:6567: connect: connection refused"
May 28 09:56:34.598847 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:34.598761    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl"
May 28 09:56:36.007881 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:36.007837    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6" podUID="30761ab3-4581-4bb4-b6b6-9a4c90b4990c" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.22:8443: connect: connection refused"
May 28 09:56:36.008327 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:36.007985    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6"
May 28 09:56:36.836189 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:36.836148    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6" podUID="30761ab3-4581-4bb4-b6b6-9a4c90b4990c" containerName="online" probeResult="failure" output="Get \"https://10.132.0.22:6567/health\": dial tcp 10.132.0.22:6567: connect: connection refused"
May 28 09:56:36.836365 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:36.836273    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6"
May 28 09:56:38.891435 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:38.891413    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6"
May 28 09:56:39.017602 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.017573    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6jjsp\" (UniqueName: \"kubernetes.io/projected/30761ab3-4581-4bb4-b6b6-9a4c90b4990c-kube-api-access-6jjsp\") pod \"30761ab3-4581-4bb4-b6b6-9a4c90b4990c\" (UID: \"30761ab3-4581-4bb4-b6b6-9a4c90b4990c\") "
May 28 09:56:39.017753 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.017654    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/30761ab3-4581-4bb4-b6b6-9a4c90b4990c-feast-data\") pod \"30761ab3-4581-4bb4-b6b6-9a4c90b4990c\" (UID: \"30761ab3-4581-4bb4-b6b6-9a4c90b4990c\") "
May 28 09:56:39.017753 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.017730    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/30761ab3-4581-4bb4-b6b6-9a4c90b4990c-registry-tls\") pod \"30761ab3-4581-4bb4-b6b6-9a4c90b4990c\" (UID: \"30761ab3-4581-4bb4-b6b6-9a4c90b4990c\") "
May 28 09:56:39.017884 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.017777    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/30761ab3-4581-4bb4-b6b6-9a4c90b4990c-offline-tls\") pod \"30761ab3-4581-4bb4-b6b6-9a4c90b4990c\" (UID: \"30761ab3-4581-4bb4-b6b6-9a4c90b4990c\") "
May 28 09:56:39.017884 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.017803    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/30761ab3-4581-4bb4-b6b6-9a4c90b4990c-ui-tls\") pod \"30761ab3-4581-4bb4-b6b6-9a4c90b4990c\" (UID: \"30761ab3-4581-4bb4-b6b6-9a4c90b4990c\") "
May 28 09:56:39.017884 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.017818    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/30761ab3-4581-4bb4-b6b6-9a4c90b4990c-online-tls\") pod \"30761ab3-4581-4bb4-b6b6-9a4c90b4990c\" (UID: \"30761ab3-4581-4bb4-b6b6-9a4c90b4990c\") "
May 28 09:56:39.018137 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.018112    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30761ab3-4581-4bb4-b6b6-9a4c90b4990c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "30761ab3-4581-4bb4-b6b6-9a4c90b4990c" (UID: "30761ab3-4581-4bb4-b6b6-9a4c90b4990c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 09:56:39.018285 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.018195    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30761ab3-4581-4bb4-b6b6-9a4c90b4990c-feast-data" (OuterVolumeSpecName: "feast-data") pod "30761ab3-4581-4bb4-b6b6-9a4c90b4990c" (UID: "30761ab3-4581-4bb4-b6b6-9a4c90b4990c"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 09:56:39.020287 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.020257    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30761ab3-4581-4bb4-b6b6-9a4c90b4990c-kube-api-access-6jjsp" (OuterVolumeSpecName: "kube-api-access-6jjsp") pod "30761ab3-4581-4bb4-b6b6-9a4c90b4990c" (UID: "30761ab3-4581-4bb4-b6b6-9a4c90b4990c"). InnerVolumeSpecName "kube-api-access-6jjsp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 09:56:39.020388 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.020327    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30761ab3-4581-4bb4-b6b6-9a4c90b4990c-online-tls" (OuterVolumeSpecName: "online-tls") pod "30761ab3-4581-4bb4-b6b6-9a4c90b4990c" (UID: "30761ab3-4581-4bb4-b6b6-9a4c90b4990c"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:56:39.020388 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.020367    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30761ab3-4581-4bb4-b6b6-9a4c90b4990c-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "30761ab3-4581-4bb4-b6b6-9a4c90b4990c" (UID: "30761ab3-4581-4bb4-b6b6-9a4c90b4990c"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:56:39.020388 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.020378    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/30761ab3-4581-4bb4-b6b6-9a4c90b4990c-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "30761ab3-4581-4bb4-b6b6-9a4c90b4990c" (UID: "30761ab3-4581-4bb4-b6b6-9a4c90b4990c"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:56:39.041579 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.041556    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl"
May 28 09:56:39.092932 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.092900    2578 generic.go:358] "Generic (PLEG): container finished" podID="30761ab3-4581-4bb4-b6b6-9a4c90b4990c" containerID="a5067eb59febe1ee159847495880ba0c6fe1ad7cd623dd0bb0016793bfecf9aa" exitCode=137
May 28 09:56:39.093158 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.092984    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6"
May 28 09:56:39.093158 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.092987    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6" event={"ID":"30761ab3-4581-4bb4-b6b6-9a4c90b4990c","Type":"ContainerDied","Data":"a5067eb59febe1ee159847495880ba0c6fe1ad7cd623dd0bb0016793bfecf9aa"}
May 28 09:56:39.093158 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.093028    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6" event={"ID":"30761ab3-4581-4bb4-b6b6-9a4c90b4990c","Type":"ContainerDied","Data":"f2cf47e6be242697364c1f919583185a6bc08b7ea5b6119c29152df0d26a8469"}
May 28 09:56:39.093158 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.093050    2578 scope.go:117] "RemoveContainer" containerID="7dfc56466c242eb53e2a9178d78f4eb36e27d8b3d703f4bb82c949178551ddb1"
May 28 09:56:39.095673 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.095650    2578 generic.go:358] "Generic (PLEG): container finished" podID="eddbb5cd-d7fc-4f47-8272-278d71ed91b9" containerID="646da3324880704515171d01b2fea20659a6d0f6f0f7860db6f1968e3a9fbd99" exitCode=137
May 28 09:56:39.095673 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.095671    2578 generic.go:358] "Generic (PLEG): container finished" podID="eddbb5cd-d7fc-4f47-8272-278d71ed91b9" containerID="6998bc056d007d68a16ec5cc5297d42d781d6c015512b80d186a7affc03c0ef7" exitCode=137
May 28 09:56:39.095850 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.095698    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl" event={"ID":"eddbb5cd-d7fc-4f47-8272-278d71ed91b9","Type":"ContainerDied","Data":"646da3324880704515171d01b2fea20659a6d0f6f0f7860db6f1968e3a9fbd99"}
May 28 09:56:39.095850 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.095722    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl"
May 28 09:56:39.095850 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.095732    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl" event={"ID":"eddbb5cd-d7fc-4f47-8272-278d71ed91b9","Type":"ContainerDied","Data":"6998bc056d007d68a16ec5cc5297d42d781d6c015512b80d186a7affc03c0ef7"}
May 28 09:56:39.095850 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.095767    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl" event={"ID":"eddbb5cd-d7fc-4f47-8272-278d71ed91b9","Type":"ContainerDied","Data":"3cfd13ed56bc3c5657ab92d71795b352de18bb5c39374bd5ed47ca3f984c4400"}
May 28 09:56:39.105992 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.105970    2578 scope.go:117] "RemoveContainer" containerID="a5067eb59febe1ee159847495880ba0c6fe1ad7cd623dd0bb0016793bfecf9aa"
May 28 09:56:39.112844 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.112828    2578 scope.go:117] "RemoveContainer" containerID="2c9ec300f0ceb7b843b46bbbb9fd738e4eb284e3f88e77b328ef6c5203a2f036"
May 28 09:56:39.118380 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.118299    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/eddbb5cd-d7fc-4f47-8272-278d71ed91b9-offline-tls\") pod \"eddbb5cd-d7fc-4f47-8272-278d71ed91b9\" (UID: \"eddbb5cd-d7fc-4f47-8272-278d71ed91b9\") "
May 28 09:56:39.118380 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.118331    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/eddbb5cd-d7fc-4f47-8272-278d71ed91b9-ui-tls\") pod \"eddbb5cd-d7fc-4f47-8272-278d71ed91b9\" (UID: \"eddbb5cd-d7fc-4f47-8272-278d71ed91b9\") "
May 28 09:56:39.118380 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.118356    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/eddbb5cd-d7fc-4f47-8272-278d71ed91b9-registry-tls\") pod \"eddbb5cd-d7fc-4f47-8272-278d71ed91b9\" (UID: \"eddbb5cd-d7fc-4f47-8272-278d71ed91b9\") "
May 28 09:56:39.118580 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.118386    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/eddbb5cd-d7fc-4f47-8272-278d71ed91b9-feast-data\") pod \"eddbb5cd-d7fc-4f47-8272-278d71ed91b9\" (UID: \"eddbb5cd-d7fc-4f47-8272-278d71ed91b9\") "
May 28 09:56:39.118580 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.118415    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-djqsb\" (UniqueName: \"kubernetes.io/projected/eddbb5cd-d7fc-4f47-8272-278d71ed91b9-kube-api-access-djqsb\") pod \"eddbb5cd-d7fc-4f47-8272-278d71ed91b9\" (UID: \"eddbb5cd-d7fc-4f47-8272-278d71ed91b9\") "
May 28 09:56:39.119128 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.118987    2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6"]
May 28 09:56:39.119216 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.119119    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eddbb5cd-d7fc-4f47-8272-278d71ed91b9-feast-data" (OuterVolumeSpecName: "feast-data") pod "eddbb5cd-d7fc-4f47-8272-278d71ed91b9" (UID: "eddbb5cd-d7fc-4f47-8272-278d71ed91b9"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 09:56:39.119668 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.119353    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/eddbb5cd-d7fc-4f47-8272-278d71ed91b9-online-tls\") pod \"eddbb5cd-d7fc-4f47-8272-278d71ed91b9\" (UID: \"eddbb5cd-d7fc-4f47-8272-278d71ed91b9\") "
May 28 09:56:39.119668 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.119568    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6jjsp\" (UniqueName: \"kubernetes.io/projected/30761ab3-4581-4bb4-b6b6-9a4c90b4990c-kube-api-access-6jjsp\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 09:56:39.119668 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.119587    2578 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/eddbb5cd-d7fc-4f47-8272-278d71ed91b9-feast-data\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 09:56:39.119668 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.119601    2578 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/30761ab3-4581-4bb4-b6b6-9a4c90b4990c-feast-data\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 09:56:39.119668 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.119614    2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/30761ab3-4581-4bb4-b6b6-9a4c90b4990c-registry-tls\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 09:56:39.119668 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.119626    2578 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/30761ab3-4581-4bb4-b6b6-9a4c90b4990c-offline-tls\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 09:56:39.119668 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.119638    2578 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/30761ab3-4581-4bb4-b6b6-9a4c90b4990c-ui-tls\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 09:56:39.119668 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.119650    2578 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/30761ab3-4581-4bb4-b6b6-9a4c90b4990c-online-tls\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 09:56:39.120594 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.120570    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eddbb5cd-d7fc-4f47-8272-278d71ed91b9-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "eddbb5cd-d7fc-4f47-8272-278d71ed91b9" (UID: "eddbb5cd-d7fc-4f47-8272-278d71ed91b9"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:56:39.120838 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.120777    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eddbb5cd-d7fc-4f47-8272-278d71ed91b9-kube-api-access-djqsb" (OuterVolumeSpecName: "kube-api-access-djqsb") pod "eddbb5cd-d7fc-4f47-8272-278d71ed91b9" (UID: "eddbb5cd-d7fc-4f47-8272-278d71ed91b9"). InnerVolumeSpecName "kube-api-access-djqsb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 09:56:39.120838 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.120793    2578 scope.go:117] "RemoveContainer" containerID="3d433a58d6112792917e8d46180d50bb80165cefb7973b33120f7a200413f57f"
May 28 09:56:39.121413 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.121291    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eddbb5cd-d7fc-4f47-8272-278d71ed91b9-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "eddbb5cd-d7fc-4f47-8272-278d71ed91b9" (UID: "eddbb5cd-d7fc-4f47-8272-278d71ed91b9"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:56:39.121741 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.121715    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eddbb5cd-d7fc-4f47-8272-278d71ed91b9-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "eddbb5cd-d7fc-4f47-8272-278d71ed91b9" (UID: "eddbb5cd-d7fc-4f47-8272-278d71ed91b9"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:56:39.122174 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.122152    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eddbb5cd-d7fc-4f47-8272-278d71ed91b9-online-tls" (OuterVolumeSpecName: "online-tls") pod "eddbb5cd-d7fc-4f47-8272-278d71ed91b9" (UID: "eddbb5cd-d7fc-4f47-8272-278d71ed91b9"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:56:39.122495 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.122481    2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-lx2d6"]
May 28 09:56:39.127257 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.127240    2578 scope.go:117] "RemoveContainer" containerID="8c419fe757328d33e2a1cbe38cb8f128d294d8ebc728d4c07e8c03fea40ae67b"
May 28 09:56:39.133381 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.133364    2578 scope.go:117] "RemoveContainer" containerID="7dfc56466c242eb53e2a9178d78f4eb36e27d8b3d703f4bb82c949178551ddb1"
May 28 09:56:39.133598 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:56:39.133582    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7dfc56466c242eb53e2a9178d78f4eb36e27d8b3d703f4bb82c949178551ddb1\": container with ID starting with 7dfc56466c242eb53e2a9178d78f4eb36e27d8b3d703f4bb82c949178551ddb1 not found: ID does not exist" containerID="7dfc56466c242eb53e2a9178d78f4eb36e27d8b3d703f4bb82c949178551ddb1"
May 28 09:56:39.133648 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.133607    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7dfc56466c242eb53e2a9178d78f4eb36e27d8b3d703f4bb82c949178551ddb1"} err="failed to get container status \"7dfc56466c242eb53e2a9178d78f4eb36e27d8b3d703f4bb82c949178551ddb1\": rpc error: code = NotFound desc = could not find container \"7dfc56466c242eb53e2a9178d78f4eb36e27d8b3d703f4bb82c949178551ddb1\": container with ID starting with 7dfc56466c242eb53e2a9178d78f4eb36e27d8b3d703f4bb82c949178551ddb1 not found: ID does not exist"
May 28 09:56:39.133648 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.133624    2578 scope.go:117] "RemoveContainer" containerID="a5067eb59febe1ee159847495880ba0c6fe1ad7cd623dd0bb0016793bfecf9aa"
May 28 09:56:39.133853 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:56:39.133834    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5067eb59febe1ee159847495880ba0c6fe1ad7cd623dd0bb0016793bfecf9aa\": container with ID starting with a5067eb59febe1ee159847495880ba0c6fe1ad7cd623dd0bb0016793bfecf9aa not found: ID does not exist" containerID="a5067eb59febe1ee159847495880ba0c6fe1ad7cd623dd0bb0016793bfecf9aa"
May 28 09:56:39.133915 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.133862    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5067eb59febe1ee159847495880ba0c6fe1ad7cd623dd0bb0016793bfecf9aa"} err="failed to get container status \"a5067eb59febe1ee159847495880ba0c6fe1ad7cd623dd0bb0016793bfecf9aa\": rpc error: code = NotFound desc = could not find container \"a5067eb59febe1ee159847495880ba0c6fe1ad7cd623dd0bb0016793bfecf9aa\": container with ID starting with a5067eb59febe1ee159847495880ba0c6fe1ad7cd623dd0bb0016793bfecf9aa not found: ID does not exist"
May 28 09:56:39.133915 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.133884    2578 scope.go:117] "RemoveContainer" containerID="2c9ec300f0ceb7b843b46bbbb9fd738e4eb284e3f88e77b328ef6c5203a2f036"
May 28 09:56:39.134116 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:56:39.134101    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c9ec300f0ceb7b843b46bbbb9fd738e4eb284e3f88e77b328ef6c5203a2f036\": container with ID starting with 2c9ec300f0ceb7b843b46bbbb9fd738e4eb284e3f88e77b328ef6c5203a2f036 not found: ID does not exist" containerID="2c9ec300f0ceb7b843b46bbbb9fd738e4eb284e3f88e77b328ef6c5203a2f036"
May 28 09:56:39.134161 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.134120    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c9ec300f0ceb7b843b46bbbb9fd738e4eb284e3f88e77b328ef6c5203a2f036"} err="failed to get container status \"2c9ec300f0ceb7b843b46bbbb9fd738e4eb284e3f88e77b328ef6c5203a2f036\": rpc error: code = NotFound desc = could not find container \"2c9ec300f0ceb7b843b46bbbb9fd738e4eb284e3f88e77b328ef6c5203a2f036\": container with ID starting with 2c9ec300f0ceb7b843b46bbbb9fd738e4eb284e3f88e77b328ef6c5203a2f036 not found: ID does not exist"
May 28 09:56:39.134161 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.134134    2578 scope.go:117] "RemoveContainer" containerID="3d433a58d6112792917e8d46180d50bb80165cefb7973b33120f7a200413f57f"
May 28 09:56:39.134354 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:56:39.134339    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d433a58d6112792917e8d46180d50bb80165cefb7973b33120f7a200413f57f\": container with ID starting with 3d433a58d6112792917e8d46180d50bb80165cefb7973b33120f7a200413f57f not found: ID does not exist" containerID="3d433a58d6112792917e8d46180d50bb80165cefb7973b33120f7a200413f57f"
May 28 09:56:39.134429 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.134356    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d433a58d6112792917e8d46180d50bb80165cefb7973b33120f7a200413f57f"} err="failed to get container status \"3d433a58d6112792917e8d46180d50bb80165cefb7973b33120f7a200413f57f\": rpc error: code = NotFound desc = could not find container \"3d433a58d6112792917e8d46180d50bb80165cefb7973b33120f7a200413f57f\": container with ID starting with 3d433a58d6112792917e8d46180d50bb80165cefb7973b33120f7a200413f57f not found: ID does not exist"
May 28 09:56:39.134429 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.134369    2578 scope.go:117] "RemoveContainer" containerID="8c419fe757328d33e2a1cbe38cb8f128d294d8ebc728d4c07e8c03fea40ae67b"
May 28 09:56:39.134589 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:56:39.134576    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c419fe757328d33e2a1cbe38cb8f128d294d8ebc728d4c07e8c03fea40ae67b\": container with ID starting with 8c419fe757328d33e2a1cbe38cb8f128d294d8ebc728d4c07e8c03fea40ae67b not found: ID does not exist" containerID="8c419fe757328d33e2a1cbe38cb8f128d294d8ebc728d4c07e8c03fea40ae67b"
May 28 09:56:39.134627 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.134592    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c419fe757328d33e2a1cbe38cb8f128d294d8ebc728d4c07e8c03fea40ae67b"} err="failed to get container status \"8c419fe757328d33e2a1cbe38cb8f128d294d8ebc728d4c07e8c03fea40ae67b\": rpc error: code = NotFound desc = could not find container \"8c419fe757328d33e2a1cbe38cb8f128d294d8ebc728d4c07e8c03fea40ae67b\": container with ID starting with 8c419fe757328d33e2a1cbe38cb8f128d294d8ebc728d4c07e8c03fea40ae67b not found: ID does not exist"
May 28 09:56:39.134627 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.134604    2578 scope.go:117] "RemoveContainer" containerID="006587e1495f44edc93d9e8750a8b44dffe2810dd5d61aa9c5753a39005fcb6e"
May 28 09:56:39.141064 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.141048    2578 scope.go:117] "RemoveContainer" containerID="646da3324880704515171d01b2fea20659a6d0f6f0f7860db6f1968e3a9fbd99"
May 28 09:56:39.146932 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.146912    2578 scope.go:117] "RemoveContainer" containerID="ee0e8ea550c4559c1d84605bcd1a601a6a7f9d390a9194362c1733cbad2c7b3b"
May 28 09:56:39.153141 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.153125    2578 scope.go:117] "RemoveContainer" containerID="6998bc056d007d68a16ec5cc5297d42d781d6c015512b80d186a7affc03c0ef7"
May 28 09:56:39.159029 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.159014    2578 scope.go:117] "RemoveContainer" containerID="b7b463603bfb2167fedbc88c91d683431ecb1f7fc46f5f618f4e2c5f4450b74e"
May 28 09:56:39.164839 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.164820    2578 scope.go:117] "RemoveContainer" containerID="14037bb4e6bcf1c49d314831d6877ed0ecedba65b9f8cc5e77888059e3bf84fa"
May 28 09:56:39.170470 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.170451    2578 scope.go:117] "RemoveContainer" containerID="006587e1495f44edc93d9e8750a8b44dffe2810dd5d61aa9c5753a39005fcb6e"
May 28 09:56:39.170672 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:56:39.170654    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"006587e1495f44edc93d9e8750a8b44dffe2810dd5d61aa9c5753a39005fcb6e\": container with ID starting with 006587e1495f44edc93d9e8750a8b44dffe2810dd5d61aa9c5753a39005fcb6e not found: ID does not exist" containerID="006587e1495f44edc93d9e8750a8b44dffe2810dd5d61aa9c5753a39005fcb6e"
May 28 09:56:39.170785 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.170680    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"006587e1495f44edc93d9e8750a8b44dffe2810dd5d61aa9c5753a39005fcb6e"} err="failed to get container status \"006587e1495f44edc93d9e8750a8b44dffe2810dd5d61aa9c5753a39005fcb6e\": rpc error: code = NotFound desc = could not find container \"006587e1495f44edc93d9e8750a8b44dffe2810dd5d61aa9c5753a39005fcb6e\": container with ID starting with 006587e1495f44edc93d9e8750a8b44dffe2810dd5d61aa9c5753a39005fcb6e not found: ID does not exist"
May 28 09:56:39.170785 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.170701    2578 scope.go:117] "RemoveContainer" containerID="646da3324880704515171d01b2fea20659a6d0f6f0f7860db6f1968e3a9fbd99"
May 28 09:56:39.170939 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:56:39.170924    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"646da3324880704515171d01b2fea20659a6d0f6f0f7860db6f1968e3a9fbd99\": container with ID starting with 646da3324880704515171d01b2fea20659a6d0f6f0f7860db6f1968e3a9fbd99 not found: ID does not exist" containerID="646da3324880704515171d01b2fea20659a6d0f6f0f7860db6f1968e3a9fbd99"
May 28 09:56:39.170983 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.170943    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"646da3324880704515171d01b2fea20659a6d0f6f0f7860db6f1968e3a9fbd99"} err="failed to get container status \"646da3324880704515171d01b2fea20659a6d0f6f0f7860db6f1968e3a9fbd99\": rpc error: code = NotFound desc = could not find container \"646da3324880704515171d01b2fea20659a6d0f6f0f7860db6f1968e3a9fbd99\": container with ID starting with 646da3324880704515171d01b2fea20659a6d0f6f0f7860db6f1968e3a9fbd99 not found: ID does not exist"
May 28 09:56:39.170983 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.170957    2578 scope.go:117] "RemoveContainer" containerID="ee0e8ea550c4559c1d84605bcd1a601a6a7f9d390a9194362c1733cbad2c7b3b"
May 28 09:56:39.171164 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:56:39.171147    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee0e8ea550c4559c1d84605bcd1a601a6a7f9d390a9194362c1733cbad2c7b3b\": container with ID starting with ee0e8ea550c4559c1d84605bcd1a601a6a7f9d390a9194362c1733cbad2c7b3b not found: ID does not exist" containerID="ee0e8ea550c4559c1d84605bcd1a601a6a7f9d390a9194362c1733cbad2c7b3b"
May 28 09:56:39.171206 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.171168    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee0e8ea550c4559c1d84605bcd1a601a6a7f9d390a9194362c1733cbad2c7b3b"} err="failed to get container status \"ee0e8ea550c4559c1d84605bcd1a601a6a7f9d390a9194362c1733cbad2c7b3b\": rpc error: code = NotFound desc = could not find container \"ee0e8ea550c4559c1d84605bcd1a601a6a7f9d390a9194362c1733cbad2c7b3b\": container with ID starting with ee0e8ea550c4559c1d84605bcd1a601a6a7f9d390a9194362c1733cbad2c7b3b not found: ID does not exist"
May 28 09:56:39.171206 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.171182    2578 scope.go:117] "RemoveContainer" containerID="6998bc056d007d68a16ec5cc5297d42d781d6c015512b80d186a7affc03c0ef7"
May 28 09:56:39.171413 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:56:39.171394    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6998bc056d007d68a16ec5cc5297d42d781d6c015512b80d186a7affc03c0ef7\": container with ID starting with 6998bc056d007d68a16ec5cc5297d42d781d6c015512b80d186a7affc03c0ef7 not found: ID does not exist" containerID="6998bc056d007d68a16ec5cc5297d42d781d6c015512b80d186a7affc03c0ef7"
May 28 09:56:39.171452 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.171416    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6998bc056d007d68a16ec5cc5297d42d781d6c015512b80d186a7affc03c0ef7"} err="failed to get container status \"6998bc056d007d68a16ec5cc5297d42d781d6c015512b80d186a7affc03c0ef7\": rpc error: code = NotFound desc = could not find container \"6998bc056d007d68a16ec5cc5297d42d781d6c015512b80d186a7affc03c0ef7\": container with ID starting with 6998bc056d007d68a16ec5cc5297d42d781d6c015512b80d186a7affc03c0ef7 not found: ID does not exist"
May 28 09:56:39.171452 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.171429    2578 scope.go:117] "RemoveContainer" containerID="b7b463603bfb2167fedbc88c91d683431ecb1f7fc46f5f618f4e2c5f4450b74e"
May 28 09:56:39.171640 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:56:39.171623    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7b463603bfb2167fedbc88c91d683431ecb1f7fc46f5f618f4e2c5f4450b74e\": container with ID starting with b7b463603bfb2167fedbc88c91d683431ecb1f7fc46f5f618f4e2c5f4450b74e not found: ID does not exist" containerID="b7b463603bfb2167fedbc88c91d683431ecb1f7fc46f5f618f4e2c5f4450b74e"
May 28 09:56:39.171679 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.171644    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7b463603bfb2167fedbc88c91d683431ecb1f7fc46f5f618f4e2c5f4450b74e"} err="failed to get container status \"b7b463603bfb2167fedbc88c91d683431ecb1f7fc46f5f618f4e2c5f4450b74e\": rpc error: code = NotFound desc = could not find container \"b7b463603bfb2167fedbc88c91d683431ecb1f7fc46f5f618f4e2c5f4450b74e\": container with ID starting with b7b463603bfb2167fedbc88c91d683431ecb1f7fc46f5f618f4e2c5f4450b74e not found: ID does not exist"
May 28 09:56:39.171679 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.171657    2578 scope.go:117] "RemoveContainer" containerID="14037bb4e6bcf1c49d314831d6877ed0ecedba65b9f8cc5e77888059e3bf84fa"
May 28 09:56:39.171927 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:56:39.171909    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14037bb4e6bcf1c49d314831d6877ed0ecedba65b9f8cc5e77888059e3bf84fa\": container with ID starting with 14037bb4e6bcf1c49d314831d6877ed0ecedba65b9f8cc5e77888059e3bf84fa not found: ID does not exist" containerID="14037bb4e6bcf1c49d314831d6877ed0ecedba65b9f8cc5e77888059e3bf84fa"
May 28 09:56:39.171984 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.171931    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14037bb4e6bcf1c49d314831d6877ed0ecedba65b9f8cc5e77888059e3bf84fa"} err="failed to get container status \"14037bb4e6bcf1c49d314831d6877ed0ecedba65b9f8cc5e77888059e3bf84fa\": rpc error: code = NotFound desc = could not find container \"14037bb4e6bcf1c49d314831d6877ed0ecedba65b9f8cc5e77888059e3bf84fa\": container with ID starting with 14037bb4e6bcf1c49d314831d6877ed0ecedba65b9f8cc5e77888059e3bf84fa not found: ID does not exist"
May 28 09:56:39.171984 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.171945    2578 scope.go:117] "RemoveContainer" containerID="006587e1495f44edc93d9e8750a8b44dffe2810dd5d61aa9c5753a39005fcb6e"
May 28 09:56:39.172158 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.172141    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"006587e1495f44edc93d9e8750a8b44dffe2810dd5d61aa9c5753a39005fcb6e"} err="failed to get container status \"006587e1495f44edc93d9e8750a8b44dffe2810dd5d61aa9c5753a39005fcb6e\": rpc error: code = NotFound desc = could not find container \"006587e1495f44edc93d9e8750a8b44dffe2810dd5d61aa9c5753a39005fcb6e\": container with ID starting with 006587e1495f44edc93d9e8750a8b44dffe2810dd5d61aa9c5753a39005fcb6e not found: ID does not exist"
May 28 09:56:39.172197 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.172160    2578 scope.go:117] "RemoveContainer" containerID="646da3324880704515171d01b2fea20659a6d0f6f0f7860db6f1968e3a9fbd99"
May 28 09:56:39.172366 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.172346    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"646da3324880704515171d01b2fea20659a6d0f6f0f7860db6f1968e3a9fbd99"} err="failed to get container status \"646da3324880704515171d01b2fea20659a6d0f6f0f7860db6f1968e3a9fbd99\": rpc error: code = NotFound desc = could not find container \"646da3324880704515171d01b2fea20659a6d0f6f0f7860db6f1968e3a9fbd99\": container with ID starting with 646da3324880704515171d01b2fea20659a6d0f6f0f7860db6f1968e3a9fbd99 not found: ID does not exist"
May 28 09:56:39.172366 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.172362    2578 scope.go:117] "RemoveContainer" containerID="ee0e8ea550c4559c1d84605bcd1a601a6a7f9d390a9194362c1733cbad2c7b3b"
May 28 09:56:39.172551 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.172537    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee0e8ea550c4559c1d84605bcd1a601a6a7f9d390a9194362c1733cbad2c7b3b"} err="failed to get container status \"ee0e8ea550c4559c1d84605bcd1a601a6a7f9d390a9194362c1733cbad2c7b3b\": rpc error: code = NotFound desc = could not find container \"ee0e8ea550c4559c1d84605bcd1a601a6a7f9d390a9194362c1733cbad2c7b3b\": container with ID starting with ee0e8ea550c4559c1d84605bcd1a601a6a7f9d390a9194362c1733cbad2c7b3b not found: ID does not exist"
May 28 09:56:39.172590 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.172551    2578 scope.go:117] "RemoveContainer" containerID="6998bc056d007d68a16ec5cc5297d42d781d6c015512b80d186a7affc03c0ef7"
May 28 09:56:39.172735 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.172718    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6998bc056d007d68a16ec5cc5297d42d781d6c015512b80d186a7affc03c0ef7"} err="failed to get container status \"6998bc056d007d68a16ec5cc5297d42d781d6c015512b80d186a7affc03c0ef7\": rpc error: code = NotFound desc = could not find container \"6998bc056d007d68a16ec5cc5297d42d781d6c015512b80d186a7affc03c0ef7\": container with ID starting with 6998bc056d007d68a16ec5cc5297d42d781d6c015512b80d186a7affc03c0ef7 not found: ID does not exist"
May 28 09:56:39.172777 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.172736    2578 scope.go:117] "RemoveContainer" containerID="b7b463603bfb2167fedbc88c91d683431ecb1f7fc46f5f618f4e2c5f4450b74e"
May 28 09:56:39.172911 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.172890    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7b463603bfb2167fedbc88c91d683431ecb1f7fc46f5f618f4e2c5f4450b74e"} err="failed to get container status \"b7b463603bfb2167fedbc88c91d683431ecb1f7fc46f5f618f4e2c5f4450b74e\": rpc error: code = NotFound desc = could not find container \"b7b463603bfb2167fedbc88c91d683431ecb1f7fc46f5f618f4e2c5f4450b74e\": container with ID starting with b7b463603bfb2167fedbc88c91d683431ecb1f7fc46f5f618f4e2c5f4450b74e not found: ID does not exist"
May 28 09:56:39.172911 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.172910    2578 scope.go:117] "RemoveContainer" containerID="14037bb4e6bcf1c49d314831d6877ed0ecedba65b9f8cc5e77888059e3bf84fa"
May 28 09:56:39.173130 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.173115    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14037bb4e6bcf1c49d314831d6877ed0ecedba65b9f8cc5e77888059e3bf84fa"} err="failed to get container status \"14037bb4e6bcf1c49d314831d6877ed0ecedba65b9f8cc5e77888059e3bf84fa\": rpc error: code = NotFound desc = could not find container \"14037bb4e6bcf1c49d314831d6877ed0ecedba65b9f8cc5e77888059e3bf84fa\": container with ID starting with 14037bb4e6bcf1c49d314831d6877ed0ecedba65b9f8cc5e77888059e3bf84fa not found: ID does not exist"
May 28 09:56:39.220150 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.220126    2578 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/eddbb5cd-d7fc-4f47-8272-278d71ed91b9-offline-tls\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 09:56:39.220150 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.220146    2578 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/eddbb5cd-d7fc-4f47-8272-278d71ed91b9-ui-tls\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 09:56:39.220296 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.220160    2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/eddbb5cd-d7fc-4f47-8272-278d71ed91b9-registry-tls\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 09:56:39.220296 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.220173    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-djqsb\" (UniqueName: \"kubernetes.io/projected/eddbb5cd-d7fc-4f47-8272-278d71ed91b9-kube-api-access-djqsb\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 09:56:39.220296 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.220187    2578 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/eddbb5cd-d7fc-4f47-8272-278d71ed91b9-online-tls\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 09:56:39.418955 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.418927    2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl"]
May 28 09:56:39.422775 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:39.422731    2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-m8pvl"]
May 28 09:56:40.104177 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:40.104146    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30761ab3-4581-4bb4-b6b6-9a4c90b4990c" path="/var/lib/kubelet/pods/30761ab3-4581-4bb4-b6b6-9a4c90b4990c/volumes"
May 28 09:56:40.104678 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:40.104663    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eddbb5cd-d7fc-4f47-8272-278d71ed91b9" path="/var/lib/kubelet/pods/eddbb5cd-d7fc-4f47-8272-278d71ed91b9/volumes"
May 28 09:56:57.231819 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:57.231689    2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-4d4sw"]
May 28 09:56:57.232394 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:57.232026    2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-4d4sw" podUID="e1c4c61e-b1e8-4e9b-af03-8a28f9a2f8ce" containerName="manager" containerID="cri-o://9e6d10c9d44230a06550b73c5d16f4d3eba4e0beadfa60a8997eccf0ade87573" gracePeriod=10
May 28 09:56:57.462309 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:57.462283    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-4d4sw"
May 28 09:56:57.553361 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:57.553285    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q2zjv\" (UniqueName: \"kubernetes.io/projected/e1c4c61e-b1e8-4e9b-af03-8a28f9a2f8ce-kube-api-access-q2zjv\") pod \"e1c4c61e-b1e8-4e9b-af03-8a28f9a2f8ce\" (UID: \"e1c4c61e-b1e8-4e9b-af03-8a28f9a2f8ce\") "
May 28 09:56:57.555256 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:57.555234    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1c4c61e-b1e8-4e9b-af03-8a28f9a2f8ce-kube-api-access-q2zjv" (OuterVolumeSpecName: "kube-api-access-q2zjv") pod "e1c4c61e-b1e8-4e9b-af03-8a28f9a2f8ce" (UID: "e1c4c61e-b1e8-4e9b-af03-8a28f9a2f8ce"). InnerVolumeSpecName "kube-api-access-q2zjv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 09:56:57.654191 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:57.654167    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2zjv\" (UniqueName: \"kubernetes.io/projected/e1c4c61e-b1e8-4e9b-af03-8a28f9a2f8ce-kube-api-access-q2zjv\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 09:56:58.145825 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:58.145798    2578 generic.go:358] "Generic (PLEG): container finished" podID="e1c4c61e-b1e8-4e9b-af03-8a28f9a2f8ce" containerID="9e6d10c9d44230a06550b73c5d16f4d3eba4e0beadfa60a8997eccf0ade87573" exitCode=0
May 28 09:56:58.145952 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:58.145830    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-4d4sw" event={"ID":"e1c4c61e-b1e8-4e9b-af03-8a28f9a2f8ce","Type":"ContainerDied","Data":"9e6d10c9d44230a06550b73c5d16f4d3eba4e0beadfa60a8997eccf0ade87573"}
May 28 09:56:58.145952 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:58.145850    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-4d4sw" event={"ID":"e1c4c61e-b1e8-4e9b-af03-8a28f9a2f8ce","Type":"ContainerDied","Data":"d8d62bb4595e185ef66e9c21fdb1297c8531325736bdfc9e88249ff61c2740d0"}
May 28 09:56:58.145952 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:58.145853    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-4d4sw"
May 28 09:56:58.145952 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:58.145863    2578 scope.go:117] "RemoveContainer" containerID="9e6d10c9d44230a06550b73c5d16f4d3eba4e0beadfa60a8997eccf0ade87573"
May 28 09:56:58.153179 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:58.153162    2578 scope.go:117] "RemoveContainer" containerID="9e6d10c9d44230a06550b73c5d16f4d3eba4e0beadfa60a8997eccf0ade87573"
May 28 09:56:58.153448 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:56:58.153429    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e6d10c9d44230a06550b73c5d16f4d3eba4e0beadfa60a8997eccf0ade87573\": container with ID starting with 9e6d10c9d44230a06550b73c5d16f4d3eba4e0beadfa60a8997eccf0ade87573 not found: ID does not exist" containerID="9e6d10c9d44230a06550b73c5d16f4d3eba4e0beadfa60a8997eccf0ade87573"
May 28 09:56:58.153523 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:58.153457    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e6d10c9d44230a06550b73c5d16f4d3eba4e0beadfa60a8997eccf0ade87573"} err="failed to get container status \"9e6d10c9d44230a06550b73c5d16f4d3eba4e0beadfa60a8997eccf0ade87573\": rpc error: code = NotFound desc = could not find container \"9e6d10c9d44230a06550b73c5d16f4d3eba4e0beadfa60a8997eccf0ade87573\": container with ID starting with 9e6d10c9d44230a06550b73c5d16f4d3eba4e0beadfa60a8997eccf0ade87573 not found: ID does not exist"
May 28 09:56:58.163016 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:58.162995    2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-4d4sw"]
May 28 09:56:58.167380 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:56:58.167360    2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-4d4sw"]
May 28 09:57:00.104857 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:00.104827    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1c4c61e-b1e8-4e9b-af03-8a28f9a2f8ce" path="/var/lib/kubelet/pods/e1c4c61e-b1e8-4e9b-af03-8a28f9a2f8ce/volumes"
May 28 09:57:01.502898 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:01.502870    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-hl7d2"]
May 28 09:57:01.503298 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:01.503117    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1c4c61e-b1e8-4e9b-af03-8a28f9a2f8ce" containerName="manager"
May 28 09:57:01.503298 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:01.503128    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1c4c61e-b1e8-4e9b-af03-8a28f9a2f8ce" containerName="manager"
May 28 09:57:01.503298 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:01.503137    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30761ab3-4581-4bb4-b6b6-9a4c90b4990c" containerName="offline"
May 28 09:57:01.503298 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:01.503143    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="30761ab3-4581-4bb4-b6b6-9a4c90b4990c" containerName="offline"
May 28 09:57:01.503298 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:01.503149    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eddbb5cd-d7fc-4f47-8272-278d71ed91b9" containerName="offline"
May 28 09:57:01.503298 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:01.503154    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="eddbb5cd-d7fc-4f47-8272-278d71ed91b9" containerName="offline"
May 28 09:57:01.503298 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:01.503164    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eddbb5cd-d7fc-4f47-8272-278d71ed91b9" containerName="registry"
May 28 09:57:01.503298 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:01.503170    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="eddbb5cd-d7fc-4f47-8272-278d71ed91b9" containerName="registry"
May 28 09:57:01.503298 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:01.503177    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eddbb5cd-d7fc-4f47-8272-278d71ed91b9" containerName="feast-init"
May 28 09:57:01.503298 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:01.503183    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="eddbb5cd-d7fc-4f47-8272-278d71ed91b9" containerName="feast-init"
May 28 09:57:01.503298 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:01.503190    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eddbb5cd-d7fc-4f47-8272-278d71ed91b9" containerName="online"
May 28 09:57:01.503298 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:01.503195    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="eddbb5cd-d7fc-4f47-8272-278d71ed91b9" containerName="online"
May 28 09:57:01.503298 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:01.503202    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eddbb5cd-d7fc-4f47-8272-278d71ed91b9" containerName="feast-apply"
May 28 09:57:01.503298 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:01.503207    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="eddbb5cd-d7fc-4f47-8272-278d71ed91b9" containerName="feast-apply"
May 28 09:57:01.503298 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:01.503213    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30761ab3-4581-4bb4-b6b6-9a4c90b4990c" containerName="online"
May 28 09:57:01.503298 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:01.503233    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="30761ab3-4581-4bb4-b6b6-9a4c90b4990c" containerName="online"
May 28 09:57:01.503298 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:01.503241    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30761ab3-4581-4bb4-b6b6-9a4c90b4990c" containerName="feast-init"
May 28 09:57:01.503298 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:01.503246    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="30761ab3-4581-4bb4-b6b6-9a4c90b4990c" containerName="feast-init"
May 28 09:57:01.503298 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:01.503251    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eddbb5cd-d7fc-4f47-8272-278d71ed91b9" containerName="ui"
May 28 09:57:01.503298 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:01.503256    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="eddbb5cd-d7fc-4f47-8272-278d71ed91b9" containerName="ui"
May 28 09:57:01.503298 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:01.503277    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30761ab3-4581-4bb4-b6b6-9a4c90b4990c" containerName="feast-apply"
May 28 09:57:01.503298 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:01.503282    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="30761ab3-4581-4bb4-b6b6-9a4c90b4990c" containerName="feast-apply"
May 28 09:57:01.503298 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:01.503289    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30761ab3-4581-4bb4-b6b6-9a4c90b4990c" containerName="ui"
May 28 09:57:01.503298 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:01.503294    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="30761ab3-4581-4bb4-b6b6-9a4c90b4990c" containerName="ui"
May 28 09:57:01.504010 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:01.503330    2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="eddbb5cd-d7fc-4f47-8272-278d71ed91b9" containerName="registry"
May 28 09:57:01.504010 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:01.503338    2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="30761ab3-4581-4bb4-b6b6-9a4c90b4990c" containerName="offline"
May 28 09:57:01.504010 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:01.503344    2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="eddbb5cd-d7fc-4f47-8272-278d71ed91b9" containerName="ui"
May 28 09:57:01.504010 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:01.503350    2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="eddbb5cd-d7fc-4f47-8272-278d71ed91b9" containerName="offline"
May 28 09:57:01.504010 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:01.503354    2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="30761ab3-4581-4bb4-b6b6-9a4c90b4990c" containerName="ui"
May 28 09:57:01.504010 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:01.503360    2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="30761ab3-4581-4bb4-b6b6-9a4c90b4990c" containerName="online"
May 28 09:57:01.504010 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:01.503365    2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="eddbb5cd-d7fc-4f47-8272-278d71ed91b9" containerName="online"
May 28 09:57:01.504010 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:01.503370    2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="e1c4c61e-b1e8-4e9b-af03-8a28f9a2f8ce" containerName="manager"
May 28 09:57:01.507508 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:01.507493    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-hl7d2"
May 28 09:57:01.512629 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:01.512607    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
May 28 09:57:01.513267 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:01.513250    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
May 28 09:57:01.513325 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:01.513249    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-rldtp\""
May 28 09:57:01.516887 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:01.516866    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-hl7d2"]
May 28 09:57:01.578570 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:01.578540    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsrn4\" (UniqueName: \"kubernetes.io/projected/72bc38d7-bbe9-4a22-803c-9bba7e545695-kube-api-access-dsrn4\") pod \"feast-operator-controller-manager-cf99db75-hl7d2\" (UID: \"72bc38d7-bbe9-4a22-803c-9bba7e545695\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-hl7d2"
May 28 09:57:01.679842 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:01.679818    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dsrn4\" (UniqueName: \"kubernetes.io/projected/72bc38d7-bbe9-4a22-803c-9bba7e545695-kube-api-access-dsrn4\") pod \"feast-operator-controller-manager-cf99db75-hl7d2\" (UID: \"72bc38d7-bbe9-4a22-803c-9bba7e545695\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-hl7d2"
May 28 09:57:01.689357 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:01.689334    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsrn4\" (UniqueName: \"kubernetes.io/projected/72bc38d7-bbe9-4a22-803c-9bba7e545695-kube-api-access-dsrn4\") pod \"feast-operator-controller-manager-cf99db75-hl7d2\" (UID: \"72bc38d7-bbe9-4a22-803c-9bba7e545695\") " pod="feast-operator-system/feast-operator-controller-manager-cf99db75-hl7d2"
May 28 09:57:01.822112 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:01.822042    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-hl7d2"
May 28 09:57:01.942407 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:01.942373    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-cf99db75-hl7d2"]
May 28 09:57:01.945364 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:57:01.945338    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72bc38d7_bbe9_4a22_803c_9bba7e545695.slice/crio-e2d1242827cebe56d01469ab36ee87573c11eb1daaeb245a1bc76496421d1330 WatchSource:0}: Error finding container e2d1242827cebe56d01469ab36ee87573c11eb1daaeb245a1bc76496421d1330: Status 404 returned error can't find the container with id e2d1242827cebe56d01469ab36ee87573c11eb1daaeb245a1bc76496421d1330
May 28 09:57:01.947362 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:01.947343    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 09:57:02.155941 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:02.155861    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-hl7d2" event={"ID":"72bc38d7-bbe9-4a22-803c-9bba7e545695","Type":"ContainerStarted","Data":"addf11b197ed111afab0a68a7fa3ce487f41b798387580c334683ba92eb5a9ce"}
May 28 09:57:02.155941 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:02.155896    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-hl7d2" event={"ID":"72bc38d7-bbe9-4a22-803c-9bba7e545695","Type":"ContainerStarted","Data":"e2d1242827cebe56d01469ab36ee87573c11eb1daaeb245a1bc76496421d1330"}
May 28 09:57:02.156154 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:02.155984    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-hl7d2"
May 28 09:57:02.176143 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:02.176092    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-hl7d2" podStartSLOduration=1.176073878 podStartE2EDuration="1.176073878s" podCreationTimestamp="2026-05-28 09:57:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 09:57:02.174502371 +0000 UTC m=+1534.634248014" watchObservedRunningTime="2026-05-28 09:57:02.176073878 +0000 UTC m=+1534.635819525"
May 28 09:57:13.160831 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:13.160801    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-cf99db75-hl7d2"
May 28 09:57:18.433012 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:18.432977    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d"]
May 28 09:57:18.436338 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:18.436323    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d"
May 28 09:57:18.438902 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:18.438880    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
May 28 09:57:18.439019 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:18.438927    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
May 28 09:57:18.439019 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:18.438981    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
May 28 09:57:18.439019 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:18.439008    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
May 28 09:57:18.439183 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:18.439045    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-r57b5\""
May 28 09:57:18.439251 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:18.439242    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
May 28 09:57:18.439312 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:18.439254    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
May 28 09:57:18.446962 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:18.446939    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d"]
May 28 09:57:18.596904 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:18.596875    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/abcf7b67-3acd-4cb4-8694-2d0d93db359a-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-tg69d\" (UID: \"abcf7b67-3acd-4cb4-8694-2d0d93db359a\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d"
May 28 09:57:18.597096 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:18.596929    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/abcf7b67-3acd-4cb4-8694-2d0d93db359a-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-tg69d\" (UID: \"abcf7b67-3acd-4cb4-8694-2d0d93db359a\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d"
May 28 09:57:18.597096 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:18.596951    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwptw\" (UniqueName: \"kubernetes.io/projected/abcf7b67-3acd-4cb4-8694-2d0d93db359a-kube-api-access-wwptw\") pod \"feast-simple-feast-setup-664fcfcc58-tg69d\" (UID: \"abcf7b67-3acd-4cb4-8694-2d0d93db359a\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d"
May 28 09:57:18.597096 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:18.597033    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/abcf7b67-3acd-4cb4-8694-2d0d93db359a-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-tg69d\" (UID: \"abcf7b67-3acd-4cb4-8694-2d0d93db359a\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d"
May 28 09:57:18.597096 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:18.597075    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/abcf7b67-3acd-4cb4-8694-2d0d93db359a-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-tg69d\" (UID: \"abcf7b67-3acd-4cb4-8694-2d0d93db359a\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d"
May 28 09:57:18.597096 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:18.597096    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/abcf7b67-3acd-4cb4-8694-2d0d93db359a-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-tg69d\" (UID: \"abcf7b67-3acd-4cb4-8694-2d0d93db359a\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d"
May 28 09:57:18.698437 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:18.698371    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/abcf7b67-3acd-4cb4-8694-2d0d93db359a-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-tg69d\" (UID: \"abcf7b67-3acd-4cb4-8694-2d0d93db359a\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d"
May 28 09:57:18.698437 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:18.698407    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/abcf7b67-3acd-4cb4-8694-2d0d93db359a-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-tg69d\" (UID: \"abcf7b67-3acd-4cb4-8694-2d0d93db359a\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d"
May 28 09:57:18.698614 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:18.698594    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/abcf7b67-3acd-4cb4-8694-2d0d93db359a-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-tg69d\" (UID: \"abcf7b67-3acd-4cb4-8694-2d0d93db359a\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d"
May 28 09:57:18.698651 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:18.698627    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wwptw\" (UniqueName: \"kubernetes.io/projected/abcf7b67-3acd-4cb4-8694-2d0d93db359a-kube-api-access-wwptw\") pod \"feast-simple-feast-setup-664fcfcc58-tg69d\" (UID: \"abcf7b67-3acd-4cb4-8694-2d0d93db359a\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d"
May 28 09:57:18.698774 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:18.698730    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/abcf7b67-3acd-4cb4-8694-2d0d93db359a-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-tg69d\" (UID: \"abcf7b67-3acd-4cb4-8694-2d0d93db359a\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d"
May 28 09:57:18.698774 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:18.698768    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/abcf7b67-3acd-4cb4-8694-2d0d93db359a-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-tg69d\" (UID: \"abcf7b67-3acd-4cb4-8694-2d0d93db359a\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d"
May 28 09:57:18.698936 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:18.698804    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/abcf7b67-3acd-4cb4-8694-2d0d93db359a-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-tg69d\" (UID: \"abcf7b67-3acd-4cb4-8694-2d0d93db359a\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d"
May 28 09:57:18.701001 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:18.700972    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/abcf7b67-3acd-4cb4-8694-2d0d93db359a-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-tg69d\" (UID: \"abcf7b67-3acd-4cb4-8694-2d0d93db359a\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d"
May 28 09:57:18.701080 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:18.701051    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/abcf7b67-3acd-4cb4-8694-2d0d93db359a-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-tg69d\" (UID: \"abcf7b67-3acd-4cb4-8694-2d0d93db359a\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d"
May 28 09:57:18.701151 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:18.701132    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/abcf7b67-3acd-4cb4-8694-2d0d93db359a-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-tg69d\" (UID: \"abcf7b67-3acd-4cb4-8694-2d0d93db359a\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d"
May 28 09:57:18.701190 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:18.701132    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/abcf7b67-3acd-4cb4-8694-2d0d93db359a-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-tg69d\" (UID: \"abcf7b67-3acd-4cb4-8694-2d0d93db359a\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d"
May 28 09:57:18.708676 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:18.708653    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwptw\" (UniqueName: \"kubernetes.io/projected/abcf7b67-3acd-4cb4-8694-2d0d93db359a-kube-api-access-wwptw\") pod \"feast-simple-feast-setup-664fcfcc58-tg69d\" (UID: \"abcf7b67-3acd-4cb4-8694-2d0d93db359a\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d"
May 28 09:57:18.745503 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:18.745482    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d"
May 28 09:57:18.880170 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:18.880144    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d"]
May 28 09:57:18.882752 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:57:18.882725    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podabcf7b67_3acd_4cb4_8694_2d0d93db359a.slice/crio-0815973066d38f79eefc549fe1407ba569b83814cba5710806213cb371a41864 WatchSource:0}: Error finding container 0815973066d38f79eefc549fe1407ba569b83814cba5710806213cb371a41864: Status 404 returned error can't find the container with id 0815973066d38f79eefc549fe1407ba569b83814cba5710806213cb371a41864
May 28 09:57:19.206510 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:19.206472    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d" event={"ID":"abcf7b67-3acd-4cb4-8694-2d0d93db359a","Type":"ContainerStarted","Data":"aa3420187cc3b8e3d8bd65397498284036a47fecae760dbafd4deab2e2a19789"}
May 28 09:57:19.206674 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:19.206514    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d" event={"ID":"abcf7b67-3acd-4cb4-8694-2d0d93db359a","Type":"ContainerStarted","Data":"0815973066d38f79eefc549fe1407ba569b83814cba5710806213cb371a41864"}
May 28 09:57:24.222714 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:24.222684    2578 generic.go:358] "Generic (PLEG): container finished" podID="abcf7b67-3acd-4cb4-8694-2d0d93db359a" containerID="aa3420187cc3b8e3d8bd65397498284036a47fecae760dbafd4deab2e2a19789" exitCode=0
May 28 09:57:24.222714 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:24.222718    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d" event={"ID":"abcf7b67-3acd-4cb4-8694-2d0d93db359a","Type":"ContainerDied","Data":"aa3420187cc3b8e3d8bd65397498284036a47fecae760dbafd4deab2e2a19789"}
May 28 09:57:25.227581 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:25.227543    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d" event={"ID":"abcf7b67-3acd-4cb4-8694-2d0d93db359a","Type":"ContainerStarted","Data":"5d56dc2265a011198cc7616228258ef8482c066e35c69eb3ea0cd36a3ece6902"}
May 28 09:57:30.242565 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:30.242526    2578 generic.go:358] "Generic (PLEG): container finished" podID="abcf7b67-3acd-4cb4-8694-2d0d93db359a" containerID="5d56dc2265a011198cc7616228258ef8482c066e35c69eb3ea0cd36a3ece6902" exitCode=0
May 28 09:57:30.242565 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:30.242554    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d" event={"ID":"abcf7b67-3acd-4cb4-8694-2d0d93db359a","Type":"ContainerDied","Data":"5d56dc2265a011198cc7616228258ef8482c066e35c69eb3ea0cd36a3ece6902"}
May 28 09:57:31.249452 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:31.249410    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d" event={"ID":"abcf7b67-3acd-4cb4-8694-2d0d93db359a","Type":"ContainerStarted","Data":"3497fcd772b0875c941e086a4d69f86269c48379d3ebcf663c58a53afadff7ce"}
May 28 09:57:31.249916 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:31.249461    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d" event={"ID":"abcf7b67-3acd-4cb4-8694-2d0d93db359a","Type":"ContainerStarted","Data":"73183fdecfddbe2311e98af92517d766894697a0659bd2d165344f6f5d84ca3a"}
May 28 09:57:31.249916 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:31.249476    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d" event={"ID":"abcf7b67-3acd-4cb4-8694-2d0d93db359a","Type":"ContainerStarted","Data":"75d8c71bb16885419724e0dae2aa8b41f43e013b4c0094d6809aa1ee8299c39b"}
May 28 09:57:31.249916 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:31.249488    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d" event={"ID":"abcf7b67-3acd-4cb4-8694-2d0d93db359a","Type":"ContainerStarted","Data":"e236351d302675716d8076267f9eb3dc88d5c0dccfd1a579e10692a77f5e5d60"}
May 28 09:57:31.275293 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:31.275236    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d" podStartSLOduration=13.275200735 podStartE2EDuration="13.275200735s" podCreationTimestamp="2026-05-28 09:57:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 09:57:31.273042857 +0000 UTC m=+1563.732788503" watchObservedRunningTime="2026-05-28 09:57:31.275200735 +0000 UTC m=+1563.734946381"
May 28 09:57:33.746680 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:33.746641    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d"
May 28 09:57:33.747140 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:33.746698    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d"
May 28 09:57:33.747140 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:33.746713    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d"
May 28 09:57:33.747140 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:33.746726    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d"
May 28 09:57:33.748774 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:33.748732    2578 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d" podUID="abcf7b67-3acd-4cb4-8694-2d0d93db359a" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.24:8816: connect: connection refused"
May 28 09:57:33.748774 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:33.748750    2578 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d" podUID="abcf7b67-3acd-4cb4-8694-2d0d93db359a" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.24:8443: connect: connection refused"
May 28 09:57:33.748774 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:33.748764    2578 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d" podUID="abcf7b67-3acd-4cb4-8694-2d0d93db359a" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.24:6571: connect: connection refused"
May 28 09:57:33.749034 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:33.748833    2578 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d" podUID="abcf7b67-3acd-4cb4-8694-2d0d93db359a" containerName="online" probeResult="failure" output="Get \"https://10.132.0.24:6567/health\": dial tcp 10.132.0.24:6567: connect: connection refused"
May 28 09:57:36.746932 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:36.746901    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d"
May 28 09:57:36.747328 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:36.747023    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d"
May 28 09:57:36.747328 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:36.747281    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d"
May 28 09:57:36.747676 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:36.747650    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d"
May 28 09:57:36.747676 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:36.747680    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d"
May 28 09:57:36.747890 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:36.747692    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d"
May 28 09:57:36.747980 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:36.747965    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d"
May 28 09:57:36.748100 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:36.748087    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d"
May 28 09:57:36.748183 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:36.748167    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d"
May 28 09:57:36.751386 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:36.751372    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d"
May 28 09:57:37.272283 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:37.272254    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d"
May 28 09:57:37.276975 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:57:37.276940    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d"
May 28 09:58:39.474035 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:39.474001    2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d"]
May 28 09:58:39.474474 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:39.474364    2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d" podUID="abcf7b67-3acd-4cb4-8694-2d0d93db359a" containerName="registry" containerID="cri-o://e236351d302675716d8076267f9eb3dc88d5c0dccfd1a579e10692a77f5e5d60" gracePeriod=30
May 28 09:58:39.474474 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:39.474421    2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d" podUID="abcf7b67-3acd-4cb4-8694-2d0d93db359a" containerName="ui" containerID="cri-o://3497fcd772b0875c941e086a4d69f86269c48379d3ebcf663c58a53afadff7ce" gracePeriod=30
May 28 09:58:39.474474 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:39.474421    2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d" podUID="abcf7b67-3acd-4cb4-8694-2d0d93db359a" containerName="offline" containerID="cri-o://73183fdecfddbe2311e98af92517d766894697a0659bd2d165344f6f5d84ca3a" gracePeriod=30
May 28 09:58:39.474653 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:39.474502    2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d" podUID="abcf7b67-3acd-4cb4-8694-2d0d93db359a" containerName="online" containerID="cri-o://75d8c71bb16885419724e0dae2aa8b41f43e013b4c0094d6809aa1ee8299c39b" gracePeriod=30
May 28 09:58:39.894511 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:39.894427    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq"]
May 28 09:58:39.898467 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:39.898444    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq"
May 28 09:58:39.900798 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:39.900772    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-4mrlh\""
May 28 09:58:39.910176 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:39.910151    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq"]
May 28 09:58:39.953749 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:39.953721    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/951e047c-78a3-40b4-b1a1-0c6b17619d17-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-s59vq\" (UID: \"951e047c-78a3-40b4-b1a1-0c6b17619d17\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq"
May 28 09:58:39.953874 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:39.953756    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/951e047c-78a3-40b4-b1a1-0c6b17619d17-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-s59vq\" (UID: \"951e047c-78a3-40b4-b1a1-0c6b17619d17\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq"
May 28 09:58:39.953874 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:39.953773    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-88q2t\" (UniqueName: \"kubernetes.io/projected/951e047c-78a3-40b4-b1a1-0c6b17619d17-kube-api-access-88q2t\") pod \"feast-simple-feast-setup-664fcfcc58-s59vq\" (UID: \"951e047c-78a3-40b4-b1a1-0c6b17619d17\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq"
May 28 09:58:39.953874 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:39.953792    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/951e047c-78a3-40b4-b1a1-0c6b17619d17-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-s59vq\" (UID: \"951e047c-78a3-40b4-b1a1-0c6b17619d17\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq"
May 28 09:58:39.953990 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:39.953884    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/951e047c-78a3-40b4-b1a1-0c6b17619d17-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-s59vq\" (UID: \"951e047c-78a3-40b4-b1a1-0c6b17619d17\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq"
May 28 09:58:39.953990 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:39.953926    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/951e047c-78a3-40b4-b1a1-0c6b17619d17-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-s59vq\" (UID: \"951e047c-78a3-40b4-b1a1-0c6b17619d17\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq"
May 28 09:58:40.055066 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:40.055032    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/951e047c-78a3-40b4-b1a1-0c6b17619d17-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-s59vq\" (UID: \"951e047c-78a3-40b4-b1a1-0c6b17619d17\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq"
May 28 09:58:40.055066 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:40.055070    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/951e047c-78a3-40b4-b1a1-0c6b17619d17-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-s59vq\" (UID: \"951e047c-78a3-40b4-b1a1-0c6b17619d17\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq"
May 28 09:58:40.055328 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:40.055091    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-88q2t\" (UniqueName: \"kubernetes.io/projected/951e047c-78a3-40b4-b1a1-0c6b17619d17-kube-api-access-88q2t\") pod \"feast-simple-feast-setup-664fcfcc58-s59vq\" (UID: \"951e047c-78a3-40b4-b1a1-0c6b17619d17\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq"
May 28 09:58:40.055328 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:40.055114    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/951e047c-78a3-40b4-b1a1-0c6b17619d17-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-s59vq\" (UID: \"951e047c-78a3-40b4-b1a1-0c6b17619d17\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq"
May 28 09:58:40.055328 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:40.055134    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/951e047c-78a3-40b4-b1a1-0c6b17619d17-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-s59vq\" (UID: \"951e047c-78a3-40b4-b1a1-0c6b17619d17\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq"
May 28 09:58:40.055328 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:40.055162    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/951e047c-78a3-40b4-b1a1-0c6b17619d17-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-s59vq\" (UID: \"951e047c-78a3-40b4-b1a1-0c6b17619d17\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq"
May 28 09:58:40.055328 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:58:40.055205    2578 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
May 28 09:58:40.055328 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:58:40.055271    2578 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found
May 28 09:58:40.055328 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:58:40.055286    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/951e047c-78a3-40b4-b1a1-0c6b17619d17-online-tls podName:951e047c-78a3-40b4-b1a1-0c6b17619d17 nodeName:}" failed. No retries permitted until 2026-05-28 09:58:40.555266736 +0000 UTC m=+1633.015012361 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/951e047c-78a3-40b4-b1a1-0c6b17619d17-online-tls") pod "feast-simple-feast-setup-664fcfcc58-s59vq" (UID: "951e047c-78a3-40b4-b1a1-0c6b17619d17") : secret "feast-simple-feast-setup-online-tls" not found
May 28 09:58:40.055328 ip-10-0-138-49 kubenswrapper[2578]: E0528 09:58:40.055328    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/951e047c-78a3-40b4-b1a1-0c6b17619d17-offline-tls podName:951e047c-78a3-40b4-b1a1-0c6b17619d17 nodeName:}" failed. No retries permitted until 2026-05-28 09:58:40.555312646 +0000 UTC m=+1633.015058282 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/951e047c-78a3-40b4-b1a1-0c6b17619d17-offline-tls") pod "feast-simple-feast-setup-664fcfcc58-s59vq" (UID: "951e047c-78a3-40b4-b1a1-0c6b17619d17") : secret "feast-simple-feast-setup-offline-tls" not found
May 28 09:58:40.055678 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:40.055613    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/951e047c-78a3-40b4-b1a1-0c6b17619d17-feast-data\") pod \"feast-simple-feast-setup-664fcfcc58-s59vq\" (UID: \"951e047c-78a3-40b4-b1a1-0c6b17619d17\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq"
May 28 09:58:40.057539 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:40.057523    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/951e047c-78a3-40b4-b1a1-0c6b17619d17-registry-tls\") pod \"feast-simple-feast-setup-664fcfcc58-s59vq\" (UID: \"951e047c-78a3-40b4-b1a1-0c6b17619d17\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq"
May 28 09:58:40.057702 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:40.057678    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/951e047c-78a3-40b4-b1a1-0c6b17619d17-ui-tls\") pod \"feast-simple-feast-setup-664fcfcc58-s59vq\" (UID: \"951e047c-78a3-40b4-b1a1-0c6b17619d17\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq"
May 28 09:58:40.064288 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:40.064192    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-88q2t\" (UniqueName: \"kubernetes.io/projected/951e047c-78a3-40b4-b1a1-0c6b17619d17-kube-api-access-88q2t\") pod \"feast-simple-feast-setup-664fcfcc58-s59vq\" (UID: \"951e047c-78a3-40b4-b1a1-0c6b17619d17\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq"
May 28 09:58:40.445062 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:40.444985    2578 generic.go:358] "Generic (PLEG): container finished" podID="abcf7b67-3acd-4cb4-8694-2d0d93db359a" containerID="3497fcd772b0875c941e086a4d69f86269c48379d3ebcf663c58a53afadff7ce" exitCode=0
May 28 09:58:40.445062 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:40.445010    2578 generic.go:358] "Generic (PLEG): container finished" podID="abcf7b67-3acd-4cb4-8694-2d0d93db359a" containerID="75d8c71bb16885419724e0dae2aa8b41f43e013b4c0094d6809aa1ee8299c39b" exitCode=0
May 28 09:58:40.445062 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:40.445048    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d" event={"ID":"abcf7b67-3acd-4cb4-8694-2d0d93db359a","Type":"ContainerDied","Data":"3497fcd772b0875c941e086a4d69f86269c48379d3ebcf663c58a53afadff7ce"}
May 28 09:58:40.445335 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:40.445069    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d" event={"ID":"abcf7b67-3acd-4cb4-8694-2d0d93db359a","Type":"ContainerDied","Data":"75d8c71bb16885419724e0dae2aa8b41f43e013b4c0094d6809aa1ee8299c39b"}
May 28 09:58:40.559270 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:40.559240    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/951e047c-78a3-40b4-b1a1-0c6b17619d17-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-s59vq\" (UID: \"951e047c-78a3-40b4-b1a1-0c6b17619d17\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq"
May 28 09:58:40.559689 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:40.559285    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/951e047c-78a3-40b4-b1a1-0c6b17619d17-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-s59vq\" (UID: \"951e047c-78a3-40b4-b1a1-0c6b17619d17\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq"
May 28 09:58:40.561551 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:40.561528    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/951e047c-78a3-40b4-b1a1-0c6b17619d17-offline-tls\") pod \"feast-simple-feast-setup-664fcfcc58-s59vq\" (UID: \"951e047c-78a3-40b4-b1a1-0c6b17619d17\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq"
May 28 09:58:40.561648 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:40.561565    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/951e047c-78a3-40b4-b1a1-0c6b17619d17-online-tls\") pod \"feast-simple-feast-setup-664fcfcc58-s59vq\" (UID: \"951e047c-78a3-40b4-b1a1-0c6b17619d17\") " pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq"
May 28 09:58:40.809292 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:40.809200    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq"
May 28 09:58:40.934679 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:40.934649    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq"]
May 28 09:58:40.935948 ip-10-0-138-49 kubenswrapper[2578]: W0528 09:58:40.935920    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod951e047c_78a3_40b4_b1a1_0c6b17619d17.slice/crio-cb7e4548e629e49e128248b72197761855e34cf40f07361cdf75ef7b99aaa30d WatchSource:0}: Error finding container cb7e4548e629e49e128248b72197761855e34cf40f07361cdf75ef7b99aaa30d: Status 404 returned error can't find the container with id cb7e4548e629e49e128248b72197761855e34cf40f07361cdf75ef7b99aaa30d
May 28 09:58:41.449438 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:41.449406    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq" event={"ID":"951e047c-78a3-40b4-b1a1-0c6b17619d17","Type":"ContainerStarted","Data":"d124975a83d2f8114bcc17b9fa6be4e1589e147f77207d60eb9c3b6924d00935"}
May 28 09:58:41.449438 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:41.449441    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq" event={"ID":"951e047c-78a3-40b4-b1a1-0c6b17619d17","Type":"ContainerStarted","Data":"cb7e4548e629e49e128248b72197761855e34cf40f07361cdf75ef7b99aaa30d"}
May 28 09:58:45.463053 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:45.463026    2578 generic.go:358] "Generic (PLEG): container finished" podID="951e047c-78a3-40b4-b1a1-0c6b17619d17" containerID="d124975a83d2f8114bcc17b9fa6be4e1589e147f77207d60eb9c3b6924d00935" exitCode=0
May 28 09:58:45.463412 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:45.463080    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq" event={"ID":"951e047c-78a3-40b4-b1a1-0c6b17619d17","Type":"ContainerDied","Data":"d124975a83d2f8114bcc17b9fa6be4e1589e147f77207d60eb9c3b6924d00935"}
May 28 09:58:46.467540 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:46.467510    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq" event={"ID":"951e047c-78a3-40b4-b1a1-0c6b17619d17","Type":"ContainerStarted","Data":"b8de34428bbd1092f2805c5f4347cb25e657d4ebf4c68b6525c1cb4bf81a6fe1"}
May 28 09:58:46.748777 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:46.748668    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d" podUID="abcf7b67-3acd-4cb4-8694-2d0d93db359a" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.24:8443: connect: connection refused"
May 28 09:58:47.273061 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:47.273021    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d" podUID="abcf7b67-3acd-4cb4-8694-2d0d93db359a" containerName="online" probeResult="failure" output="Get \"https://10.132.0.24:6567/health\": dial tcp 10.132.0.24:6567: connect: connection refused"
May 28 09:58:51.482812 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:51.482774    2578 generic.go:358] "Generic (PLEG): container finished" podID="951e047c-78a3-40b4-b1a1-0c6b17619d17" containerID="b8de34428bbd1092f2805c5f4347cb25e657d4ebf4c68b6525c1cb4bf81a6fe1" exitCode=0
May 28 09:58:51.483166 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:51.482842    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq" event={"ID":"951e047c-78a3-40b4-b1a1-0c6b17619d17","Type":"ContainerDied","Data":"b8de34428bbd1092f2805c5f4347cb25e657d4ebf4c68b6525c1cb4bf81a6fe1"}
May 28 09:58:52.489913 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:52.489871    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq" event={"ID":"951e047c-78a3-40b4-b1a1-0c6b17619d17","Type":"ContainerStarted","Data":"a796706b61d726190cb08b906327683c25ece4f6242aae5a3fdc4685cb84cb82"}
May 28 09:58:52.490408 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:52.489923    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq" event={"ID":"951e047c-78a3-40b4-b1a1-0c6b17619d17","Type":"ContainerStarted","Data":"991624b5164a1753af3352cec2246781ce1ab4f41c67258dce57cd21c901e88a"}
May 28 09:58:52.490408 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:52.489938    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq" event={"ID":"951e047c-78a3-40b4-b1a1-0c6b17619d17","Type":"ContainerStarted","Data":"c5ee75a8f311aeb37fa8992190dce9956fb66b653665197912a9ff7e5e730bbb"}
May 28 09:58:52.490408 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:52.489952    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq" event={"ID":"951e047c-78a3-40b4-b1a1-0c6b17619d17","Type":"ContainerStarted","Data":"fd8406608fc104c0f269bc81f907d279bb71770b261a7265f69a5a1bcdc55785"}
May 28 09:58:52.515855 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:52.515786    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq" podStartSLOduration=13.515750146 podStartE2EDuration="13.515750146s" podCreationTimestamp="2026-05-28 09:58:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 09:58:52.514970047 +0000 UTC m=+1644.974715697" watchObservedRunningTime="2026-05-28 09:58:52.515750146 +0000 UTC m=+1644.975495792"
May 28 09:58:52.810234 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:52.810125    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq"
May 28 09:58:52.810234 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:52.810178    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq"
May 28 09:58:52.810234 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:52.810192    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq"
May 28 09:58:52.810234 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:52.810206    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq"
May 28 09:58:52.812343 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:52.812296    2578 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq" podUID="951e047c-78a3-40b4-b1a1-0c6b17619d17" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.25:8443: connect: connection refused"
May 28 09:58:52.812343 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:52.812326    2578 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq" podUID="951e047c-78a3-40b4-b1a1-0c6b17619d17" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.25:8816: connect: connection refused"
May 28 09:58:52.812530 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:52.812342    2578 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq" podUID="951e047c-78a3-40b4-b1a1-0c6b17619d17" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.25:6571: connect: connection refused"
May 28 09:58:52.812530 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:52.812427    2578 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq" podUID="951e047c-78a3-40b4-b1a1-0c6b17619d17" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused"
May 28 09:58:55.809752 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:55.809641    2578 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq" podUID="951e047c-78a3-40b4-b1a1-0c6b17619d17" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.25:8443: connect: connection refused"
May 28 09:58:55.810241 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:55.809638    2578 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq" podUID="951e047c-78a3-40b4-b1a1-0c6b17619d17" containerName="registry" probeResult="failure" output="dial tcp 10.132.0.25:6571: connect: connection refused"
May 28 09:58:55.810241 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:55.810170    2578 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq" podUID="951e047c-78a3-40b4-b1a1-0c6b17619d17" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.25:8816: connect: connection refused"
May 28 09:58:55.810505 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:55.810480    2578 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq" podUID="951e047c-78a3-40b4-b1a1-0c6b17619d17" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused"
May 28 09:58:56.748484 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:56.748411    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d" podUID="abcf7b67-3acd-4cb4-8694-2d0d93db359a" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.24:8443: connect: connection refused"
May 28 09:58:57.273209 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:57.273176    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d" podUID="abcf7b67-3acd-4cb4-8694-2d0d93db359a" containerName="online" probeResult="failure" output="Get \"https://10.132.0.24:6567/health\": dial tcp 10.132.0.24:6567: connect: connection refused"
May 28 09:58:58.810998 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:58.810964    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq"
May 28 09:58:58.811465 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:58.811058    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq"
May 28 09:58:58.811465 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:58.811315    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq"
May 28 09:58:58.811617 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:58.811596    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq"
May 28 09:58:58.811716 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:58.811630    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq"
May 28 09:58:58.811716 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:58.811645    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq"
May 28 09:58:58.811903 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:58.811884    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq"
May 28 09:58:58.812037 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:58.812020    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq"
May 28 09:58:58.812123 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:58.812109    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq"
May 28 09:58:58.815642 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:58.815618    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq"
May 28 09:58:59.513120 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:59.513093    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq"
May 28 09:58:59.515908 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:58:59.515885    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq"
May 28 09:59:06.748661 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:59:06.748620    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d" podUID="abcf7b67-3acd-4cb4-8694-2d0d93db359a" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.24:8443: connect: connection refused"
May 28 09:59:06.749082 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:59:06.748756    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d"
May 28 09:59:07.273119 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:59:07.273083    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d" podUID="abcf7b67-3acd-4cb4-8694-2d0d93db359a" containerName="online" probeResult="failure" output="Get \"https://10.132.0.24:6567/health\": dial tcp 10.132.0.24:6567: connect: connection refused"
May 28 09:59:07.273290 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:59:07.273195    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d"
May 28 09:59:09.540459 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:59:09.540429    2578 generic.go:358] "Generic (PLEG): container finished" podID="abcf7b67-3acd-4cb4-8694-2d0d93db359a" containerID="73183fdecfddbe2311e98af92517d766894697a0659bd2d165344f6f5d84ca3a" exitCode=137
May 28 09:59:09.540459 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:59:09.540454    2578 generic.go:358] "Generic (PLEG): container finished" podID="abcf7b67-3acd-4cb4-8694-2d0d93db359a" containerID="e236351d302675716d8076267f9eb3dc88d5c0dccfd1a579e10692a77f5e5d60" exitCode=137
May 28 09:59:09.540802 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:59:09.540503    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d" event={"ID":"abcf7b67-3acd-4cb4-8694-2d0d93db359a","Type":"ContainerDied","Data":"73183fdecfddbe2311e98af92517d766894697a0659bd2d165344f6f5d84ca3a"}
May 28 09:59:09.540802 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:59:09.540544    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d" event={"ID":"abcf7b67-3acd-4cb4-8694-2d0d93db359a","Type":"ContainerDied","Data":"e236351d302675716d8076267f9eb3dc88d5c0dccfd1a579e10692a77f5e5d60"}
May 28 09:59:10.116888 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:59:10.116868    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d"
May 28 09:59:10.299889 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:59:10.299819    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/abcf7b67-3acd-4cb4-8694-2d0d93db359a-online-tls\") pod \"abcf7b67-3acd-4cb4-8694-2d0d93db359a\" (UID: \"abcf7b67-3acd-4cb4-8694-2d0d93db359a\") "
May 28 09:59:10.299889 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:59:10.299866    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/abcf7b67-3acd-4cb4-8694-2d0d93db359a-offline-tls\") pod \"abcf7b67-3acd-4cb4-8694-2d0d93db359a\" (UID: \"abcf7b67-3acd-4cb4-8694-2d0d93db359a\") "
May 28 09:59:10.300071 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:59:10.299897    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/abcf7b67-3acd-4cb4-8694-2d0d93db359a-feast-data\") pod \"abcf7b67-3acd-4cb4-8694-2d0d93db359a\" (UID: \"abcf7b67-3acd-4cb4-8694-2d0d93db359a\") "
May 28 09:59:10.300071 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:59:10.299921    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwptw\" (UniqueName: \"kubernetes.io/projected/abcf7b67-3acd-4cb4-8694-2d0d93db359a-kube-api-access-wwptw\") pod \"abcf7b67-3acd-4cb4-8694-2d0d93db359a\" (UID: \"abcf7b67-3acd-4cb4-8694-2d0d93db359a\") "
May 28 09:59:10.300071 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:59:10.299942    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/abcf7b67-3acd-4cb4-8694-2d0d93db359a-ui-tls\") pod \"abcf7b67-3acd-4cb4-8694-2d0d93db359a\" (UID: \"abcf7b67-3acd-4cb4-8694-2d0d93db359a\") "
May 28 09:59:10.300071 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:59:10.299994    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/abcf7b67-3acd-4cb4-8694-2d0d93db359a-registry-tls\") pod \"abcf7b67-3acd-4cb4-8694-2d0d93db359a\" (UID: \"abcf7b67-3acd-4cb4-8694-2d0d93db359a\") "
May 28 09:59:10.300523 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:59:10.300489    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/abcf7b67-3acd-4cb4-8694-2d0d93db359a-feast-data" (OuterVolumeSpecName: "feast-data") pod "abcf7b67-3acd-4cb4-8694-2d0d93db359a" (UID: "abcf7b67-3acd-4cb4-8694-2d0d93db359a"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 09:59:10.302265 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:59:10.302240    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abcf7b67-3acd-4cb4-8694-2d0d93db359a-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "abcf7b67-3acd-4cb4-8694-2d0d93db359a" (UID: "abcf7b67-3acd-4cb4-8694-2d0d93db359a"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:59:10.302265 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:59:10.302243    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abcf7b67-3acd-4cb4-8694-2d0d93db359a-kube-api-access-wwptw" (OuterVolumeSpecName: "kube-api-access-wwptw") pod "abcf7b67-3acd-4cb4-8694-2d0d93db359a" (UID: "abcf7b67-3acd-4cb4-8694-2d0d93db359a"). InnerVolumeSpecName "kube-api-access-wwptw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 09:59:10.302415 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:59:10.302276    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abcf7b67-3acd-4cb4-8694-2d0d93db359a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "abcf7b67-3acd-4cb4-8694-2d0d93db359a" (UID: "abcf7b67-3acd-4cb4-8694-2d0d93db359a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:59:10.302415 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:59:10.302397    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abcf7b67-3acd-4cb4-8694-2d0d93db359a-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "abcf7b67-3acd-4cb4-8694-2d0d93db359a" (UID: "abcf7b67-3acd-4cb4-8694-2d0d93db359a"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:59:10.302415 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:59:10.302407    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abcf7b67-3acd-4cb4-8694-2d0d93db359a-online-tls" (OuterVolumeSpecName: "online-tls") pod "abcf7b67-3acd-4cb4-8694-2d0d93db359a" (UID: "abcf7b67-3acd-4cb4-8694-2d0d93db359a"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 09:59:10.400576 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:59:10.400541    2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/abcf7b67-3acd-4cb4-8694-2d0d93db359a-registry-tls\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 09:59:10.400576 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:59:10.400573    2578 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/abcf7b67-3acd-4cb4-8694-2d0d93db359a-online-tls\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 09:59:10.400576 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:59:10.400582    2578 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/abcf7b67-3acd-4cb4-8694-2d0d93db359a-offline-tls\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 09:59:10.400755 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:59:10.400590    2578 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/abcf7b67-3acd-4cb4-8694-2d0d93db359a-feast-data\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 09:59:10.400755 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:59:10.400598    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwptw\" (UniqueName: \"kubernetes.io/projected/abcf7b67-3acd-4cb4-8694-2d0d93db359a-kube-api-access-wwptw\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 09:59:10.400755 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:59:10.400607    2578 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/abcf7b67-3acd-4cb4-8694-2d0d93db359a-ui-tls\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 09:59:10.545620 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:59:10.545592    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d" event={"ID":"abcf7b67-3acd-4cb4-8694-2d0d93db359a","Type":"ContainerDied","Data":"0815973066d38f79eefc549fe1407ba569b83814cba5710806213cb371a41864"}
May 28 09:59:10.545620 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:59:10.545616    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d"
May 28 09:59:10.546018 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:59:10.545638    2578 scope.go:117] "RemoveContainer" containerID="3497fcd772b0875c941e086a4d69f86269c48379d3ebcf663c58a53afadff7ce"
May 28 09:59:10.554312 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:59:10.554296    2578 scope.go:117] "RemoveContainer" containerID="73183fdecfddbe2311e98af92517d766894697a0659bd2d165344f6f5d84ca3a"
May 28 09:59:10.561164 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:59:10.561137    2578 scope.go:117] "RemoveContainer" containerID="75d8c71bb16885419724e0dae2aa8b41f43e013b4c0094d6809aa1ee8299c39b"
May 28 09:59:10.567547 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:59:10.567529    2578 scope.go:117] "RemoveContainer" containerID="e236351d302675716d8076267f9eb3dc88d5c0dccfd1a579e10692a77f5e5d60"
May 28 09:59:10.571484 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:59:10.571462    2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d"]
May 28 09:59:10.574249 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:59:10.574212    2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-tg69d"]
May 28 09:59:10.575322 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:59:10.575306    2578 scope.go:117] "RemoveContainer" containerID="5d56dc2265a011198cc7616228258ef8482c066e35c69eb3ea0cd36a3ece6902"
May 28 09:59:10.581452 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:59:10.581438    2578 scope.go:117] "RemoveContainer" containerID="aa3420187cc3b8e3d8bd65397498284036a47fecae760dbafd4deab2e2a19789"
May 28 09:59:12.105483 ip-10-0-138-49 kubenswrapper[2578]: I0528 09:59:12.105452    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abcf7b67-3acd-4cb4-8694-2d0d93db359a" path="/var/lib/kubelet/pods/abcf7b67-3acd-4cb4-8694-2d0d93db359a/volumes"
May 28 10:00:01.262627 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:01.262558    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw"]
May 28 10:00:01.263078 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:01.262823    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abcf7b67-3acd-4cb4-8694-2d0d93db359a" containerName="online"
May 28 10:00:01.263078 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:01.262836    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="abcf7b67-3acd-4cb4-8694-2d0d93db359a" containerName="online"
May 28 10:00:01.263078 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:01.262848    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abcf7b67-3acd-4cb4-8694-2d0d93db359a" containerName="feast-apply"
May 28 10:00:01.263078 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:01.262854    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="abcf7b67-3acd-4cb4-8694-2d0d93db359a" containerName="feast-apply"
May 28 10:00:01.263078 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:01.262860    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abcf7b67-3acd-4cb4-8694-2d0d93db359a" containerName="registry"
May 28 10:00:01.263078 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:01.262865    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="abcf7b67-3acd-4cb4-8694-2d0d93db359a" containerName="registry"
May 28 10:00:01.263078 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:01.262870    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abcf7b67-3acd-4cb4-8694-2d0d93db359a" containerName="offline"
May 28 10:00:01.263078 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:01.262875    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="abcf7b67-3acd-4cb4-8694-2d0d93db359a" containerName="offline"
May 28 10:00:01.263078 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:01.262881    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abcf7b67-3acd-4cb4-8694-2d0d93db359a" containerName="ui"
May 28 10:00:01.263078 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:01.262886    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="abcf7b67-3acd-4cb4-8694-2d0d93db359a" containerName="ui"
May 28 10:00:01.263078 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:01.262894    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abcf7b67-3acd-4cb4-8694-2d0d93db359a" containerName="feast-init"
May 28 10:00:01.263078 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:01.262900    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="abcf7b67-3acd-4cb4-8694-2d0d93db359a" containerName="feast-init"
May 28 10:00:01.263078 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:01.262938    2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="abcf7b67-3acd-4cb4-8694-2d0d93db359a" containerName="registry"
May 28 10:00:01.263078 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:01.262945    2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="abcf7b67-3acd-4cb4-8694-2d0d93db359a" containerName="online"
May 28 10:00:01.263078 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:01.262952    2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="abcf7b67-3acd-4cb4-8694-2d0d93db359a" containerName="offline"
May 28 10:00:01.263078 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:01.262958    2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="abcf7b67-3acd-4cb4-8694-2d0d93db359a" containerName="ui"
May 28 10:00:01.266416 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:01.266397    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw"
May 28 10:00:01.268947 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:01.268921    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
May 28 10:00:01.269067 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:01.269049    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
May 28 10:00:01.269259 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:01.269245    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
May 28 10:00:01.269311 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:01.269279    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
May 28 10:00:01.269358 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:01.269325    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-vhln4\""
May 28 10:00:01.269358 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:01.269353    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
May 28 10:00:01.269434 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:01.269329    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
May 28 10:00:01.276701 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:01.276679    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw"]
May 28 10:00:01.348119 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:01.348098    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/74c85c82-1ba4-4c91-982b-14228f9ed915-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-kljfw\" (UID: \"74c85c82-1ba4-4c91-982b-14228f9ed915\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw"
May 28 10:00:01.348259 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:01.348127    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/74c85c82-1ba4-4c91-982b-14228f9ed915-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-kljfw\" (UID: \"74c85c82-1ba4-4c91-982b-14228f9ed915\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw"
May 28 10:00:01.348259 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:01.348160    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/74c85c82-1ba4-4c91-982b-14228f9ed915-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-kljfw\" (UID: \"74c85c82-1ba4-4c91-982b-14228f9ed915\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw"
May 28 10:00:01.348259 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:01.348201    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/74c85c82-1ba4-4c91-982b-14228f9ed915-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-kljfw\" (UID: \"74c85c82-1ba4-4c91-982b-14228f9ed915\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw"
May 28 10:00:01.348381 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:01.348256    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/74c85c82-1ba4-4c91-982b-14228f9ed915-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-kljfw\" (UID: \"74c85c82-1ba4-4c91-982b-14228f9ed915\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw"
May 28 10:00:01.348381 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:01.348284    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ngfcl\" (UniqueName: \"kubernetes.io/projected/74c85c82-1ba4-4c91-982b-14228f9ed915-kube-api-access-ngfcl\") pod \"feast-simple-feast-remote-setup-5cff94746b-kljfw\" (UID: \"74c85c82-1ba4-4c91-982b-14228f9ed915\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw"
May 28 10:00:01.449142 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:01.449113    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/74c85c82-1ba4-4c91-982b-14228f9ed915-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-kljfw\" (UID: \"74c85c82-1ba4-4c91-982b-14228f9ed915\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw"
May 28 10:00:01.449323 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:01.449148    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/74c85c82-1ba4-4c91-982b-14228f9ed915-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-kljfw\" (UID: \"74c85c82-1ba4-4c91-982b-14228f9ed915\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw"
May 28 10:00:01.449323 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:01.449178    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/74c85c82-1ba4-4c91-982b-14228f9ed915-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-kljfw\" (UID: \"74c85c82-1ba4-4c91-982b-14228f9ed915\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw"
May 28 10:00:01.449323 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:01.449210    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/74c85c82-1ba4-4c91-982b-14228f9ed915-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-kljfw\" (UID: \"74c85c82-1ba4-4c91-982b-14228f9ed915\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw"
May 28 10:00:01.449323 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:01.449251    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/74c85c82-1ba4-4c91-982b-14228f9ed915-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-kljfw\" (UID: \"74c85c82-1ba4-4c91-982b-14228f9ed915\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw"
May 28 10:00:01.449323 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:01.449282    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ngfcl\" (UniqueName: \"kubernetes.io/projected/74c85c82-1ba4-4c91-982b-14228f9ed915-kube-api-access-ngfcl\") pod \"feast-simple-feast-remote-setup-5cff94746b-kljfw\" (UID: \"74c85c82-1ba4-4c91-982b-14228f9ed915\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw"
May 28 10:00:01.449563 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:01.449522    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/74c85c82-1ba4-4c91-982b-14228f9ed915-feast-data\") pod \"feast-simple-feast-remote-setup-5cff94746b-kljfw\" (UID: \"74c85c82-1ba4-4c91-982b-14228f9ed915\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw"
May 28 10:00:01.449885 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:01.449856    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/74c85c82-1ba4-4c91-982b-14228f9ed915-registry-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-kljfw\" (UID: \"74c85c82-1ba4-4c91-982b-14228f9ed915\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw"
May 28 10:00:01.451632 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:01.451610    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/74c85c82-1ba4-4c91-982b-14228f9ed915-ui-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-kljfw\" (UID: \"74c85c82-1ba4-4c91-982b-14228f9ed915\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw"
May 28 10:00:01.451785 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:01.451666    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/74c85c82-1ba4-4c91-982b-14228f9ed915-offline-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-kljfw\" (UID: \"74c85c82-1ba4-4c91-982b-14228f9ed915\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw"
May 28 10:00:01.451848 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:01.451786    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/74c85c82-1ba4-4c91-982b-14228f9ed915-online-tls\") pod \"feast-simple-feast-remote-setup-5cff94746b-kljfw\" (UID: \"74c85c82-1ba4-4c91-982b-14228f9ed915\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw"
May 28 10:00:01.458185 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:01.458167    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ngfcl\" (UniqueName: \"kubernetes.io/projected/74c85c82-1ba4-4c91-982b-14228f9ed915-kube-api-access-ngfcl\") pod \"feast-simple-feast-remote-setup-5cff94746b-kljfw\" (UID: \"74c85c82-1ba4-4c91-982b-14228f9ed915\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw"
May 28 10:00:01.576123 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:01.576043    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw"
May 28 10:00:01.701667 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:01.701642    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw"]
May 28 10:00:01.703714 ip-10-0-138-49 kubenswrapper[2578]: W0528 10:00:01.703681    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod74c85c82_1ba4_4c91_982b_14228f9ed915.slice/crio-51dadcaacb27d62a11dccb84115b9c8f2d6157fb281fa75f13ff6e99ee577d2b WatchSource:0}: Error finding container 51dadcaacb27d62a11dccb84115b9c8f2d6157fb281fa75f13ff6e99ee577d2b: Status 404 returned error can't find the container with id 51dadcaacb27d62a11dccb84115b9c8f2d6157fb281fa75f13ff6e99ee577d2b
May 28 10:00:02.685072 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:02.685036    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw" event={"ID":"74c85c82-1ba4-4c91-982b-14228f9ed915","Type":"ContainerStarted","Data":"90133cd189c1b89db9bbe97ff1f79fffd44136165766e9f2314a0d907aef16a3"}
May 28 10:00:02.685072 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:02.685076    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw" event={"ID":"74c85c82-1ba4-4c91-982b-14228f9ed915","Type":"ContainerStarted","Data":"51dadcaacb27d62a11dccb84115b9c8f2d6157fb281fa75f13ff6e99ee577d2b"}
May 28 10:00:06.696807 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:06.696776    2578 generic.go:358] "Generic (PLEG): container finished" podID="74c85c82-1ba4-4c91-982b-14228f9ed915" containerID="90133cd189c1b89db9bbe97ff1f79fffd44136165766e9f2314a0d907aef16a3" exitCode=0
May 28 10:00:06.696807 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:06.696814    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw" event={"ID":"74c85c82-1ba4-4c91-982b-14228f9ed915","Type":"ContainerDied","Data":"90133cd189c1b89db9bbe97ff1f79fffd44136165766e9f2314a0d907aef16a3"}
May 28 10:00:07.701255 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:07.701207    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw" event={"ID":"74c85c82-1ba4-4c91-982b-14228f9ed915","Type":"ContainerStarted","Data":"36533e1a6281b83ec78c398c1d0d65c2c96df0699284c80cf1c86843a4bb8401"}
May 28 10:00:12.717796 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:12.717764    2578 generic.go:358] "Generic (PLEG): container finished" podID="74c85c82-1ba4-4c91-982b-14228f9ed915" containerID="36533e1a6281b83ec78c398c1d0d65c2c96df0699284c80cf1c86843a4bb8401" exitCode=0
May 28 10:00:12.718135 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:12.717825    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw" event={"ID":"74c85c82-1ba4-4c91-982b-14228f9ed915","Type":"ContainerDied","Data":"36533e1a6281b83ec78c398c1d0d65c2c96df0699284c80cf1c86843a4bb8401"}
May 28 10:00:13.723935 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:13.723890    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw" event={"ID":"74c85c82-1ba4-4c91-982b-14228f9ed915","Type":"ContainerStarted","Data":"148fe0c7dd1957fbbb52975e3cf76407acb24e694708a0dbfb9fb1106afb8595"}
May 28 10:00:13.724310 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:13.723948    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw" event={"ID":"74c85c82-1ba4-4c91-982b-14228f9ed915","Type":"ContainerStarted","Data":"722ff2d3f680c7db62af396d69b6f11cbb8dbd52350b8ca97b21f647a09d80fc"}
May 28 10:00:13.724310 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:13.723965    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw" event={"ID":"74c85c82-1ba4-4c91-982b-14228f9ed915","Type":"ContainerStarted","Data":"b6ef2d8cd265663c17da1c743ce1e76470fc9a86c46c5e463a4de0c190674925"}
May 28 10:00:13.750614 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:13.750571    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw" podStartSLOduration=12.750557006 podStartE2EDuration="12.750557006s" podCreationTimestamp="2026-05-28 10:00:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 10:00:13.748127158 +0000 UTC m=+1726.207872803" watchObservedRunningTime="2026-05-28 10:00:13.750557006 +0000 UTC m=+1726.210302651"
May 28 10:00:16.576489 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:16.576449    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw"
May 28 10:00:16.577074 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:16.577039    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw"
May 28 10:00:16.577074 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:16.577068    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw"
May 28 10:00:16.577752 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:16.577700    2578 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw" podUID="74c85c82-1ba4-4c91-982b-14228f9ed915" containerName="offline" probeResult="failure" output="dial tcp 10.132.0.26:8816: connect: connection refused"
May 28 10:00:16.577752 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:16.577720    2578 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw" podUID="74c85c82-1ba4-4c91-982b-14228f9ed915" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused"
May 28 10:00:16.577927 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:16.577757    2578 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw" podUID="74c85c82-1ba4-4c91-982b-14228f9ed915" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused"
May 28 10:00:19.577113 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:19.577081    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw"
May 28 10:00:19.577539 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:19.577426    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw"
May 28 10:00:19.577678 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:19.577644    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw"
May 28 10:00:19.577678 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:19.577677    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw"
May 28 10:00:19.577885 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:19.577866    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw"
May 28 10:00:19.577995 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:19.577954    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw"
May 28 10:00:19.581293 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:19.581276    2578 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw"
May 28 10:00:19.742468 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:19.742450    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw"
May 28 10:00:19.745182 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:00:19.745161    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw"
May 28 10:01:22.187368 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:22.187337    2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw"]
May 28 10:01:22.187816 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:22.187646    2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw" podUID="74c85c82-1ba4-4c91-982b-14228f9ed915" containerName="online" containerID="cri-o://b6ef2d8cd265663c17da1c743ce1e76470fc9a86c46c5e463a4de0c190674925" gracePeriod=30
May 28 10:01:22.187816 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:22.187684    2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw" podUID="74c85c82-1ba4-4c91-982b-14228f9ed915" containerName="ui" containerID="cri-o://148fe0c7dd1957fbbb52975e3cf76407acb24e694708a0dbfb9fb1106afb8595" gracePeriod=30
May 28 10:01:22.187816 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:22.187693    2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw" podUID="74c85c82-1ba4-4c91-982b-14228f9ed915" containerName="offline" containerID="cri-o://722ff2d3f680c7db62af396d69b6f11cbb8dbd52350b8ca97b21f647a09d80fc" gracePeriod=30
May 28 10:01:22.403551 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:22.403514    2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq"]
May 28 10:01:22.404175 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:22.404001    2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq" podUID="951e047c-78a3-40b4-b1a1-0c6b17619d17" containerName="registry" containerID="cri-o://fd8406608fc104c0f269bc81f907d279bb71770b261a7265f69a5a1bcdc55785" gracePeriod=30
May 28 10:01:22.404175 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:22.404051    2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq" podUID="951e047c-78a3-40b4-b1a1-0c6b17619d17" containerName="ui" containerID="cri-o://a796706b61d726190cb08b906327683c25ece4f6242aae5a3fdc4685cb84cb82" gracePeriod=30
May 28 10:01:22.404175 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:22.404060    2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq" podUID="951e047c-78a3-40b4-b1a1-0c6b17619d17" containerName="offline" containerID="cri-o://991624b5164a1753af3352cec2246781ce1ab4f41c67258dce57cd21c901e88a" gracePeriod=30
May 28 10:01:22.404175 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:22.404063    2578 kuberuntime_container.go:864] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq" podUID="951e047c-78a3-40b4-b1a1-0c6b17619d17" containerName="online" containerID="cri-o://c5ee75a8f311aeb37fa8992190dce9956fb66b653665197912a9ff7e5e730bbb" gracePeriod=30
May 28 10:01:22.913949 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:22.913913    2578 generic.go:358] "Generic (PLEG): container finished" podID="74c85c82-1ba4-4c91-982b-14228f9ed915" containerID="148fe0c7dd1957fbbb52975e3cf76407acb24e694708a0dbfb9fb1106afb8595" exitCode=0
May 28 10:01:22.914141 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:22.913971    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw" event={"ID":"74c85c82-1ba4-4c91-982b-14228f9ed915","Type":"ContainerDied","Data":"148fe0c7dd1957fbbb52975e3cf76407acb24e694708a0dbfb9fb1106afb8595"}
May 28 10:01:23.918751 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:23.918717    2578 generic.go:358] "Generic (PLEG): container finished" podID="74c85c82-1ba4-4c91-982b-14228f9ed915" containerID="b6ef2d8cd265663c17da1c743ce1e76470fc9a86c46c5e463a4de0c190674925" exitCode=0
May 28 10:01:23.919132 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:23.918790    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw" event={"ID":"74c85c82-1ba4-4c91-982b-14228f9ed915","Type":"ContainerDied","Data":"b6ef2d8cd265663c17da1c743ce1e76470fc9a86c46c5e463a4de0c190674925"}
May 28 10:01:23.921142 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:23.921122    2578 generic.go:358] "Generic (PLEG): container finished" podID="951e047c-78a3-40b4-b1a1-0c6b17619d17" containerID="a796706b61d726190cb08b906327683c25ece4f6242aae5a3fdc4685cb84cb82" exitCode=0
May 28 10:01:23.921142 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:23.921140    2578 generic.go:358] "Generic (PLEG): container finished" podID="951e047c-78a3-40b4-b1a1-0c6b17619d17" containerID="c5ee75a8f311aeb37fa8992190dce9956fb66b653665197912a9ff7e5e730bbb" exitCode=0
May 28 10:01:23.921324 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:23.921160    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq" event={"ID":"951e047c-78a3-40b4-b1a1-0c6b17619d17","Type":"ContainerDied","Data":"a796706b61d726190cb08b906327683c25ece4f6242aae5a3fdc4685cb84cb82"}
May 28 10:01:23.921324 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:23.921178    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq" event={"ID":"951e047c-78a3-40b4-b1a1-0c6b17619d17","Type":"ContainerDied","Data":"c5ee75a8f311aeb37fa8992190dce9956fb66b653665197912a9ff7e5e730bbb"}
May 28 10:01:28.152622 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:28.152591    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wqcwd_397304a8-87ab-49c0-9fc0-a3ca99f04032/ovn-acl-logging/0.log"
May 28 10:01:28.158502 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:28.158481    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wqcwd_397304a8-87ab-49c0-9fc0-a3ca99f04032/ovn-acl-logging/0.log"
May 28 10:01:28.812127 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:28.812082    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq" podUID="951e047c-78a3-40b4-b1a1-0c6b17619d17" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.25:8443: connect: connection refused"
May 28 10:01:29.514175 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:29.514134    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq" podUID="951e047c-78a3-40b4-b1a1-0c6b17619d17" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused"
May 28 10:01:29.578401 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:29.578363    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw" podUID="74c85c82-1ba4-4c91-982b-14228f9ed915" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused"
May 28 10:01:29.743417 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:29.743385    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw" podUID="74c85c82-1ba4-4c91-982b-14228f9ed915" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused"
May 28 10:01:38.811883 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:38.811837    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq" podUID="951e047c-78a3-40b4-b1a1-0c6b17619d17" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.25:8443: connect: connection refused"
May 28 10:01:39.513580 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:39.513542    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq" podUID="951e047c-78a3-40b4-b1a1-0c6b17619d17" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused"
May 28 10:01:39.578444 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:39.578407    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw" podUID="74c85c82-1ba4-4c91-982b-14228f9ed915" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused"
May 28 10:01:39.743202 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:39.743168    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw" podUID="74c85c82-1ba4-4c91-982b-14228f9ed915" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused"
May 28 10:01:48.812001 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:48.811960    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq" podUID="951e047c-78a3-40b4-b1a1-0c6b17619d17" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.25:8443: connect: connection refused"
May 28 10:01:48.812544 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:48.812120    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq"
May 28 10:01:49.514234 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:49.514183    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq" podUID="951e047c-78a3-40b4-b1a1-0c6b17619d17" containerName="online" probeResult="failure" output="Get \"https://10.132.0.25:6567/health\": dial tcp 10.132.0.25:6567: connect: connection refused"
May 28 10:01:49.514396 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:49.514310    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq"
May 28 10:01:49.578368 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:49.578328    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw" podUID="74c85c82-1ba4-4c91-982b-14228f9ed915" containerName="ui" probeResult="failure" output="dial tcp 10.132.0.26:8443: connect: connection refused"
May 28 10:01:49.578506 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:49.578453    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw"
May 28 10:01:49.743344 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:49.743310    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw" podUID="74c85c82-1ba4-4c91-982b-14228f9ed915" containerName="online" probeResult="failure" output="Get \"https://10.132.0.26:6567/health\": dial tcp 10.132.0.26:6567: connect: connection refused"
May 28 10:01:49.743491 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:49.743453    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw"
May 28 10:01:52.825271 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:52.825250    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw"
May 28 10:01:52.950734 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:52.950703    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/74c85c82-1ba4-4c91-982b-14228f9ed915-feast-data\") pod \"74c85c82-1ba4-4c91-982b-14228f9ed915\" (UID: \"74c85c82-1ba4-4c91-982b-14228f9ed915\") "
May 28 10:01:52.950901 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:52.950742    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/74c85c82-1ba4-4c91-982b-14228f9ed915-ui-tls\") pod \"74c85c82-1ba4-4c91-982b-14228f9ed915\" (UID: \"74c85c82-1ba4-4c91-982b-14228f9ed915\") "
May 28 10:01:52.950901 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:52.950769    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/74c85c82-1ba4-4c91-982b-14228f9ed915-offline-tls\") pod \"74c85c82-1ba4-4c91-982b-14228f9ed915\" (UID: \"74c85c82-1ba4-4c91-982b-14228f9ed915\") "
May 28 10:01:52.950901 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:52.950789    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/74c85c82-1ba4-4c91-982b-14228f9ed915-registry-tls\") pod \"74c85c82-1ba4-4c91-982b-14228f9ed915\" (UID: \"74c85c82-1ba4-4c91-982b-14228f9ed915\") "
May 28 10:01:52.950901 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:52.950863    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ngfcl\" (UniqueName: \"kubernetes.io/projected/74c85c82-1ba4-4c91-982b-14228f9ed915-kube-api-access-ngfcl\") pod \"74c85c82-1ba4-4c91-982b-14228f9ed915\" (UID: \"74c85c82-1ba4-4c91-982b-14228f9ed915\") "
May 28 10:01:52.950901 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:52.950892    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/74c85c82-1ba4-4c91-982b-14228f9ed915-online-tls\") pod \"74c85c82-1ba4-4c91-982b-14228f9ed915\" (UID: \"74c85c82-1ba4-4c91-982b-14228f9ed915\") "
May 28 10:01:52.951310 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:52.951270    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74c85c82-1ba4-4c91-982b-14228f9ed915-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "74c85c82-1ba4-4c91-982b-14228f9ed915" (UID: "74c85c82-1ba4-4c91-982b-14228f9ed915"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 10:01:52.951440 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:52.951345    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74c85c82-1ba4-4c91-982b-14228f9ed915-feast-data" (OuterVolumeSpecName: "feast-data") pod "74c85c82-1ba4-4c91-982b-14228f9ed915" (UID: "74c85c82-1ba4-4c91-982b-14228f9ed915"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 10:01:52.953071 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:52.953016    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74c85c82-1ba4-4c91-982b-14228f9ed915-online-tls" (OuterVolumeSpecName: "online-tls") pod "74c85c82-1ba4-4c91-982b-14228f9ed915" (UID: "74c85c82-1ba4-4c91-982b-14228f9ed915"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:01:52.953153 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:52.953068    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74c85c82-1ba4-4c91-982b-14228f9ed915-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "74c85c82-1ba4-4c91-982b-14228f9ed915" (UID: "74c85c82-1ba4-4c91-982b-14228f9ed915"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:01:52.953153 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:52.953094    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74c85c82-1ba4-4c91-982b-14228f9ed915-kube-api-access-ngfcl" (OuterVolumeSpecName: "kube-api-access-ngfcl") pod "74c85c82-1ba4-4c91-982b-14228f9ed915" (UID: "74c85c82-1ba4-4c91-982b-14228f9ed915"). InnerVolumeSpecName "kube-api-access-ngfcl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 10:01:52.953281 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:52.953183    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/74c85c82-1ba4-4c91-982b-14228f9ed915-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "74c85c82-1ba4-4c91-982b-14228f9ed915" (UID: "74c85c82-1ba4-4c91-982b-14228f9ed915"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:01:52.996525 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:52.996497    2578 generic.go:358] "Generic (PLEG): container finished" podID="951e047c-78a3-40b4-b1a1-0c6b17619d17" containerID="991624b5164a1753af3352cec2246781ce1ab4f41c67258dce57cd21c901e88a" exitCode=137
May 28 10:01:52.996525 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:52.996521    2578 generic.go:358] "Generic (PLEG): container finished" podID="951e047c-78a3-40b4-b1a1-0c6b17619d17" containerID="fd8406608fc104c0f269bc81f907d279bb71770b261a7265f69a5a1bcdc55785" exitCode=137
May 28 10:01:52.996762 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:52.996580    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq" event={"ID":"951e047c-78a3-40b4-b1a1-0c6b17619d17","Type":"ContainerDied","Data":"991624b5164a1753af3352cec2246781ce1ab4f41c67258dce57cd21c901e88a"}
May 28 10:01:52.996762 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:52.996622    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq" event={"ID":"951e047c-78a3-40b4-b1a1-0c6b17619d17","Type":"ContainerDied","Data":"fd8406608fc104c0f269bc81f907d279bb71770b261a7265f69a5a1bcdc55785"}
May 28 10:01:52.998951 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:52.998932    2578 generic.go:358] "Generic (PLEG): container finished" podID="74c85c82-1ba4-4c91-982b-14228f9ed915" containerID="722ff2d3f680c7db62af396d69b6f11cbb8dbd52350b8ca97b21f647a09d80fc" exitCode=137
May 28 10:01:52.999045 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:52.998995    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw" event={"ID":"74c85c82-1ba4-4c91-982b-14228f9ed915","Type":"ContainerDied","Data":"722ff2d3f680c7db62af396d69b6f11cbb8dbd52350b8ca97b21f647a09d80fc"}
May 28 10:01:52.999045 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:52.999019    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw" event={"ID":"74c85c82-1ba4-4c91-982b-14228f9ed915","Type":"ContainerDied","Data":"51dadcaacb27d62a11dccb84115b9c8f2d6157fb281fa75f13ff6e99ee577d2b"}
May 28 10:01:52.999045 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:52.999025    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw"
May 28 10:01:52.999045 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:52.999036    2578 scope.go:117] "RemoveContainer" containerID="148fe0c7dd1957fbbb52975e3cf76407acb24e694708a0dbfb9fb1106afb8595"
May 28 10:01:53.013133 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:53.011888    2578 scope.go:117] "RemoveContainer" containerID="722ff2d3f680c7db62af396d69b6f11cbb8dbd52350b8ca97b21f647a09d80fc"
May 28 10:01:53.020001 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:53.019976    2578 scope.go:117] "RemoveContainer" containerID="b6ef2d8cd265663c17da1c743ce1e76470fc9a86c46c5e463a4de0c190674925"
May 28 10:01:53.026989 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:53.026964    2578 scope.go:117] "RemoveContainer" containerID="36533e1a6281b83ec78c398c1d0d65c2c96df0699284c80cf1c86843a4bb8401"
May 28 10:01:53.028012 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:53.027990    2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw"]
May 28 10:01:53.034358 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:53.034327    2578 scope.go:117] "RemoveContainer" containerID="90133cd189c1b89db9bbe97ff1f79fffd44136165766e9f2314a0d907aef16a3"
May 28 10:01:53.035610 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:53.035588    2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-5cff94746b-kljfw"]
May 28 10:01:53.041177 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:53.041161    2578 scope.go:117] "RemoveContainer" containerID="148fe0c7dd1957fbbb52975e3cf76407acb24e694708a0dbfb9fb1106afb8595"
May 28 10:01:53.041417 ip-10-0-138-49 kubenswrapper[2578]: E0528 10:01:53.041401    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"148fe0c7dd1957fbbb52975e3cf76407acb24e694708a0dbfb9fb1106afb8595\": container with ID starting with 148fe0c7dd1957fbbb52975e3cf76407acb24e694708a0dbfb9fb1106afb8595 not found: ID does not exist" containerID="148fe0c7dd1957fbbb52975e3cf76407acb24e694708a0dbfb9fb1106afb8595"
May 28 10:01:53.041493 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:53.041430    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"148fe0c7dd1957fbbb52975e3cf76407acb24e694708a0dbfb9fb1106afb8595"} err="failed to get container status \"148fe0c7dd1957fbbb52975e3cf76407acb24e694708a0dbfb9fb1106afb8595\": rpc error: code = NotFound desc = could not find container \"148fe0c7dd1957fbbb52975e3cf76407acb24e694708a0dbfb9fb1106afb8595\": container with ID starting with 148fe0c7dd1957fbbb52975e3cf76407acb24e694708a0dbfb9fb1106afb8595 not found: ID does not exist"
May 28 10:01:53.041493 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:53.041455    2578 scope.go:117] "RemoveContainer" containerID="722ff2d3f680c7db62af396d69b6f11cbb8dbd52350b8ca97b21f647a09d80fc"
May 28 10:01:53.041670 ip-10-0-138-49 kubenswrapper[2578]: E0528 10:01:53.041655    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"722ff2d3f680c7db62af396d69b6f11cbb8dbd52350b8ca97b21f647a09d80fc\": container with ID starting with 722ff2d3f680c7db62af396d69b6f11cbb8dbd52350b8ca97b21f647a09d80fc not found: ID does not exist" containerID="722ff2d3f680c7db62af396d69b6f11cbb8dbd52350b8ca97b21f647a09d80fc"
May 28 10:01:53.041730 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:53.041677    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"722ff2d3f680c7db62af396d69b6f11cbb8dbd52350b8ca97b21f647a09d80fc"} err="failed to get container status \"722ff2d3f680c7db62af396d69b6f11cbb8dbd52350b8ca97b21f647a09d80fc\": rpc error: code = NotFound desc = could not find container \"722ff2d3f680c7db62af396d69b6f11cbb8dbd52350b8ca97b21f647a09d80fc\": container with ID starting with 722ff2d3f680c7db62af396d69b6f11cbb8dbd52350b8ca97b21f647a09d80fc not found: ID does not exist"
May 28 10:01:53.041730 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:53.041698    2578 scope.go:117] "RemoveContainer" containerID="b6ef2d8cd265663c17da1c743ce1e76470fc9a86c46c5e463a4de0c190674925"
May 28 10:01:53.041943 ip-10-0-138-49 kubenswrapper[2578]: E0528 10:01:53.041927    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6ef2d8cd265663c17da1c743ce1e76470fc9a86c46c5e463a4de0c190674925\": container with ID starting with b6ef2d8cd265663c17da1c743ce1e76470fc9a86c46c5e463a4de0c190674925 not found: ID does not exist" containerID="b6ef2d8cd265663c17da1c743ce1e76470fc9a86c46c5e463a4de0c190674925"
May 28 10:01:53.041980 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:53.041948    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6ef2d8cd265663c17da1c743ce1e76470fc9a86c46c5e463a4de0c190674925"} err="failed to get container status \"b6ef2d8cd265663c17da1c743ce1e76470fc9a86c46c5e463a4de0c190674925\": rpc error: code = NotFound desc = could not find container \"b6ef2d8cd265663c17da1c743ce1e76470fc9a86c46c5e463a4de0c190674925\": container with ID starting with b6ef2d8cd265663c17da1c743ce1e76470fc9a86c46c5e463a4de0c190674925 not found: ID does not exist"
May 28 10:01:53.041980 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:53.041963    2578 scope.go:117] "RemoveContainer" containerID="36533e1a6281b83ec78c398c1d0d65c2c96df0699284c80cf1c86843a4bb8401"
May 28 10:01:53.042181 ip-10-0-138-49 kubenswrapper[2578]: E0528 10:01:53.042162    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36533e1a6281b83ec78c398c1d0d65c2c96df0699284c80cf1c86843a4bb8401\": container with ID starting with 36533e1a6281b83ec78c398c1d0d65c2c96df0699284c80cf1c86843a4bb8401 not found: ID does not exist" containerID="36533e1a6281b83ec78c398c1d0d65c2c96df0699284c80cf1c86843a4bb8401"
May 28 10:01:53.042326 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:53.042186    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36533e1a6281b83ec78c398c1d0d65c2c96df0699284c80cf1c86843a4bb8401"} err="failed to get container status \"36533e1a6281b83ec78c398c1d0d65c2c96df0699284c80cf1c86843a4bb8401\": rpc error: code = NotFound desc = could not find container \"36533e1a6281b83ec78c398c1d0d65c2c96df0699284c80cf1c86843a4bb8401\": container with ID starting with 36533e1a6281b83ec78c398c1d0d65c2c96df0699284c80cf1c86843a4bb8401 not found: ID does not exist"
May 28 10:01:53.042326 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:53.042201    2578 scope.go:117] "RemoveContainer" containerID="90133cd189c1b89db9bbe97ff1f79fffd44136165766e9f2314a0d907aef16a3"
May 28 10:01:53.042453 ip-10-0-138-49 kubenswrapper[2578]: E0528 10:01:53.042421    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90133cd189c1b89db9bbe97ff1f79fffd44136165766e9f2314a0d907aef16a3\": container with ID starting with 90133cd189c1b89db9bbe97ff1f79fffd44136165766e9f2314a0d907aef16a3 not found: ID does not exist" containerID="90133cd189c1b89db9bbe97ff1f79fffd44136165766e9f2314a0d907aef16a3"
May 28 10:01:53.042497 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:53.042445    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90133cd189c1b89db9bbe97ff1f79fffd44136165766e9f2314a0d907aef16a3"} err="failed to get container status \"90133cd189c1b89db9bbe97ff1f79fffd44136165766e9f2314a0d907aef16a3\": rpc error: code = NotFound desc = could not find container \"90133cd189c1b89db9bbe97ff1f79fffd44136165766e9f2314a0d907aef16a3\": container with ID starting with 90133cd189c1b89db9bbe97ff1f79fffd44136165766e9f2314a0d907aef16a3 not found: ID does not exist"
May 28 10:01:53.044611 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:53.044597    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq"
May 28 10:01:53.052184 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:53.052167    2578 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/74c85c82-1ba4-4c91-982b-14228f9ed915-feast-data\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 10:01:53.052184 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:53.052184    2578 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/74c85c82-1ba4-4c91-982b-14228f9ed915-ui-tls\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 10:01:53.052317 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:53.052193    2578 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/74c85c82-1ba4-4c91-982b-14228f9ed915-offline-tls\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 10:01:53.052317 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:53.052201    2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/74c85c82-1ba4-4c91-982b-14228f9ed915-registry-tls\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 10:01:53.052317 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:53.052210    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ngfcl\" (UniqueName: \"kubernetes.io/projected/74c85c82-1ba4-4c91-982b-14228f9ed915-kube-api-access-ngfcl\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 10:01:53.052317 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:53.052238    2578 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/74c85c82-1ba4-4c91-982b-14228f9ed915-online-tls\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 10:01:53.153138 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:53.153117    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/951e047c-78a3-40b4-b1a1-0c6b17619d17-registry-tls\") pod \"951e047c-78a3-40b4-b1a1-0c6b17619d17\" (UID: \"951e047c-78a3-40b4-b1a1-0c6b17619d17\") "
May 28 10:01:53.153280 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:53.153150    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/951e047c-78a3-40b4-b1a1-0c6b17619d17-ui-tls\") pod \"951e047c-78a3-40b4-b1a1-0c6b17619d17\" (UID: \"951e047c-78a3-40b4-b1a1-0c6b17619d17\") "
May 28 10:01:53.153280 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:53.153173    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/951e047c-78a3-40b4-b1a1-0c6b17619d17-offline-tls\") pod \"951e047c-78a3-40b4-b1a1-0c6b17619d17\" (UID: \"951e047c-78a3-40b4-b1a1-0c6b17619d17\") "
May 28 10:01:53.153280 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:53.153199    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/951e047c-78a3-40b4-b1a1-0c6b17619d17-online-tls\") pod \"951e047c-78a3-40b4-b1a1-0c6b17619d17\" (UID: \"951e047c-78a3-40b4-b1a1-0c6b17619d17\") "
May 28 10:01:53.153280 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:53.153263    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-88q2t\" (UniqueName: \"kubernetes.io/projected/951e047c-78a3-40b4-b1a1-0c6b17619d17-kube-api-access-88q2t\") pod \"951e047c-78a3-40b4-b1a1-0c6b17619d17\" (UID: \"951e047c-78a3-40b4-b1a1-0c6b17619d17\") "
May 28 10:01:53.153280 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:53.153281    2578 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/951e047c-78a3-40b4-b1a1-0c6b17619d17-feast-data\") pod \"951e047c-78a3-40b4-b1a1-0c6b17619d17\" (UID: \"951e047c-78a3-40b4-b1a1-0c6b17619d17\") "
May 28 10:01:53.153894 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:53.153856    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/951e047c-78a3-40b4-b1a1-0c6b17619d17-feast-data" (OuterVolumeSpecName: "feast-data") pod "951e047c-78a3-40b4-b1a1-0c6b17619d17" (UID: "951e047c-78a3-40b4-b1a1-0c6b17619d17"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 10:01:53.155160 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:53.155136    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/951e047c-78a3-40b4-b1a1-0c6b17619d17-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "951e047c-78a3-40b4-b1a1-0c6b17619d17" (UID: "951e047c-78a3-40b4-b1a1-0c6b17619d17"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:01:53.155271 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:53.155254    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/951e047c-78a3-40b4-b1a1-0c6b17619d17-kube-api-access-88q2t" (OuterVolumeSpecName: "kube-api-access-88q2t") pod "951e047c-78a3-40b4-b1a1-0c6b17619d17" (UID: "951e047c-78a3-40b4-b1a1-0c6b17619d17"). InnerVolumeSpecName "kube-api-access-88q2t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 10:01:53.155330 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:53.155273    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/951e047c-78a3-40b4-b1a1-0c6b17619d17-online-tls" (OuterVolumeSpecName: "online-tls") pod "951e047c-78a3-40b4-b1a1-0c6b17619d17" (UID: "951e047c-78a3-40b4-b1a1-0c6b17619d17"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:01:53.155631 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:53.155612    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/951e047c-78a3-40b4-b1a1-0c6b17619d17-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "951e047c-78a3-40b4-b1a1-0c6b17619d17" (UID: "951e047c-78a3-40b4-b1a1-0c6b17619d17"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:01:53.155714 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:53.155632    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/951e047c-78a3-40b4-b1a1-0c6b17619d17-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "951e047c-78a3-40b4-b1a1-0c6b17619d17" (UID: "951e047c-78a3-40b4-b1a1-0c6b17619d17"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 10:01:53.254070 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:53.254018    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-88q2t\" (UniqueName: \"kubernetes.io/projected/951e047c-78a3-40b4-b1a1-0c6b17619d17-kube-api-access-88q2t\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 10:01:53.254070 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:53.254042    2578 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/951e047c-78a3-40b4-b1a1-0c6b17619d17-feast-data\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 10:01:53.254070 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:53.254051    2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/951e047c-78a3-40b4-b1a1-0c6b17619d17-registry-tls\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 10:01:53.254070 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:53.254059    2578 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/951e047c-78a3-40b4-b1a1-0c6b17619d17-ui-tls\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 10:01:53.254070 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:53.254066    2578 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/951e047c-78a3-40b4-b1a1-0c6b17619d17-offline-tls\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 10:01:53.254070 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:53.254074    2578 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/951e047c-78a3-40b4-b1a1-0c6b17619d17-online-tls\") on node \"ip-10-0-138-49.ec2.internal\" DevicePath \"\""
May 28 10:01:54.003979 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:54.003951    2578 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq"
May 28 10:01:54.004416 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:54.003944    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq" event={"ID":"951e047c-78a3-40b4-b1a1-0c6b17619d17","Type":"ContainerDied","Data":"cb7e4548e629e49e128248b72197761855e34cf40f07361cdf75ef7b99aaa30d"}
May 28 10:01:54.004416 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:54.004073    2578 scope.go:117] "RemoveContainer" containerID="a796706b61d726190cb08b906327683c25ece4f6242aae5a3fdc4685cb84cb82"
May 28 10:01:54.012932 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:54.012918    2578 scope.go:117] "RemoveContainer" containerID="991624b5164a1753af3352cec2246781ce1ab4f41c67258dce57cd21c901e88a"
May 28 10:01:54.019661 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:54.019640    2578 scope.go:117] "RemoveContainer" containerID="c5ee75a8f311aeb37fa8992190dce9956fb66b653665197912a9ff7e5e730bbb"
May 28 10:01:54.025855 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:54.025839    2578 scope.go:117] "RemoveContainer" containerID="fd8406608fc104c0f269bc81f907d279bb71770b261a7265f69a5a1bcdc55785"
May 28 10:01:54.028199 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:54.028180    2578 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq"]
May 28 10:01:54.032902 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:54.032885    2578 scope.go:117] "RemoveContainer" containerID="b8de34428bbd1092f2805c5f4347cb25e657d4ebf4c68b6525c1cb4bf81a6fe1"
May 28 10:01:54.034029 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:54.034013    2578 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-664fcfcc58-s59vq"]
May 28 10:01:54.039187 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:54.039170    2578 scope.go:117] "RemoveContainer" containerID="d124975a83d2f8114bcc17b9fa6be4e1589e147f77207d60eb9c3b6924d00935"
May 28 10:01:54.104532 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:54.104508    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74c85c82-1ba4-4c91-982b-14228f9ed915" path="/var/lib/kubelet/pods/74c85c82-1ba4-4c91-982b-14228f9ed915/volumes"
May 28 10:01:54.105013 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:01:54.105001    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="951e047c-78a3-40b4-b1a1-0c6b17619d17" path="/var/lib/kubelet/pods/951e047c-78a3-40b4-b1a1-0c6b17619d17/volumes"
May 28 10:02:30.059972 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:30.059936    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4wzj6/must-gather-755jg"]
May 28 10:02:30.060386 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:30.060169    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="951e047c-78a3-40b4-b1a1-0c6b17619d17" containerName="ui"
May 28 10:02:30.060386 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:30.060181    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="951e047c-78a3-40b4-b1a1-0c6b17619d17" containerName="ui"
May 28 10:02:30.060386 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:30.060192    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="951e047c-78a3-40b4-b1a1-0c6b17619d17" containerName="feast-apply"
May 28 10:02:30.060386 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:30.060198    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="951e047c-78a3-40b4-b1a1-0c6b17619d17" containerName="feast-apply"
May 28 10:02:30.060386 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:30.060204    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="951e047c-78a3-40b4-b1a1-0c6b17619d17" containerName="feast-init"
May 28 10:02:30.060386 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:30.060211    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="951e047c-78a3-40b4-b1a1-0c6b17619d17" containerName="feast-init"
May 28 10:02:30.060386 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:30.060232    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74c85c82-1ba4-4c91-982b-14228f9ed915" containerName="feast-init"
May 28 10:02:30.060386 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:30.060238    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="74c85c82-1ba4-4c91-982b-14228f9ed915" containerName="feast-init"
May 28 10:02:30.060386 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:30.060248    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74c85c82-1ba4-4c91-982b-14228f9ed915" containerName="online"
May 28 10:02:30.060386 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:30.060254    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="74c85c82-1ba4-4c91-982b-14228f9ed915" containerName="online"
May 28 10:02:30.060386 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:30.060262    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74c85c82-1ba4-4c91-982b-14228f9ed915" containerName="feast-apply"
May 28 10:02:30.060386 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:30.060267    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="74c85c82-1ba4-4c91-982b-14228f9ed915" containerName="feast-apply"
May 28 10:02:30.060386 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:30.060272    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74c85c82-1ba4-4c91-982b-14228f9ed915" containerName="offline"
May 28 10:02:30.060386 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:30.060277    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="74c85c82-1ba4-4c91-982b-14228f9ed915" containerName="offline"
May 28 10:02:30.060386 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:30.060283    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74c85c82-1ba4-4c91-982b-14228f9ed915" containerName="ui"
May 28 10:02:30.060386 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:30.060288    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="74c85c82-1ba4-4c91-982b-14228f9ed915" containerName="ui"
May 28 10:02:30.060386 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:30.060293    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="951e047c-78a3-40b4-b1a1-0c6b17619d17" containerName="registry"
May 28 10:02:30.060386 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:30.060298    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="951e047c-78a3-40b4-b1a1-0c6b17619d17" containerName="registry"
May 28 10:02:30.060386 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:30.060303    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="951e047c-78a3-40b4-b1a1-0c6b17619d17" containerName="online"
May 28 10:02:30.060386 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:30.060307    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="951e047c-78a3-40b4-b1a1-0c6b17619d17" containerName="online"
May 28 10:02:30.060386 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:30.060313    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="951e047c-78a3-40b4-b1a1-0c6b17619d17" containerName="offline"
May 28 10:02:30.060386 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:30.060318    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="951e047c-78a3-40b4-b1a1-0c6b17619d17" containerName="offline"
May 28 10:02:30.060386 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:30.060367    2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="951e047c-78a3-40b4-b1a1-0c6b17619d17" containerName="offline"
May 28 10:02:30.060386 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:30.060376    2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="74c85c82-1ba4-4c91-982b-14228f9ed915" containerName="online"
May 28 10:02:30.060386 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:30.060382    2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="74c85c82-1ba4-4c91-982b-14228f9ed915" containerName="offline"
May 28 10:02:30.060386 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:30.060388    2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="951e047c-78a3-40b4-b1a1-0c6b17619d17" containerName="online"
May 28 10:02:30.060386 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:30.060394    2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="951e047c-78a3-40b4-b1a1-0c6b17619d17" containerName="ui"
May 28 10:02:30.060386 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:30.060401    2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="74c85c82-1ba4-4c91-982b-14228f9ed915" containerName="ui"
May 28 10:02:30.061291 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:30.060407    2578 memory_manager.go:356] "RemoveStaleState removing state" podUID="951e047c-78a3-40b4-b1a1-0c6b17619d17" containerName="registry"
May 28 10:02:30.064554 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:30.064538    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4wzj6/must-gather-755jg"
May 28 10:02:30.067129 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:30.067107    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4wzj6\"/\"openshift-service-ca.crt\""
May 28 10:02:30.067269 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:30.067110    2578 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4wzj6\"/\"kube-root-ca.crt\""
May 28 10:02:30.067269 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:30.067247    2578 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4wzj6\"/\"default-dockercfg-pftj9\""
May 28 10:02:30.073523 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:30.073503    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4wzj6/must-gather-755jg"]
May 28 10:02:30.099996 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:30.099976    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cbb579ec-9f48-4148-8bbe-78d96dbc31cf-must-gather-output\") pod \"must-gather-755jg\" (UID: \"cbb579ec-9f48-4148-8bbe-78d96dbc31cf\") " pod="openshift-must-gather-4wzj6/must-gather-755jg"
May 28 10:02:30.100085 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:30.100021    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l5cs\" (UniqueName: \"kubernetes.io/projected/cbb579ec-9f48-4148-8bbe-78d96dbc31cf-kube-api-access-7l5cs\") pod \"must-gather-755jg\" (UID: \"cbb579ec-9f48-4148-8bbe-78d96dbc31cf\") " pod="openshift-must-gather-4wzj6/must-gather-755jg"
May 28 10:02:30.201151 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:30.201129    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7l5cs\" (UniqueName: \"kubernetes.io/projected/cbb579ec-9f48-4148-8bbe-78d96dbc31cf-kube-api-access-7l5cs\") pod \"must-gather-755jg\" (UID: \"cbb579ec-9f48-4148-8bbe-78d96dbc31cf\") " pod="openshift-must-gather-4wzj6/must-gather-755jg"
May 28 10:02:30.201260 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:30.201177    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cbb579ec-9f48-4148-8bbe-78d96dbc31cf-must-gather-output\") pod \"must-gather-755jg\" (UID: \"cbb579ec-9f48-4148-8bbe-78d96dbc31cf\") " pod="openshift-must-gather-4wzj6/must-gather-755jg"
May 28 10:02:30.201433 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:30.201419    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cbb579ec-9f48-4148-8bbe-78d96dbc31cf-must-gather-output\") pod \"must-gather-755jg\" (UID: \"cbb579ec-9f48-4148-8bbe-78d96dbc31cf\") " pod="openshift-must-gather-4wzj6/must-gather-755jg"
May 28 10:02:30.210204 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:30.210179    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l5cs\" (UniqueName: \"kubernetes.io/projected/cbb579ec-9f48-4148-8bbe-78d96dbc31cf-kube-api-access-7l5cs\") pod \"must-gather-755jg\" (UID: \"cbb579ec-9f48-4148-8bbe-78d96dbc31cf\") " pod="openshift-must-gather-4wzj6/must-gather-755jg"
May 28 10:02:30.373471 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:30.373424    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4wzj6/must-gather-755jg"
May 28 10:02:30.495682 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:30.495652    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4wzj6/must-gather-755jg"]
May 28 10:02:30.499634 ip-10-0-138-49 kubenswrapper[2578]: W0528 10:02:30.499605    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcbb579ec_9f48_4148_8bbe_78d96dbc31cf.slice/crio-528d786f863736bbc1202386857ac28bf3f700b86a38d55264903c88dc6658f2 WatchSource:0}: Error finding container 528d786f863736bbc1202386857ac28bf3f700b86a38d55264903c88dc6658f2: Status 404 returned error can't find the container with id 528d786f863736bbc1202386857ac28bf3f700b86a38d55264903c88dc6658f2
May 28 10:02:30.501353 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:30.501337    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 10:02:31.101126 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:31.101085    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4wzj6/must-gather-755jg" event={"ID":"cbb579ec-9f48-4148-8bbe-78d96dbc31cf","Type":"ContainerStarted","Data":"528d786f863736bbc1202386857ac28bf3f700b86a38d55264903c88dc6658f2"}
May 28 10:02:32.109877 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:32.109826    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4wzj6/must-gather-755jg" event={"ID":"cbb579ec-9f48-4148-8bbe-78d96dbc31cf","Type":"ContainerStarted","Data":"a25f6422960a83421abd757665c20253f0b2d7803636bd398e91f5e6cf4b2e99"}
May 28 10:02:32.109877 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:32.109863    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4wzj6/must-gather-755jg" event={"ID":"cbb579ec-9f48-4148-8bbe-78d96dbc31cf","Type":"ContainerStarted","Data":"7c5609501f3d08a0d8bfbe631f48378e93dde1c4064ae17aeef84ff4d883dccd"}
May 28 10:02:32.128503 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:32.128452    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-4wzj6/must-gather-755jg" podStartSLOduration=1.339427432 podStartE2EDuration="2.128434488s" podCreationTimestamp="2026-05-28 10:02:30 +0000 UTC" firstStartedPulling="2026-05-28 10:02:30.501462197 +0000 UTC m=+1862.961207820" lastFinishedPulling="2026-05-28 10:02:31.290469253 +0000 UTC m=+1863.750214876" observedRunningTime="2026-05-28 10:02:32.127984884 +0000 UTC m=+1864.587730532" watchObservedRunningTime="2026-05-28 10:02:32.128434488 +0000 UTC m=+1864.588180134"
May 28 10:02:32.738031 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:32.738000    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-ghjgh_85b6e3b2-9894-4ebd-9c28-33bf84f4fbd5/global-pull-secret-syncer/0.log"
May 28 10:02:32.927094 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:32.927065    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fswqv_a9e39b1c-78f9-4176-9dda-9464da6c6d4d/konnectivity-agent/0.log"
May 28 10:02:33.039779 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:33.039659    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-49.ec2.internal_1f961dde9f6169a438d2aee717de7ec2/haproxy/0.log"
May 28 10:02:36.195482 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:36.195456    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8dflz_690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8/node-exporter/0.log"
May 28 10:02:36.223925 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:36.223894    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8dflz_690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8/kube-rbac-proxy/0.log"
May 28 10:02:36.249030 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:36.249005    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8dflz_690a6a6c-b9c0-48bb-ad9c-2f5a1b0288b8/init-textfile/0.log"
May 28 10:02:36.832543 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:36.832472    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-697fdcbfff-dj6rb_c5e6ca04-3465-47d4-86ab-2b47472b772b/telemeter-client/0.log"
May 28 10:02:36.862784 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:36.862747    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-697fdcbfff-dj6rb_c5e6ca04-3465-47d4-86ab-2b47472b772b/reload/0.log"
May 28 10:02:36.895972 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:36.895945    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-697fdcbfff-dj6rb_c5e6ca04-3465-47d4-86ab-2b47472b772b/kube-rbac-proxy/0.log"
May 28 10:02:38.090418 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:38.090353    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-ndlhq_4f338af0-ba12-449a-9d1d-131a715463e9/networking-console-plugin/0.log"
May 28 10:02:38.905673 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:38.905646    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-b998457fd-d64j8_649c9d16-e8bd-4431-a700-f67fc6c3e9de/console/0.log"
May 28 10:02:38.913089 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:38.913065    2578 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4wzj6/perf-node-gather-daemonset-js9km"]
May 28 10:02:38.917287 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:38.917270    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4wzj6/perf-node-gather-daemonset-js9km"
May 28 10:02:38.926858 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:38.926835    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4wzj6/perf-node-gather-daemonset-js9km"]
May 28 10:02:38.987690 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:38.987660    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/24d07055-ab2f-4e6e-9dc3-fa365200ff4c-podres\") pod \"perf-node-gather-daemonset-js9km\" (UID: \"24d07055-ab2f-4e6e-9dc3-fa365200ff4c\") " pod="openshift-must-gather-4wzj6/perf-node-gather-daemonset-js9km"
May 28 10:02:38.987690 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:38.987694    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/24d07055-ab2f-4e6e-9dc3-fa365200ff4c-sys\") pod \"perf-node-gather-daemonset-js9km\" (UID: \"24d07055-ab2f-4e6e-9dc3-fa365200ff4c\") " pod="openshift-must-gather-4wzj6/perf-node-gather-daemonset-js9km"
May 28 10:02:38.987943 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:38.987746    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/24d07055-ab2f-4e6e-9dc3-fa365200ff4c-lib-modules\") pod \"perf-node-gather-daemonset-js9km\" (UID: \"24d07055-ab2f-4e6e-9dc3-fa365200ff4c\") " pod="openshift-must-gather-4wzj6/perf-node-gather-daemonset-js9km"
May 28 10:02:38.987943 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:38.987786    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/24d07055-ab2f-4e6e-9dc3-fa365200ff4c-proc\") pod \"perf-node-gather-daemonset-js9km\" (UID: \"24d07055-ab2f-4e6e-9dc3-fa365200ff4c\") " pod="openshift-must-gather-4wzj6/perf-node-gather-daemonset-js9km"
May 28 10:02:38.987943 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:38.987806    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsspf\" (UniqueName: \"kubernetes.io/projected/24d07055-ab2f-4e6e-9dc3-fa365200ff4c-kube-api-access-bsspf\") pod \"perf-node-gather-daemonset-js9km\" (UID: \"24d07055-ab2f-4e6e-9dc3-fa365200ff4c\") " pod="openshift-must-gather-4wzj6/perf-node-gather-daemonset-js9km"
May 28 10:02:39.088870 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:39.088829    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/24d07055-ab2f-4e6e-9dc3-fa365200ff4c-lib-modules\") pod \"perf-node-gather-daemonset-js9km\" (UID: \"24d07055-ab2f-4e6e-9dc3-fa365200ff4c\") " pod="openshift-must-gather-4wzj6/perf-node-gather-daemonset-js9km"
May 28 10:02:39.089057 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:39.088884    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/24d07055-ab2f-4e6e-9dc3-fa365200ff4c-proc\") pod \"perf-node-gather-daemonset-js9km\" (UID: \"24d07055-ab2f-4e6e-9dc3-fa365200ff4c\") " pod="openshift-must-gather-4wzj6/perf-node-gather-daemonset-js9km"
May 28 10:02:39.089057 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:39.088913    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bsspf\" (UniqueName: \"kubernetes.io/projected/24d07055-ab2f-4e6e-9dc3-fa365200ff4c-kube-api-access-bsspf\") pod \"perf-node-gather-daemonset-js9km\" (UID: \"24d07055-ab2f-4e6e-9dc3-fa365200ff4c\") " pod="openshift-must-gather-4wzj6/perf-node-gather-daemonset-js9km"
May 28 10:02:39.089057 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:39.088951    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/24d07055-ab2f-4e6e-9dc3-fa365200ff4c-lib-modules\") pod \"perf-node-gather-daemonset-js9km\" (UID: \"24d07055-ab2f-4e6e-9dc3-fa365200ff4c\") " pod="openshift-must-gather-4wzj6/perf-node-gather-daemonset-js9km"
May 28 10:02:39.089057 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:39.089019    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/24d07055-ab2f-4e6e-9dc3-fa365200ff4c-proc\") pod \"perf-node-gather-daemonset-js9km\" (UID: \"24d07055-ab2f-4e6e-9dc3-fa365200ff4c\") " pod="openshift-must-gather-4wzj6/perf-node-gather-daemonset-js9km"
May 28 10:02:39.089057 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:39.088972    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/24d07055-ab2f-4e6e-9dc3-fa365200ff4c-podres\") pod \"perf-node-gather-daemonset-js9km\" (UID: \"24d07055-ab2f-4e6e-9dc3-fa365200ff4c\") " pod="openshift-must-gather-4wzj6/perf-node-gather-daemonset-js9km"
May 28 10:02:39.089347 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:39.089075    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/24d07055-ab2f-4e6e-9dc3-fa365200ff4c-podres\") pod \"perf-node-gather-daemonset-js9km\" (UID: \"24d07055-ab2f-4e6e-9dc3-fa365200ff4c\") " pod="openshift-must-gather-4wzj6/perf-node-gather-daemonset-js9km"
May 28 10:02:39.089347 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:39.089093    2578 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/24d07055-ab2f-4e6e-9dc3-fa365200ff4c-sys\") pod \"perf-node-gather-daemonset-js9km\" (UID: \"24d07055-ab2f-4e6e-9dc3-fa365200ff4c\") " pod="openshift-must-gather-4wzj6/perf-node-gather-daemonset-js9km"
May 28 10:02:39.089347 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:39.089171    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/24d07055-ab2f-4e6e-9dc3-fa365200ff4c-sys\") pod \"perf-node-gather-daemonset-js9km\" (UID: \"24d07055-ab2f-4e6e-9dc3-fa365200ff4c\") " pod="openshift-must-gather-4wzj6/perf-node-gather-daemonset-js9km"
May 28 10:02:39.100795 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:39.100775    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsspf\" (UniqueName: \"kubernetes.io/projected/24d07055-ab2f-4e6e-9dc3-fa365200ff4c-kube-api-access-bsspf\") pod \"perf-node-gather-daemonset-js9km\" (UID: \"24d07055-ab2f-4e6e-9dc3-fa365200ff4c\") " pod="openshift-must-gather-4wzj6/perf-node-gather-daemonset-js9km"
May 28 10:02:39.227544 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:39.227512    2578 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4wzj6/perf-node-gather-daemonset-js9km"
May 28 10:02:39.366296 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:39.366270    2578 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4wzj6/perf-node-gather-daemonset-js9km"]
May 28 10:02:39.368366 ip-10-0-138-49 kubenswrapper[2578]: W0528 10:02:39.368342    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod24d07055_ab2f_4e6e_9dc3_fa365200ff4c.slice/crio-8f21c70ec2df6201477b2144f6cd2f20db09f8f70be3c07cbf90f74a17ab9f82 WatchSource:0}: Error finding container 8f21c70ec2df6201477b2144f6cd2f20db09f8f70be3c07cbf90f74a17ab9f82: Status 404 returned error can't find the container with id 8f21c70ec2df6201477b2144f6cd2f20db09f8f70be3c07cbf90f74a17ab9f82
May 28 10:02:40.105323 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:40.105298    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4jnrs_4bc2255b-95b4-4e5d-84ca-3b62b9da5519/dns/0.log"
May 28 10:02:40.129653 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:40.129628    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-4jnrs_4bc2255b-95b4-4e5d-84ca-3b62b9da5519/kube-rbac-proxy/0.log"
May 28 10:02:40.137642 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:40.137618    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4wzj6/perf-node-gather-daemonset-js9km" event={"ID":"24d07055-ab2f-4e6e-9dc3-fa365200ff4c","Type":"ContainerStarted","Data":"545a9663d7240505c5a0f7962769839c7c1cc744f5f25acf143bae4750d6d007"}
May 28 10:02:40.137748 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:40.137646    2578 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4wzj6/perf-node-gather-daemonset-js9km" event={"ID":"24d07055-ab2f-4e6e-9dc3-fa365200ff4c","Type":"ContainerStarted","Data":"8f21c70ec2df6201477b2144f6cd2f20db09f8f70be3c07cbf90f74a17ab9f82"}
May 28 10:02:40.137748 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:40.137731    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4wzj6/perf-node-gather-daemonset-js9km"
May 28 10:02:40.155497 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:40.155457    2578 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-4wzj6/perf-node-gather-daemonset-js9km" podStartSLOduration=2.155441575 podStartE2EDuration="2.155441575s" podCreationTimestamp="2026-05-28 10:02:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 10:02:40.153944355 +0000 UTC m=+1872.613690010" watchObservedRunningTime="2026-05-28 10:02:40.155441575 +0000 UTC m=+1872.615187220"
May 28 10:02:40.307562 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:40.307526    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zg2lk_17ebbce7-58aa-49ef-8367-03b9d9f52618/dns-node-resolver/0.log"
May 28 10:02:40.778680 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:40.778651    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-nvjjz_e77da112-3527-431e-b09e-a5e7b1e6237a/node-ca/0.log"
May 28 10:02:41.798122 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:41.798090    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cl4cv_3a32cf92-12af-459a-ad67-15d50ffbcb4a/serve-healthcheck-canary/0.log"
May 28 10:02:42.292918 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:42.292853    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g9nwp_6ab2cf66-6221-4d97-98e0-6ddace4d1aa8/kube-rbac-proxy/0.log"
May 28 10:02:42.317382 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:42.317360    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g9nwp_6ab2cf66-6221-4d97-98e0-6ddace4d1aa8/exporter/0.log"
May 28 10:02:42.357759 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:42.357739    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g9nwp_6ab2cf66-6221-4d97-98e0-6ddace4d1aa8/extractor/0.log"
May 28 10:02:46.150802 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:46.150760    2578 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4wzj6/perf-node-gather-daemonset-js9km"
May 28 10:02:47.918897 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:47.918868    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-9qvc7_14998e85-5fb9-4268-8bfd-666f8ea4e771/kube-multus/0.log"
May 28 10:02:48.349141 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:48.349111    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pcp25_9b7b650a-16c7-4711-b774-2618ab6d17fd/kube-multus-additional-cni-plugins/0.log"
May 28 10:02:48.374763 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:48.374734    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pcp25_9b7b650a-16c7-4711-b774-2618ab6d17fd/egress-router-binary-copy/0.log"
May 28 10:02:48.398755 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:48.398723    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pcp25_9b7b650a-16c7-4711-b774-2618ab6d17fd/cni-plugins/0.log"
May 28 10:02:48.424890 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:48.424868    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pcp25_9b7b650a-16c7-4711-b774-2618ab6d17fd/bond-cni-plugin/0.log"
May 28 10:02:48.450956 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:48.450935    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pcp25_9b7b650a-16c7-4711-b774-2618ab6d17fd/routeoverride-cni/0.log"
May 28 10:02:48.483057 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:48.483033    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pcp25_9b7b650a-16c7-4711-b774-2618ab6d17fd/whereabouts-cni-bincopy/0.log"
May 28 10:02:48.512033 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:48.511974    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pcp25_9b7b650a-16c7-4711-b774-2618ab6d17fd/whereabouts-cni/0.log"
May 28 10:02:48.610707 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:48.610673    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4jgb2_36d6c59d-f6ef-439d-8a97-58441ccdb9de/network-metrics-daemon/0.log"
May 28 10:02:48.636696 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:48.636664    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4jgb2_36d6c59d-f6ef-439d-8a97-58441ccdb9de/kube-rbac-proxy/0.log"
May 28 10:02:50.168702 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:50.168673    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wqcwd_397304a8-87ab-49c0-9fc0-a3ca99f04032/ovn-controller/0.log"
May 28 10:02:50.188735 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:50.188707    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wqcwd_397304a8-87ab-49c0-9fc0-a3ca99f04032/ovn-acl-logging/0.log"
May 28 10:02:50.196803 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:50.196785    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wqcwd_397304a8-87ab-49c0-9fc0-a3ca99f04032/ovn-acl-logging/1.log"
May 28 10:02:50.218400 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:50.218384    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wqcwd_397304a8-87ab-49c0-9fc0-a3ca99f04032/kube-rbac-proxy-node/0.log"
May 28 10:02:50.242181 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:50.242165    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wqcwd_397304a8-87ab-49c0-9fc0-a3ca99f04032/kube-rbac-proxy-ovn-metrics/0.log"
May 28 10:02:50.261665 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:50.261646    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wqcwd_397304a8-87ab-49c0-9fc0-a3ca99f04032/northd/0.log"
May 28 10:02:50.284310 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:50.284286    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wqcwd_397304a8-87ab-49c0-9fc0-a3ca99f04032/nbdb/0.log"
May 28 10:02:50.307027 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:50.307011    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wqcwd_397304a8-87ab-49c0-9fc0-a3ca99f04032/sbdb/0.log"
May 28 10:02:50.409428 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:50.409403    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wqcwd_397304a8-87ab-49c0-9fc0-a3ca99f04032/ovnkube-controller/0.log"
May 28 10:02:51.437001 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:51.436974    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-n442c_36d4fbf6-bd2d-4aba-8dd5-5abe7958fb74/network-check-target-container/0.log"
May 28 10:02:52.382241 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:52.382198    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-x49m9_70d16a61-6335-4394-aebd-18e43cbd22a8/iptables-alerter/0.log"
May 28 10:02:53.026022 ip-10-0-138-49 kubenswrapper[2578]: I0528 10:02:53.025996    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-rrxw4_f12d790e-dc2c-4dec-b3a1-04e48182ae83/tuned/0.log"