Sep 08 09:58:06.213044 ip-10-0-132-96 systemd[1]: Starting Kubernetes Kubelet...
Sep 08 09:58:06.608069 ip-10-0-132-96 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 09:58:06.608069 ip-10-0-132-96 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 08 09:58:06.608069 ip-10-0-132-96 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 09:58:06.608069 ip-10-0-132-96 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 08 09:58:06.608069 ip-10-0-132-96 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 09:58:06.608737 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.608078    2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 08 09:58:06.611358 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611341    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 09:58:06.611358 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611358    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 09:58:06.611422 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611363    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 09:58:06.611422 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611366    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 09:58:06.611422 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611369    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 09:58:06.611422 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611372    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 09:58:06.611422 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611375    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 09:58:06.611422 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611378    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 09:58:06.611422 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611381    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 09:58:06.611422 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611384    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 09:58:06.611422 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611387    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 09:58:06.611422 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611389    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 09:58:06.611422 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611392    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 09:58:06.611422 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611395    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 09:58:06.611422 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611397    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 09:58:06.611422 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611403    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 09:58:06.611422 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611406    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 09:58:06.611422 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611408    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 09:58:06.611422 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611411    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 09:58:06.611422 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611414    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 09:58:06.611422 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611417    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 09:58:06.611422 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611419    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 09:58:06.611903 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611422    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 09:58:06.611903 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611427    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 09:58:06.611903 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611431    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 09:58:06.611903 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611434    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 09:58:06.611903 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611437    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 09:58:06.611903 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611439    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 09:58:06.611903 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611442    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 09:58:06.611903 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611445    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 09:58:06.611903 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611448    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 09:58:06.611903 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611451    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 09:58:06.611903 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611453    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 09:58:06.611903 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611456    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 09:58:06.611903 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611459    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 09:58:06.611903 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611461    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 09:58:06.611903 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611465    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 09:58:06.611903 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611467    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 09:58:06.611903 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611469    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 09:58:06.611903 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611472    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 09:58:06.611903 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611474    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 09:58:06.612365 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611477    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 09:58:06.612365 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611479    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 09:58:06.612365 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611482    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 09:58:06.612365 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611484    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 09:58:06.612365 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611487    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 09:58:06.612365 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611489    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 09:58:06.612365 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611492    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 09:58:06.612365 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611494    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 09:58:06.612365 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611497    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 09:58:06.612365 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611499    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 09:58:06.612365 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611502    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 09:58:06.612365 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611504    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 09:58:06.612365 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611507    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 09:58:06.612365 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611509    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 09:58:06.612365 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611513    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 09:58:06.612365 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611516    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 09:58:06.612365 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611518    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 09:58:06.612365 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611521    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 09:58:06.612365 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611524    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 09:58:06.612365 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611526    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 09:58:06.612876 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611529    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 09:58:06.612876 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611531    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 09:58:06.612876 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611548    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 09:58:06.612876 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611551    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 09:58:06.612876 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611553    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 09:58:06.612876 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611556    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 09:58:06.612876 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611559    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 09:58:06.612876 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611561    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 09:58:06.612876 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611564    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 09:58:06.612876 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611566    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 09:58:06.612876 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611569    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 09:58:06.612876 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611571    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 09:58:06.612876 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611573    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 09:58:06.612876 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611576    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 09:58:06.612876 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611580    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 09:58:06.612876 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611584    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 09:58:06.612876 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611586    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 09:58:06.612876 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611589    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 09:58:06.612876 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611592    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 09:58:06.613356 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611595    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 09:58:06.613356 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611598    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 09:58:06.613356 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611603    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 09:58:06.613356 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611605    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 09:58:06.613356 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611608    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 09:58:06.613356 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611610    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 09:58:06.613356 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611613    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 09:58:06.613356 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611617    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 09:58:06.613356 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611619    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 09:58:06.613356 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611623    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 09:58:06.613356 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611627    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 09:58:06.613356 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611629    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 09:58:06.613356 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611632    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 09:58:06.613356 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611635    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 09:58:06.613356 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611637    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 09:58:06.613356 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611640    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 09:58:06.613356 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611642    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 09:58:06.613356 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611645    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 09:58:06.613356 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.611647    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 09:58:06.613837 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612304    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 09:58:06.613837 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612310    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 09:58:06.613837 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612314    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 09:58:06.613837 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612316    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 09:58:06.613837 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612319    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 09:58:06.613837 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612321    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 09:58:06.613837 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612324    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 09:58:06.613837 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612326    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 09:58:06.613837 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612329    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 09:58:06.613837 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612331    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 09:58:06.613837 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612334    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 09:58:06.613837 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612338    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 09:58:06.613837 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612342    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 09:58:06.613837 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612345    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 09:58:06.613837 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612348    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 09:58:06.613837 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612350    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 09:58:06.613837 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612353    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 09:58:06.613837 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612355    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 09:58:06.613837 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612358    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 09:58:06.614349 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612360    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 09:58:06.614349 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612363    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 09:58:06.614349 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612366    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 09:58:06.614349 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612369    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 09:58:06.614349 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612371    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 09:58:06.614349 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612374    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 09:58:06.614349 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612377    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 09:58:06.614349 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612379    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 09:58:06.614349 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612382    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 09:58:06.614349 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612385    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 09:58:06.614349 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612388    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 09:58:06.614349 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612390    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 09:58:06.614349 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612393    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 09:58:06.614349 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612397    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 09:58:06.614349 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612400    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 09:58:06.614349 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612404    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 09:58:06.614349 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612406    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 09:58:06.614349 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612409    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 09:58:06.614349 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612412    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 09:58:06.614838 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612414    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 09:58:06.614838 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612417    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 09:58:06.614838 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612419    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 09:58:06.614838 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612421    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 09:58:06.614838 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612424    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 09:58:06.614838 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612426    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 09:58:06.614838 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612429    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 09:58:06.614838 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612431    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 09:58:06.614838 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612434    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 09:58:06.614838 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612437    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 09:58:06.614838 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612439    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 09:58:06.614838 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612442    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 09:58:06.614838 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612444    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 09:58:06.614838 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612447    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 09:58:06.614838 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612450    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 09:58:06.614838 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612459    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 09:58:06.614838 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612462    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 09:58:06.614838 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612465    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 09:58:06.614838 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612467    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 09:58:06.614838 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612470    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 09:58:06.615340 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612472    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 09:58:06.615340 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612475    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 09:58:06.615340 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612477    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 09:58:06.615340 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612480    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 09:58:06.615340 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612482    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 09:58:06.615340 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612484    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 09:58:06.615340 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612487    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 09:58:06.615340 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612489    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 09:58:06.615340 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612493    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 09:58:06.615340 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612496    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 09:58:06.615340 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612499    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 09:58:06.615340 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612502    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 09:58:06.615340 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612505    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 09:58:06.615340 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612508    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 09:58:06.615340 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612511    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 09:58:06.615340 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612514    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 09:58:06.615340 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612516    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 09:58:06.615340 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612519    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 09:58:06.615340 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612521    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 09:58:06.615340 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612524    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 09:58:06.615852 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612526    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 09:58:06.615852 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612528    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 09:58:06.615852 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612550    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 09:58:06.615852 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612553    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 09:58:06.615852 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612556    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 09:58:06.615852 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612558    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 09:58:06.615852 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612562    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 09:58:06.615852 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612564    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 09:58:06.615852 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612567    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 09:58:06.615852 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612569    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 09:58:06.615852 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612572    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 09:58:06.615852 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612582    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 09:58:06.615852 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612585    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 09:58:06.615852 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612588    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 09:58:06.615852 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612590    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 09:58:06.615852 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612593    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 09:58:06.615852 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612595    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 09:58:06.615852 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612598    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 09:58:06.615852 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612600    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 09:58:06.615852 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612603    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 09:58:06.616337 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.612605    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 09:58:06.616337 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613016    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 09:58:06.616337 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613021    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 09:58:06.616337 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613025    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 09:58:06.616337 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613028    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 09:58:06.616337 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613031    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 09:58:06.616337 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613034    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 09:58:06.616337 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613037    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 09:58:06.616337 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613040    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 09:58:06.616337 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613042    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 09:58:06.616337 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613045    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 09:58:06.616337 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613047    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 09:58:06.616337 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613050    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 09:58:06.616337 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613052    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 09:58:06.616337 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613055    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 09:58:06.616337 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613058    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 09:58:06.616337 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613060    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 09:58:06.616337 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613062    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 09:58:06.616337 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613066    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 09:58:06.616854 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613068    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 09:58:06.616854 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613071    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 09:58:06.616854 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613073    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 09:58:06.616854 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613076    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 09:58:06.616854 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613078    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 09:58:06.616854 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613081    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 09:58:06.616854 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613083    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 09:58:06.616854 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613086    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 09:58:06.616854 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613088    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 09:58:06.616854 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613091    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 09:58:06.616854 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613093    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 09:58:06.616854 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613096    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 09:58:06.616854 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613098    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 09:58:06.616854 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613101    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 09:58:06.616854 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613104    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 09:58:06.616854 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613106    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 09:58:06.616854 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613108    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 09:58:06.616854 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613111    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 09:58:06.616854 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613113    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 09:58:06.616854 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613115    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 09:58:06.617337 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613118    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 09:58:06.617337 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613120    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 09:58:06.617337 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613122    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 09:58:06.617337 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613125    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 09:58:06.617337 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613127    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 09:58:06.617337 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613130    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 09:58:06.617337 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613132    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 09:58:06.617337 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613134    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 09:58:06.617337 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613137    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 09:58:06.617337 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613140    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 09:58:06.617337 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613143    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 09:58:06.617337 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613146    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 09:58:06.617337 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613148    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 09:58:06.617337 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613151    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 09:58:06.617337 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613153    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 09:58:06.617337 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613155    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 09:58:06.617337 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613158    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 09:58:06.617337 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613161    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 09:58:06.617337 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613164    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 09:58:06.617337 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613166    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 09:58:06.617897 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613169    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 09:58:06.617897 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613171    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 09:58:06.617897 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613176    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 09:58:06.617897 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613179    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 09:58:06.617897 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613183    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 09:58:06.617897 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613187    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 09:58:06.617897 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613190    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 09:58:06.617897 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613193    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 09:58:06.617897 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613196    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 09:58:06.617897 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613198    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 09:58:06.617897 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613201    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 09:58:06.617897 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613203    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 09:58:06.617897 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613207    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 09:58:06.617897 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613210    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 09:58:06.617897 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613213    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 09:58:06.617897 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613215    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 09:58:06.617897 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613218    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 09:58:06.617897 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613221    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 09:58:06.617897 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613223    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 09:58:06.618351 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613226    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 09:58:06.618351 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613230    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 09:58:06.618351 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613233    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 09:58:06.618351 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613236    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 09:58:06.618351 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613239    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 09:58:06.618351 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613241    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 09:58:06.618351 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613243    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 09:58:06.618351 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613246    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 09:58:06.618351 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613248    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 09:58:06.618351 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613251    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 09:58:06.618351 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613253    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 09:58:06.618351 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613258    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 09:58:06.618351 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613260    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 09:58:06.618351 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613263    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 09:58:06.618351 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613265    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 09:58:06.618351 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613268    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 09:58:06.618351 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613270    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 09:58:06.618351 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613273    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 09:58:06.618351 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613275    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 09:58:06.618893 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613277    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 09:58:06.618893 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613280    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 09:58:06.618893 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613282    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 09:58:06.618893 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613349    2579 flags.go:64] FLAG: --address="0.0.0.0"
Sep 08 09:58:06.618893 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613389    2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 08 09:58:06.618893 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613396    2579 flags.go:64] FLAG: --anonymous-auth="true"
Sep 08 09:58:06.618893 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613400    2579 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 08 09:58:06.618893 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613404    2579 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 08 09:58:06.618893 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613407    2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 08 09:58:06.618893 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613411    2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 08 09:58:06.618893 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613415    2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 08 09:58:06.618893 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613418    2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 08 09:58:06.618893 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613420    2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 08 09:58:06.618893 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613424    2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 08 09:58:06.618893 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613427    2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 08 09:58:06.618893 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613430    2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 08 09:58:06.618893 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613438    2579 flags.go:64] FLAG: --cgroup-root=""
Sep 08 09:58:06.618893 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613441    2579 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 08 09:58:06.618893 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613444    2579 flags.go:64] FLAG: --client-ca-file=""
Sep 08 09:58:06.618893 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613446    2579 flags.go:64] FLAG: --cloud-provider="external"
Sep 08 09:58:06.618893 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613449    2579 flags.go:64] FLAG: --cluster-dns="[]"
Sep 08 09:58:06.618893 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613453    2579 flags.go:64] FLAG: --cluster-domain=""
Sep 08 09:58:06.618893 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613456    2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 08 09:58:06.618893 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613459    2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 08 09:58:06.619460 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613463    2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 08 09:58:06.619460 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613466    2579 flags.go:64] FLAG: --container-log-max-files="5"
Sep 08 09:58:06.619460 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613470    2579 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 08 09:58:06.619460 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613473    2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 08 09:58:06.619460 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613476    2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 08 09:58:06.619460 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613478    2579 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 08 09:58:06.619460 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613481    2579 flags.go:64] FLAG: --contention-profiling="false"
Sep 08 09:58:06.619460 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613484    2579 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 08 09:58:06.619460 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613487    2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 08 09:58:06.619460 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613490    2579 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 08 09:58:06.619460 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613493    2579 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 08 09:58:06.619460 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613496    2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 08 09:58:06.619460 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613500    2579 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 08 09:58:06.619460 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613503    2579 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 08 09:58:06.619460 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613506    2579 flags.go:64] FLAG: --enable-load-reader="false"
Sep 08 09:58:06.619460 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613509    2579 flags.go:64] FLAG: --enable-server="true"
Sep 08 09:58:06.619460 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613511    2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 08 09:58:06.619460 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613516    2579 flags.go:64] FLAG: --event-burst="100"
Sep 08 09:58:06.619460 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613519    2579 flags.go:64] FLAG: --event-qps="50"
Sep 08 09:58:06.619460 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613522    2579 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 08 09:58:06.619460 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613524    2579 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 08 09:58:06.619460 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613527    2579 flags.go:64] FLAG: --eviction-hard=""
Sep 08 09:58:06.619460 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613530    2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 08 09:58:06.619460 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613547    2579 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 08 09:58:06.620049 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613551    2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 08 09:58:06.620049 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613555    2579 flags.go:64] FLAG: --eviction-soft=""
Sep 08 09:58:06.620049 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613557    2579 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 08 09:58:06.620049 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613561    2579 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 08 09:58:06.620049 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613563    2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 08 09:58:06.620049 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613566    2579 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 08 09:58:06.620049 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613569    2579 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 08 09:58:06.620049 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613572    2579 flags.go:64] FLAG: --fail-swap-on="true"
Sep 08 09:58:06.620049 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613576    2579 flags.go:64] FLAG: --feature-gates=""
Sep 08 09:58:06.620049 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613580    2579 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 08 09:58:06.620049 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613583    2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 08 09:58:06.620049 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613586    2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 08 09:58:06.620049 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613589    2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 08 09:58:06.620049 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613592    2579 flags.go:64] FLAG: --healthz-port="10248"
Sep 08 09:58:06.620049 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613594    2579 flags.go:64] FLAG: --help="false"
Sep 08 09:58:06.620049 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613597    2579 flags.go:64] FLAG: --hostname-override="ip-10-0-132-96.ec2.internal"
Sep 08 09:58:06.620049 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613600    2579 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 08 09:58:06.620049 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613603    2579 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 08 09:58:06.620049 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613606    2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 08 09:58:06.620049 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613609    2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 08 09:58:06.620049 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613614    2579 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 08 09:58:06.620049 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613617    2579 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 08 09:58:06.620049 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613619    2579 flags.go:64] FLAG: --image-service-endpoint=""
Sep 08 09:58:06.620665 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613622    2579 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 08 09:58:06.620665 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613625    2579 flags.go:64] FLAG: --kube-api-burst="100"
Sep 08 09:58:06.620665 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613628    2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 08 09:58:06.620665 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613631    2579 flags.go:64] FLAG: --kube-api-qps="50"
Sep 08 09:58:06.620665 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613633    2579 flags.go:64] FLAG: --kube-reserved=""
Sep 08 09:58:06.620665 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613636    2579 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 08 09:58:06.620665 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613639    2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 08 09:58:06.620665 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613642    2579 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 08 09:58:06.620665 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613644    2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 08 09:58:06.620665 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613647    2579 flags.go:64] FLAG: --lock-file=""
Sep 08 09:58:06.620665 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613650    2579 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 08 09:58:06.620665 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613653    2579 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 08 09:58:06.620665 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613656    2579 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 08 09:58:06.620665 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613661    2579 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 08 09:58:06.620665 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613664    2579 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 08 09:58:06.620665 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613667    2579 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 08 09:58:06.620665 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613669    2579 flags.go:64] FLAG: --logging-format="text"
Sep 08 09:58:06.620665 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613673    2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 08 09:58:06.620665 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613676    2579 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 08 09:58:06.620665 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613679    2579 flags.go:64] FLAG: --manifest-url=""
Sep 08 09:58:06.620665 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613682    2579 flags.go:64] FLAG: --manifest-url-header=""
Sep 08 09:58:06.620665 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613686    2579 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 08 09:58:06.620665 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613689    2579 flags.go:64] FLAG: --max-open-files="1000000"
Sep 08 09:58:06.620665 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613692    2579 flags.go:64] FLAG: --max-pods="110"
Sep 08 09:58:06.620665 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613695    2579 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 08 09:58:06.621750 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613698    2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 08 09:58:06.621750 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613701    2579 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 08 09:58:06.621750 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613704    2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 08 09:58:06.621750 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613706    2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 08 09:58:06.621750 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613710    2579 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 08 09:58:06.621750 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613713    2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 08 09:58:06.621750 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613720    2579 flags.go:64] FLAG: --node-status-max-images="50"
Sep 08 09:58:06.621750 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613722    2579 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 08 09:58:06.621750 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613725    2579 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 08 09:58:06.621750 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613728    2579 flags.go:64] FLAG: --pod-cidr=""
Sep 08 09:58:06.621750 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613731    2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 08 09:58:06.621750 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613736    2579 flags.go:64] FLAG: --pod-manifest-path=""
Sep 08 09:58:06.621750 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613739    2579 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 08 09:58:06.621750 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613742    2579 flags.go:64] FLAG: --pods-per-core="0"
Sep 08 09:58:06.621750 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613745    2579 flags.go:64] FLAG: --port="10250"
Sep 08 09:58:06.621750 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613748    2579 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 08 09:58:06.621750 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613750    2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08dc77774fc48e847"
Sep 08 09:58:06.621750 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613753    2579 flags.go:64] FLAG: --qos-reserved=""
Sep 08 09:58:06.621750 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613756    2579 flags.go:64] FLAG: --read-only-port="10255"
Sep 08 09:58:06.621750 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613759    2579 flags.go:64] FLAG: --register-node="true"
Sep 08 09:58:06.621750 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613762    2579 flags.go:64] FLAG: --register-with-taints=""
Sep 08 09:58:06.621750 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613765    2579 flags.go:64] FLAG: --registry-burst="10"
Sep 08 09:58:06.621750 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613768    2579 flags.go:64] FLAG: --registry-qps="5"
Sep 08 09:58:06.621750 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613771    2579 flags.go:64] FLAG: --reserved-cpus=""
Sep 08 09:58:06.622775 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613775    2579 flags.go:64] FLAG: --reserved-memory=""
Sep 08 09:58:06.622775 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613778    2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 08 09:58:06.622775 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613781    2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 08 09:58:06.622775 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613784    2579 flags.go:64] FLAG: --rotate-certificates="false"
Sep 08 09:58:06.622775 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613787    2579 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 08 09:58:06.622775 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613789    2579 flags.go:64] FLAG: --runonce="false"
Sep 08 09:58:06.622775 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613792    2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 08 09:58:06.622775 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613795    2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 08 09:58:06.622775 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613798    2579 flags.go:64] FLAG: --seccomp-default="false"
Sep 08 09:58:06.622775 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613801    2579 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 08 09:58:06.622775 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613804    2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 08 09:58:06.622775 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613807    2579 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 08 09:58:06.622775 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613810    2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 08 09:58:06.622775 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613814    2579 flags.go:64] FLAG: --storage-driver-password="root"
Sep 08 09:58:06.622775 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613817    2579 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 08 09:58:06.622775 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613820    2579 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 08 09:58:06.622775 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613823    2579 flags.go:64] FLAG: --storage-driver-user="root"
Sep 08 09:58:06.622775 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613826    2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 08 09:58:06.622775 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613828    2579 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 08 09:58:06.622775 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613831    2579 flags.go:64] FLAG: --system-cgroups=""
Sep 08 09:58:06.622775 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613834    2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 08 09:58:06.622775 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613839    2579 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 08 09:58:06.622775 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613842    2579 flags.go:64] FLAG: --tls-cert-file=""
Sep 08 09:58:06.622775 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613845    2579 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 08 09:58:06.622775 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613849    2579 flags.go:64] FLAG: --tls-min-version=""
Sep 08 09:58:06.623469 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613851    2579 flags.go:64] FLAG: --tls-private-key-file=""
Sep 08 09:58:06.623469 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613854    2579 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 08 09:58:06.623469 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613857    2579 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 08 09:58:06.623469 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613860    2579 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 08 09:58:06.623469 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613863    2579 flags.go:64] FLAG: --v="2"
Sep 08 09:58:06.623469 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613867    2579 flags.go:64] FLAG: --version="false"
Sep 08 09:58:06.623469 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613870    2579 flags.go:64] FLAG: --vmodule=""
Sep 08 09:58:06.623469 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613876    2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 08 09:58:06.623469 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.613879    2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 08 09:58:06.623469 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613986    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 09:58:06.623469 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613989    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 09:58:06.623469 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613992    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 09:58:06.623469 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613995    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 09:58:06.623469 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.613998    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 09:58:06.623469 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614001    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 09:58:06.623469 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614003    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 09:58:06.623469 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614006    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 09:58:06.623469 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614008    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 09:58:06.623469 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614011    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 09:58:06.623469 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614013    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 09:58:06.623469 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614019    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 09:58:06.624200 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614024    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 09:58:06.624200 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614026    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 09:58:06.624200 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614029    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 09:58:06.624200 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614032    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 09:58:06.624200 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614035    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 09:58:06.624200 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614037    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 09:58:06.624200 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614040    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 09:58:06.624200 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614042    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 09:58:06.624200 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614045    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 09:58:06.624200 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614048    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 09:58:06.624200 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614050    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 09:58:06.624200 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614053    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 09:58:06.624200 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614055    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 09:58:06.624200 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614058    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 09:58:06.624200 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614062    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 09:58:06.624200 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614066    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 09:58:06.624200 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614069    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 09:58:06.624200 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614072    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 09:58:06.624200 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614076    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 09:58:06.625065 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614079    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 09:58:06.625065 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614081    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 09:58:06.625065 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614084    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 09:58:06.625065 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614087    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 09:58:06.625065 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614090    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 09:58:06.625065 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614092    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 09:58:06.625065 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614095    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 09:58:06.625065 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614097    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 09:58:06.625065 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614099    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 09:58:06.625065 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614102    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 09:58:06.625065 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614104    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 09:58:06.625065 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614107    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 09:58:06.625065 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614110    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 09:58:06.625065 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614113    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 09:58:06.625065 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614115    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 09:58:06.625065 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614118    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 09:58:06.625065 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614120    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 09:58:06.625065 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614123    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 09:58:06.625065 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614125    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 09:58:06.625065 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614127    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 09:58:06.625658 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614130    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 09:58:06.625658 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614134    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 09:58:06.625658 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614137    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 09:58:06.625658 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614140    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 09:58:06.625658 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614143    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 09:58:06.625658 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614146    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 09:58:06.625658 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614148    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 09:58:06.625658 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614151    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 09:58:06.625658 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614153    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 09:58:06.625658 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614156    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 09:58:06.625658 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614159    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 09:58:06.625658 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614162    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 09:58:06.625658 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614165    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 09:58:06.625658 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614167    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 09:58:06.625658 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614170    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 09:58:06.625658 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614172    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 09:58:06.625658 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614175    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 09:58:06.625658 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614177    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 09:58:06.625658 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614180    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 09:58:06.625658 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614182    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 09:58:06.626234 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614184    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 09:58:06.626234 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614187    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 09:58:06.626234 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614189    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 09:58:06.626234 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614192    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 09:58:06.626234 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614195    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 09:58:06.626234 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614197    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 09:58:06.626234 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614200    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 09:58:06.626234 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614202    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 09:58:06.626234 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614205    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 09:58:06.626234 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614207    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 09:58:06.626234 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614210    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 09:58:06.626234 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614212    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 09:58:06.626234 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614215    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 09:58:06.626234 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614217    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 09:58:06.626234 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614220    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 09:58:06.626234 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614222    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 09:58:06.626234 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614225    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 09:58:06.626234 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614227    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 09:58:06.626234 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614230    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 09:58:06.626234 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614232    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 09:58:06.626769 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614234    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 09:58:06.626769 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614237    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 09:58:06.626769 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614240    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 09:58:06.626769 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614243    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 09:58:06.626769 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614246    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 09:58:06.626769 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614248    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 09:58:06.626769 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614251    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 09:58:06.626769 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.614253    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 09:58:06.626769 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.614258    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 09:58:06.626769 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.622792    2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 08 09:58:06.626769 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.622811    2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 08 09:58:06.626769 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.623785    2579 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 08 09:58:06.626769 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.623804    2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 08 09:58:06.626769 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.623891    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 09:58:06.626769 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.623898    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 09:58:06.627324 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.623904    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 09:58:06.627324 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.623908    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 09:58:06.627324 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.623913    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 09:58:06.627324 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.623919    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 09:58:06.627324 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.623923    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 09:58:06.627324 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.623927    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 09:58:06.627324 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.623932    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 09:58:06.627324 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.623936    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 09:58:06.627324 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.623940    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 09:58:06.627324 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.623947    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 09:58:06.627324 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.623953    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 09:58:06.627324 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.623958    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 09:58:06.627324 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.623963    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 09:58:06.627324 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.623969    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 09:58:06.627324 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.623973    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 09:58:06.627324 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.623978    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 09:58:06.627324 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.623983    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 09:58:06.627324 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.623987    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 09:58:06.627324 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.623991    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 09:58:06.627324 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.623996    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 09:58:06.628209 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624000    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 09:58:06.628209 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624004    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 09:58:06.628209 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624008    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 09:58:06.628209 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624012    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 09:58:06.628209 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624016    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 09:58:06.628209 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624020    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 09:58:06.628209 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624025    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 09:58:06.628209 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624031    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 09:58:06.628209 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624035    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 09:58:06.628209 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624039    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 09:58:06.628209 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624043    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 09:58:06.628209 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624048    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 09:58:06.628209 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624052    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 09:58:06.628209 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624056    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 09:58:06.628209 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624060    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 09:58:06.628209 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624064    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 09:58:06.628209 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624068    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 09:58:06.628209 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624072    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 09:58:06.628209 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624076    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 09:58:06.628209 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624080    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 09:58:06.628771 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624084    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 09:58:06.628771 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624089    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 09:58:06.628771 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624093    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 09:58:06.628771 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624097    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 09:58:06.628771 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624101    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 09:58:06.628771 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624105    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 09:58:06.628771 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624110    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 09:58:06.628771 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624113    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 09:58:06.628771 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624117    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 09:58:06.628771 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624121    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 09:58:06.628771 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624126    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 09:58:06.628771 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624130    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 09:58:06.628771 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624134    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 09:58:06.628771 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624137    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 09:58:06.628771 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624141    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 09:58:06.628771 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624145    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 09:58:06.628771 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624149    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 09:58:06.628771 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624154    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 09:58:06.628771 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624158    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 09:58:06.628771 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624162    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 09:58:06.629395 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624169    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 09:58:06.629395 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624174    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 09:58:06.629395 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624178    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 09:58:06.629395 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624182    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 09:58:06.629395 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624186    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 09:58:06.629395 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624190    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 09:58:06.629395 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624194    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 09:58:06.629395 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624198    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 09:58:06.629395 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624202    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 09:58:06.629395 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624205    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 09:58:06.629395 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624209    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 09:58:06.629395 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624212    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 09:58:06.629395 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624216    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 09:58:06.629395 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624220    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 09:58:06.629395 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624224    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 09:58:06.629395 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624228    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 09:58:06.629395 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624232    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 09:58:06.629395 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624236    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 09:58:06.629395 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624240    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 09:58:06.630000 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624245    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 09:58:06.630000 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624249    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 09:58:06.630000 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624253    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 09:58:06.630000 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624259    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 09:58:06.630000 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624265    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 09:58:06.630000 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624269    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 09:58:06.630000 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624274    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 09:58:06.630000 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624278    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 09:58:06.630000 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624283    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 09:58:06.630000 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624287    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 09:58:06.630000 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624291    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 09:58:06.630000 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624295    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 09:58:06.630000 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624299    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 09:58:06.630000 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624303    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 09:58:06.630000 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624308    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 09:58:06.630000 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624312    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 09:58:06.630000 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624316    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 09:58:06.630000 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624320    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 09:58:06.630495 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.624328    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 09:58:06.630495 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624501    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 09:58:06.630495 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624509    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 09:58:06.630495 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624514    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 09:58:06.630495 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624518    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 09:58:06.630495 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624523    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 09:58:06.630495 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624527    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 09:58:06.630495 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624553    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 09:58:06.630495 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624558    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 09:58:06.630495 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624562    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 09:58:06.630495 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624566    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 09:58:06.630495 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624570    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 09:58:06.630495 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624581    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 09:58:06.630495 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624586    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 09:58:06.630495 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624589    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 09:58:06.630886 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624593    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 09:58:06.630886 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624597    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 09:58:06.630886 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624601    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 09:58:06.630886 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624605    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 09:58:06.630886 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624609    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 09:58:06.630886 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624613    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 09:58:06.630886 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624617    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 09:58:06.630886 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624621    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 09:58:06.630886 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624626    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 09:58:06.630886 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624632    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 09:58:06.630886 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624638    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 09:58:06.630886 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624643    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 09:58:06.630886 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624648    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 09:58:06.630886 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624652    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 09:58:06.630886 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624658    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 09:58:06.630886 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624662    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 09:58:06.630886 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624667    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 09:58:06.630886 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624671    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 09:58:06.630886 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624675    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 09:58:06.631428 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624678    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 09:58:06.631428 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624682    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 09:58:06.631428 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624686    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 09:58:06.631428 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624690    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 09:58:06.631428 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624694    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 09:58:06.631428 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624698    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 09:58:06.631428 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624702    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 09:58:06.631428 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624706    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 09:58:06.631428 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624710    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 09:58:06.631428 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624715    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 09:58:06.631428 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624719    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 09:58:06.631428 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624722    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 09:58:06.631428 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624727    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 09:58:06.631428 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624731    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 09:58:06.631428 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624736    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 09:58:06.631428 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624740    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 09:58:06.631428 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624743    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 09:58:06.631428 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624747    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 09:58:06.631428 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624752    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 09:58:06.631428 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624755    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 09:58:06.631924 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624759    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 09:58:06.631924 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624763    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 09:58:06.631924 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624767    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 09:58:06.631924 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624771    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 09:58:06.631924 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624775    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 09:58:06.631924 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624779    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 09:58:06.631924 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624783    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 09:58:06.631924 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624787    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 09:58:06.631924 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624793    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 09:58:06.631924 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624797    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 09:58:06.631924 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624801    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 09:58:06.631924 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624805    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 09:58:06.631924 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624810    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 09:58:06.631924 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624814    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 09:58:06.631924 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624817    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 09:58:06.631924 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624821    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 09:58:06.631924 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624825    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 09:58:06.631924 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624829    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 09:58:06.631924 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624833    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 09:58:06.631924 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624837    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 09:58:06.632458 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624841    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 09:58:06.632458 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624846    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 09:58:06.632458 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624850    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 09:58:06.632458 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624854    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 09:58:06.632458 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624860    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 09:58:06.632458 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624865    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 09:58:06.632458 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624871    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 09:58:06.632458 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624875    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 09:58:06.632458 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624879    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 09:58:06.632458 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624883    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 09:58:06.632458 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624887    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 09:58:06.632458 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624891    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 09:58:06.632458 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624895    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 09:58:06.632458 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624899    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 09:58:06.632458 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624904    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 09:58:06.632458 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624910    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 09:58:06.632458 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624915    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 09:58:06.632458 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624920    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 09:58:06.632458 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624924    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 09:58:06.633086 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624928    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 09:58:06.633086 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624932    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 09:58:06.633086 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624937    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 09:58:06.633086 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624941    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 09:58:06.633086 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624946    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 09:58:06.633086 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624950    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 09:58:06.633086 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:06.624954    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 09:58:06.633086 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.624962    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 09:58:06.633086 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.625109    2579 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 08 09:58:06.633086 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.628997    2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 08 09:58:06.633086 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.630200    2579 server.go:1019] "Starting client certificate rotation"
Sep 08 09:58:06.633086 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.630306    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 08 09:58:06.633086 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.631162    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 08 09:58:06.633512 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.633479    2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 08 09:58:06.639674 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.639653    2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 08 09:58:06.650182 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.650166    2579 log.go:25] "Validated CRI v1 runtime API"
Sep 08 09:58:06.653633 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.653615    2579 log.go:25] "Validated CRI v1 image API"
Sep 08 09:58:06.654465 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.654450    2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 08 09:58:06.659688 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.659662    2579 fs.go:135] Filesystem UUIDs: map[0626f499-e3b6-4bc8-ad44-37bea96d85c2:/dev/nvme0n1p4 5e6ce47d-b90f-4eb2-8d2f-7278a581285f:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Sep 08 09:58:06.659688 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.659681    2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 08 09:58:06.659819 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.659803    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 08 09:58:06.664976 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.664866    2579 manager.go:216] Machine: {Timestamp:2026-09-08 09:58:06.663412094 +0000 UTC m=+0.359010984 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096889 MemoryCapacity:32812154880 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20f2bba35e19696d35ddb253a80ad4 SystemUUID:ec20f2bb-a35e-1969-6d35-ddb253a80ad4 BootID:2205dba2-ed78-4daf-9ff6-f3bbda8665d1 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:df:9e:78:91:01 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:df:9e:78:91:01 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b6:85:d9:40:e7:9e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812154880 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 08 09:58:06.664976 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.664966    2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 08 09:58:06.665083 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.665039    2579 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 08 09:58:06.668619 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.668591    2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 08 09:58:06.668799 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.668623    2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-96.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 08 09:58:06.669553 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.669523    2579 topology_manager.go:138] "Creating topology manager with none policy"
Sep 08 09:58:06.669610 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.669556    2579 container_manager_linux.go:309] "Creating device plugin manager"
Sep 08 09:58:06.669610 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.669573    2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 08 09:58:06.670430 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.670418    2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 08 09:58:06.671720 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.671708    2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 08 09:58:06.676348 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.676334    2579 state_mem.go:36] "Initialized new in-memory state store"
Sep 08 09:58:06.676475 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.676464    2579 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 08 09:58:06.676529 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.676502    2579 kubelet.go:486] "Attempting to sync node with API server"
Sep 08 09:58:06.676529 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.676516    2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 08 09:58:06.676636 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.676531    2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 08 09:58:06.676636 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.676564    2579 kubelet.go:398] "Adding apiserver pod source"
Sep 08 09:58:06.676636 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.676585    2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 08 09:58:06.677019 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.677004    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 08 09:58:06.677082 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.677038    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 08 09:58:06.680027 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.680007    2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 08 09:58:06.684357 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.684336    2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 08 09:58:06.684420 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.684383    2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 08 09:58:06.685868 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.685847    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zvnqk"
Sep 08 09:58:06.685947 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.685869    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 08 09:58:06.685947 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.685896    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 08 09:58:06.685947 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.685918    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 08 09:58:06.685947 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.685926    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 08 09:58:06.686080 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.685963    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 08 09:58:06.686080 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.686004    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 08 09:58:06.686278 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.686264    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 08 09:58:06.686310 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.686283    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 08 09:58:06.686310 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.686294    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 08 09:58:06.686310 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.686305    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 08 09:58:06.686401 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.686319    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 08 09:58:06.686401 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.686327    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 08 09:58:06.687330 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.687318    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 08 09:58:06.687373 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.687331    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 08 09:58:06.687772 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:06.687748    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-96.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 08 09:58:06.687827 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:06.687810    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 08 09:58:06.691100 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.691087    2579 server.go:1268] "Started kubelet"
Sep 08 09:58:06.691180 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.691153    2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 08 09:58:06.691237 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.691167    2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 08 09:58:06.691237 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.691230    2579 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 08 09:58:06.691844 ip-10-0-132-96 systemd[1]: Started Kubernetes Kubelet.
Sep 08 09:58:06.692330 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.692182    2579 server.go:310] "Adding debug handlers to kubelet server"
Sep 08 09:58:06.692862 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.692798    2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 08 09:58:06.692994 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.692977    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zvnqk"
Sep 08 09:58:06.697553 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:06.697519    2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 08 09:58:06.699665 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.699649    2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 08 09:58:06.699751 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.699717    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 08 09:58:06.699805 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.699762    2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-96.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 08 09:58:06.699805 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:06.699791    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-96.ec2.internal\" not found"
Sep 08 09:58:06.700452 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.700437    2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 08 09:58:06.700817 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.700799    2579 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 08 09:58:06.700817 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.700817    2579 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 08 09:58:06.700966 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:06.699733    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-96.ec2.internal.18d3500b5a990849  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-96.ec2.internal,UID:ip-10-0-132-96.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-96.ec2.internal,},FirstTimestamp:2026-09-08 09:58:06.691059785 +0000 UTC m=+0.386658676,LastTimestamp:2026-09-08 09:58:06.691059785 +0000 UTC m=+0.386658676,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-96.ec2.internal,}"
Sep 08 09:58:06.700966 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.700928    2579 reconstruct.go:97] "Volume reconstruction finished"
Sep 08 09:58:06.700966 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.700957    2579 reconciler.go:29] "Reconciler: start to sync state"
Sep 08 09:58:06.700966 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.700929    2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 08 09:58:06.701129 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.700977    2579 factory.go:55] Registering systemd factory
Sep 08 09:58:06.701129 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.700987    2579 factory.go:223] Registration of the systemd container factory successfully
Sep 08 09:58:06.701205 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.701157    2579 factory.go:153] Registering CRI-O factory
Sep 08 09:58:06.701205 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.701169    2579 factory.go:223] Registration of the crio container factory successfully
Sep 08 09:58:06.701205 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.701181    2579 factory.go:103] Registering Raw factory
Sep 08 09:58:06.701205 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.701190    2579 manager.go:1196] Started watching for new ooms in manager
Sep 08 09:58:06.701580 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.701566    2579 manager.go:349] Starting recovery of all containers
Sep 08 09:58:06.706076 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.706051    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 09:58:06.709261 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:06.709233    2579 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-132-96.ec2.internal\" not found" node="ip-10-0-132-96.ec2.internal"
Sep 08 09:58:06.712646 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.712436    2579 manager.go:354] Recovery completed
Sep 08 09:58:06.717476 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.717460    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 09:58:06.719814 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.719800    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-96.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 09:58:06.719874 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.719829    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-96.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 09:58:06.719874 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.719843    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-96.ec2.internal" event="NodeHasSufficientPID"
Sep 08 09:58:06.720359 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.720345    2579 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 08 09:58:06.720396 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.720360    2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 08 09:58:06.720396 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.720363    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 09:58:06.720396 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.720381    2579 state_mem.go:36] "Initialized new in-memory state store"
Sep 08 09:58:06.722323 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.722308    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-96.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 09:58:06.722410 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.722333    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-96.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 09:58:06.722410 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.722348    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-96.ec2.internal" event="NodeHasSufficientPID"
Sep 08 09:58:06.722510 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.722486    2579 policy_none.go:49] "None policy: Start"
Sep 08 09:58:06.722510 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.722498    2579 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 08 09:58:06.722510 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.722508    2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 08 09:58:06.724670 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.724642    2579 policy_none.go:47] "Start"
Sep 08 09:58:06.760126 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.760113    2579 manager.go:337] "Starting Device Plugin manager"
Sep 08 09:58:06.776524 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:06.760146    2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 08 09:58:06.776524 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.760158    2579 server.go:87] "Starting device plugin registration server"
Sep 08 09:58:06.776524 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.760436    2579 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 08 09:58:06.776524 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.760454    2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 08 09:58:06.776524 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.760564    2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 08 09:58:06.776524 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.760664    2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 08 09:58:06.776524 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.760686    2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 08 09:58:06.776524 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:06.761082    2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 08 09:58:06.776524 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:06.761131    2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-96.ec2.internal\" not found"
Sep 08 09:58:06.824798 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.824771    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 08 09:58:06.826081 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.826063    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 08 09:58:06.826134 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.826122    2579 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 08 09:58:06.826170 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.826148    2579 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 08 09:58:06.826216 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:06.826191    2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 08 09:58:06.828365 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.828339    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 09:58:06.861218 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.861139    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 09:58:06.861957 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.861941    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-96.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 09:58:06.862037 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.861975    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-96.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 09:58:06.862037 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.861989    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-96.ec2.internal" event="NodeHasSufficientPID"
Sep 08 09:58:06.862037 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.862017    2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-96.ec2.internal"
Sep 08 09:58:06.868147 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.868134    2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-96.ec2.internal"
Sep 08 09:58:06.868213 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:06.868153    2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-96.ec2.internal\": node \"ip-10-0-132-96.ec2.internal\" not found"
Sep 08 09:58:06.891917 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:06.891893    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-96.ec2.internal\" not found"
Sep 08 09:58:06.926642 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.926616    2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-96.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-96.ec2.internal"]
Sep 08 09:58:06.926710 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.926691    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 09:58:06.928147 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.928128    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-96.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 09:58:06.928237 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.928154    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-96.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 09:58:06.928237 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.928164    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-96.ec2.internal" event="NodeHasSufficientPID"
Sep 08 09:58:06.930558 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.930529    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 09:58:06.930673 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.930660    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-96.ec2.internal"
Sep 08 09:58:06.930708 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.930689    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 09:58:06.931315 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.931297    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-96.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 09:58:06.931370 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.931332    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-96.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 09:58:06.931370 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.931343    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-96.ec2.internal" event="NodeHasSufficientPID"
Sep 08 09:58:06.931441 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.931297    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-96.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 09:58:06.931441 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.931406    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-96.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 09:58:06.931441 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.931419    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-96.ec2.internal" event="NodeHasSufficientPID"
Sep 08 09:58:06.933753 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.933736    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-96.ec2.internal"
Sep 08 09:58:06.933796 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.933770    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 09:58:06.934430 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.934413    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-96.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 09:58:06.934531 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.934439    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-96.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 09:58:06.934531 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:06.934452    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-96.ec2.internal" event="NodeHasSufficientPID"
Sep 08 09:58:06.958063 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:06.958038    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-96.ec2.internal\" not found" node="ip-10-0-132-96.ec2.internal"
Sep 08 09:58:06.962201 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:06.962186    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-96.ec2.internal\" not found" node="ip-10-0-132-96.ec2.internal"
Sep 08 09:58:06.992728 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:06.992710    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-96.ec2.internal\" not found"
Sep 08 09:58:07.003421 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:07.003400    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ba08d37bcb40217ed6ffc66b79f33b9e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-96.ec2.internal\" (UID: \"ba08d37bcb40217ed6ffc66b79f33b9e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-96.ec2.internal"
Sep 08 09:58:07.003469 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:07.003425    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba08d37bcb40217ed6ffc66b79f33b9e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-96.ec2.internal\" (UID: \"ba08d37bcb40217ed6ffc66b79f33b9e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-96.ec2.internal"
Sep 08 09:58:07.003469 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:07.003451    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/39c5e68f9a1e6fb3d5599c7ac75713d7-config\") pod \"kube-apiserver-proxy-ip-10-0-132-96.ec2.internal\" (UID: \"39c5e68f9a1e6fb3d5599c7ac75713d7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-96.ec2.internal"
Sep 08 09:58:07.093415 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:07.093384    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-96.ec2.internal\" not found"
Sep 08 09:58:07.103804 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:07.103785    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ba08d37bcb40217ed6ffc66b79f33b9e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-96.ec2.internal\" (UID: \"ba08d37bcb40217ed6ffc66b79f33b9e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-96.ec2.internal"
Sep 08 09:58:07.103856 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:07.103809    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba08d37bcb40217ed6ffc66b79f33b9e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-96.ec2.internal\" (UID: \"ba08d37bcb40217ed6ffc66b79f33b9e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-96.ec2.internal"
Sep 08 09:58:07.103856 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:07.103826    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/39c5e68f9a1e6fb3d5599c7ac75713d7-config\") pod \"kube-apiserver-proxy-ip-10-0-132-96.ec2.internal\" (UID: \"39c5e68f9a1e6fb3d5599c7ac75713d7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-96.ec2.internal"
Sep 08 09:58:07.103920 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:07.103903    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ba08d37bcb40217ed6ffc66b79f33b9e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-96.ec2.internal\" (UID: \"ba08d37bcb40217ed6ffc66b79f33b9e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-96.ec2.internal"
Sep 08 09:58:07.103955 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:07.103906    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ba08d37bcb40217ed6ffc66b79f33b9e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-96.ec2.internal\" (UID: \"ba08d37bcb40217ed6ffc66b79f33b9e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-96.ec2.internal"
Sep 08 09:58:07.103955 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:07.103906    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/39c5e68f9a1e6fb3d5599c7ac75713d7-config\") pod \"kube-apiserver-proxy-ip-10-0-132-96.ec2.internal\" (UID: \"39c5e68f9a1e6fb3d5599c7ac75713d7\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-96.ec2.internal"
Sep 08 09:58:07.194219 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:07.194161    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-96.ec2.internal\" not found"
Sep 08 09:58:07.260671 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:07.260647    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-96.ec2.internal"
Sep 08 09:58:07.265624 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:07.265385    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-96.ec2.internal"
Sep 08 09:58:07.294596 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:07.294573    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-96.ec2.internal\" not found"
Sep 08 09:58:07.395105 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:07.395072    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-96.ec2.internal\" not found"
Sep 08 09:58:07.495665 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:07.495593    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-96.ec2.internal\" not found"
Sep 08 09:58:07.569290 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:07.569268    2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 09:58:07.596381 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:07.596352    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-96.ec2.internal\" not found"
Sep 08 09:58:07.629895 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:07.629874    2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 08 09:58:07.630261 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:07.629983    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 08 09:58:07.630261 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:07.629990    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 08 09:58:07.630261 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:07.629996    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 08 09:58:07.697377 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:07.697346    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-96.ec2.internal\" not found"
Sep 08 09:58:07.698452 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:07.698428    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-07 09:53:07 +0000 UTC" deadline="2028-05-06 17:32:09.524122104 +0000 UTC"
Sep 08 09:58:07.698503 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:07.698452    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14551h34m1.825672409s"
Sep 08 09:58:07.793179 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:07.793113    2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 09:58:07.800729 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:07.800708    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-96.ec2.internal"
Sep 08 09:58:07.811929 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:07.811915    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 08 09:58:07.812755 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:07.812741    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-96.ec2.internal"
Sep 08 09:58:07.821007 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:07.820995    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 08 09:58:07.973299 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:07.973264    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39c5e68f9a1e6fb3d5599c7ac75713d7.slice/crio-1d7d30a147cd3be755232df3595d3135d94d7a674fe480b84c54aaee375edc14 WatchSource:0}: Error finding container 1d7d30a147cd3be755232df3595d3135d94d7a674fe480b84c54aaee375edc14: Status 404 returned error can't find the container with id 1d7d30a147cd3be755232df3595d3135d94d7a674fe480b84c54aaee375edc14
Sep 08 09:58:07.973663 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:07.973644    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba08d37bcb40217ed6ffc66b79f33b9e.slice/crio-285019abcaf47c75931ce1cbe8d3d5066612aef09362bbe8063652d34cc8ddc8 WatchSource:0}: Error finding container 285019abcaf47c75931ce1cbe8d3d5066612aef09362bbe8063652d34cc8ddc8: Status 404 returned error can't find the container with id 285019abcaf47c75931ce1cbe8d3d5066612aef09362bbe8063652d34cc8ddc8
Sep 08 09:58:07.977856 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:07.977842    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 09:58:08.677515 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.677476    2579 apiserver.go:52] "Watching apiserver"
Sep 08 09:58:08.687361 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.687334    2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 08 09:58:08.688838 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.688807    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-kz86g","kube-system/global-pull-secret-syncer-j4t5c","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsc2q","openshift-dns/node-resolver-wdvlk","openshift-image-registry/node-ca-2zsx5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-96.ec2.internal","openshift-multus/multus-85r8m","openshift-multus/network-metrics-daemon-b5m55","openshift-network-operator/iptables-alerter-pjsr4","kube-system/konnectivity-agent-8l4t6","kube-system/kube-apiserver-proxy-ip-10-0-132-96.ec2.internal","openshift-cluster-node-tuning-operator/tuned-l52p6","openshift-multus/multus-additional-cni-plugins-dcfdx","openshift-network-diagnostics/network-check-target-8lnsn"]
Sep 08 09:58:08.691560 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.691503    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-85r8m"
Sep 08 09:58:08.693878 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.693858    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dcfdx"
Sep 08 09:58:08.694376 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.694356    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 08 09:58:08.694793 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.694600    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 08 09:58:08.694793 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.694622    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 08 09:58:08.694793 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.694637    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vzdz5\""
Sep 08 09:58:08.694793 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.694630    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 08 09:58:08.696106 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.696086    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsc2q"
Sep 08 09:58:08.696674 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.696654    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-cz7l6\""
Sep 08 09:58:08.696674 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.696672    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 08 09:58:08.696828 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.696790    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 08 09:58:08.698528 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.698506    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 08 09:58:08.698675 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.698660    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wdvlk"
Sep 08 09:58:08.698945 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.698778    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 08 09:58:08.699016 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.698970    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 08 09:58:08.699072 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.699052    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jdn5r\""
Sep 08 09:58:08.700752 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.700731    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 08 09:58:08.701156 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.701139    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2zsx5"
Sep 08 09:58:08.701253 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.701195    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-4crkm\""
Sep 08 09:58:08.701422 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.701405    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 08 09:58:08.701496 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.701474    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 08 09:58:08.703436 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.703416    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8lnsn"
Sep 08 09:58:08.703540 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:08.703503    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8lnsn" podUID="6829ca1d-d62e-446a-a557-43217aba9a6f"
Sep 08 09:58:08.703827 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.703806    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 08 09:58:08.703913 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.703830    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 08 09:58:08.704091 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.704060    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 08 09:58:08.704167 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.704061    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-499wv\""
Sep 08 09:58:08.706285 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.706264    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pjsr4"
Sep 08 09:58:08.708314 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.708293    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b5m55"
Sep 08 09:58:08.708410 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:08.708377    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b5m55" podUID="3868a1c3-46c6-4940-92ed-e460b77d7cfc"
Sep 08 09:58:08.709132 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.709113    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 08 09:58:08.709234 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.709113    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-gbwdq\""
Sep 08 09:58:08.709234 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.709143    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 08 09:58:08.709234 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.709208    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 08 09:58:08.710789 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.710772    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j4t5c"
Sep 08 09:58:08.711128 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:08.711101    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j4t5c" podUID="3ce5d383-ffe7-47c5-8960-4553f5dfd4c4"
Sep 08 09:58:08.714199 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.714168    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03e3282b-d719-4d88-ac22-72691939bdac-multus-cni-dir\") pod \"multus-85r8m\" (UID: \"03e3282b-d719-4d88-ac22-72691939bdac\") " pod="openshift-multus/multus-85r8m"
Sep 08 09:58:08.714309 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.714209    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/03e3282b-d719-4d88-ac22-72691939bdac-host-run-multus-certs\") pod \"multus-85r8m\" (UID: \"03e3282b-d719-4d88-ac22-72691939bdac\") " pod="openshift-multus/multus-85r8m"
Sep 08 09:58:08.714309 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.714248    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/313cffc0-94c1-466a-8a57-750151daa9ea-hosts-file\") pod \"node-resolver-wdvlk\" (UID: \"313cffc0-94c1-466a-8a57-750151daa9ea\") " pod="openshift-dns/node-resolver-wdvlk"
Sep 08 09:58:08.714427 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.714349    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4a41ec82-3e27-4c50-b580-861230051e27-serviceca\") pod \"node-ca-2zsx5\" (UID: \"4a41ec82-3e27-4c50-b580-861230051e27\") " pod="openshift-image-registry/node-ca-2zsx5"
Sep 08 09:58:08.714427 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.714394    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5tr4\" (UniqueName: \"kubernetes.io/projected/4a41ec82-3e27-4c50-b580-861230051e27-kube-api-access-z5tr4\") pod \"node-ca-2zsx5\" (UID: \"4a41ec82-3e27-4c50-b580-861230051e27\") " pod="openshift-image-registry/node-ca-2zsx5"
Sep 08 09:58:08.714532 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.714435    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1425c284-4dee-4ed4-a65f-8c1dc7283c8f-system-cni-dir\") pod \"multus-additional-cni-plugins-dcfdx\" (UID: \"1425c284-4dee-4ed4-a65f-8c1dc7283c8f\") " pod="openshift-multus/multus-additional-cni-plugins-dcfdx"
Sep 08 09:58:08.714532 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.714475    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8l4t6"
Sep 08 09:58:08.714532 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.714497    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1425c284-4dee-4ed4-a65f-8c1dc7283c8f-cnibin\") pod \"multus-additional-cni-plugins-dcfdx\" (UID: \"1425c284-4dee-4ed4-a65f-8c1dc7283c8f\") " pod="openshift-multus/multus-additional-cni-plugins-dcfdx"
Sep 08 09:58:08.714694 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.714632    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1425c284-4dee-4ed4-a65f-8c1dc7283c8f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dcfdx\" (UID: \"1425c284-4dee-4ed4-a65f-8c1dc7283c8f\") " pod="openshift-multus/multus-additional-cni-plugins-dcfdx"
Sep 08 09:58:08.714694 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.714673    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/73d345ba-36c0-46ab-b6d8-7351693d21a5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lsc2q\" (UID: \"73d345ba-36c0-46ab-b6d8-7351693d21a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsc2q"
Sep 08 09:58:08.714771 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.714732    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/73d345ba-36c0-46ab-b6d8-7351693d21a5-socket-dir\") pod \"aws-ebs-csi-driver-node-lsc2q\" (UID: \"73d345ba-36c0-46ab-b6d8-7351693d21a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsc2q"
Sep 08 09:58:08.714813 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.714773    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/73d345ba-36c0-46ab-b6d8-7351693d21a5-device-dir\") pod \"aws-ebs-csi-driver-node-lsc2q\" (UID: \"73d345ba-36c0-46ab-b6d8-7351693d21a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsc2q"
Sep 08 09:58:08.714813 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.714803    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4a41ec82-3e27-4c50-b580-861230051e27-host\") pod \"node-ca-2zsx5\" (UID: \"4a41ec82-3e27-4c50-b580-861230051e27\") " pod="openshift-image-registry/node-ca-2zsx5"
Sep 08 09:58:08.714891 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.714829    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03e3282b-d719-4d88-ac22-72691939bdac-system-cni-dir\") pod \"multus-85r8m\" (UID: \"03e3282b-d719-4d88-ac22-72691939bdac\") " pod="openshift-multus/multus-85r8m"
Sep 08 09:58:08.714928 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.714881    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/03e3282b-d719-4d88-ac22-72691939bdac-cnibin\") pod \"multus-85r8m\" (UID: \"03e3282b-d719-4d88-ac22-72691939bdac\") " pod="openshift-multus/multus-85r8m"
Sep 08 09:58:08.714966 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.714945    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1425c284-4dee-4ed4-a65f-8c1dc7283c8f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dcfdx\" (UID: \"1425c284-4dee-4ed4-a65f-8c1dc7283c8f\") " pod="openshift-multus/multus-additional-cni-plugins-dcfdx"
Sep 08 09:58:08.715005 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.714968    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/03e3282b-d719-4d88-ac22-72691939bdac-multus-socket-dir-parent\") pod \"multus-85r8m\" (UID: \"03e3282b-d719-4d88-ac22-72691939bdac\") " pod="openshift-multus/multus-85r8m"
Sep 08 09:58:08.715005 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.714989    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1425c284-4dee-4ed4-a65f-8c1dc7283c8f-cni-binary-copy\") pod \"multus-additional-cni-plugins-dcfdx\" (UID: \"1425c284-4dee-4ed4-a65f-8c1dc7283c8f\") " pod="openshift-multus/multus-additional-cni-plugins-dcfdx"
Sep 08 09:58:08.715081 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.715009    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/73d345ba-36c0-46ab-b6d8-7351693d21a5-etc-selinux\") pod \"aws-ebs-csi-driver-node-lsc2q\" (UID: \"73d345ba-36c0-46ab-b6d8-7351693d21a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsc2q"
Sep 08 09:58:08.715133 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.715107    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/03e3282b-d719-4d88-ac22-72691939bdac-cni-binary-copy\") pod \"multus-85r8m\" (UID: \"03e3282b-d719-4d88-ac22-72691939bdac\") " pod="openshift-multus/multus-85r8m"
Sep 08 09:58:08.715189 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.715148    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/03e3282b-d719-4d88-ac22-72691939bdac-host-run-k8s-cni-cncf-io\") pod \"multus-85r8m\" (UID: \"03e3282b-d719-4d88-ac22-72691939bdac\") " pod="openshift-multus/multus-85r8m"
Sep 08 09:58:08.715242 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.715187    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/03e3282b-d719-4d88-ac22-72691939bdac-host-var-lib-kubelet\") pod \"multus-85r8m\" (UID: \"03e3282b-d719-4d88-ac22-72691939bdac\") " pod="openshift-multus/multus-85r8m"
Sep 08 09:58:08.715242 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.715218    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xhck\" (UniqueName: \"kubernetes.io/projected/03e3282b-d719-4d88-ac22-72691939bdac-kube-api-access-6xhck\") pod \"multus-85r8m\" (UID: \"03e3282b-d719-4d88-ac22-72691939bdac\") " pod="openshift-multus/multus-85r8m"
Sep 08 09:58:08.715343 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.715260    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/73d345ba-36c0-46ab-b6d8-7351693d21a5-sys-fs\") pod \"aws-ebs-csi-driver-node-lsc2q\" (UID: \"73d345ba-36c0-46ab-b6d8-7351693d21a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsc2q"
Sep 08 09:58:08.715343 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.715299    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/03e3282b-d719-4d88-ac22-72691939bdac-host-run-netns\") pod \"multus-85r8m\" (UID: \"03e3282b-d719-4d88-ac22-72691939bdac\") " pod="openshift-multus/multus-85r8m"
Sep 08 09:58:08.715343 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.715334    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/03e3282b-d719-4d88-ac22-72691939bdac-host-var-lib-cni-bin\") pod \"multus-85r8m\" (UID: \"03e3282b-d719-4d88-ac22-72691939bdac\") " pod="openshift-multus/multus-85r8m"
Sep 08 09:58:08.715490 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.715364    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/03e3282b-d719-4d88-ac22-72691939bdac-host-var-lib-cni-multus\") pod \"multus-85r8m\" (UID: \"03e3282b-d719-4d88-ac22-72691939bdac\") " pod="openshift-multus/multus-85r8m"
Sep 08 09:58:08.715490 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.715414    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/03e3282b-d719-4d88-ac22-72691939bdac-multus-conf-dir\") pod \"multus-85r8m\" (UID: \"03e3282b-d719-4d88-ac22-72691939bdac\") " pod="openshift-multus/multus-85r8m"
Sep 08 09:58:08.715583 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.715512    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/03e3282b-d719-4d88-ac22-72691939bdac-multus-daemon-config\") pod \"multus-85r8m\" (UID: \"03e3282b-d719-4d88-ac22-72691939bdac\") " pod="openshift-multus/multus-85r8m"
Sep 08 09:58:08.715639 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.715607    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03e3282b-d719-4d88-ac22-72691939bdac-etc-kubernetes\") pod \"multus-85r8m\" (UID: \"03e3282b-d719-4d88-ac22-72691939bdac\") " pod="openshift-multus/multus-85r8m"
Sep 08 09:58:08.715694 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.715651    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1425c284-4dee-4ed4-a65f-8c1dc7283c8f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dcfdx\" (UID: \"1425c284-4dee-4ed4-a65f-8c1dc7283c8f\") " pod="openshift-multus/multus-additional-cni-plugins-dcfdx"
Sep 08 09:58:08.715771 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.715751    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqhdq\" (UniqueName: \"kubernetes.io/projected/1425c284-4dee-4ed4-a65f-8c1dc7283c8f-kube-api-access-qqhdq\") pod \"multus-additional-cni-plugins-dcfdx\" (UID: \"1425c284-4dee-4ed4-a65f-8c1dc7283c8f\") " pod="openshift-multus/multus-additional-cni-plugins-dcfdx"
Sep 08 09:58:08.715852 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.715820    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/03e3282b-d719-4d88-ac22-72691939bdac-hostroot\") pod \"multus-85r8m\" (UID: \"03e3282b-d719-4d88-ac22-72691939bdac\") " pod="openshift-multus/multus-85r8m"
Sep 08 09:58:08.715973 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.715895    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/73d345ba-36c0-46ab-b6d8-7351693d21a5-registration-dir\") pod \"aws-ebs-csi-driver-node-lsc2q\" (UID: \"73d345ba-36c0-46ab-b6d8-7351693d21a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsc2q"
Sep 08 09:58:08.715973 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.715933    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8b9l\" (UniqueName: \"kubernetes.io/projected/73d345ba-36c0-46ab-b6d8-7351693d21a5-kube-api-access-t8b9l\") pod \"aws-ebs-csi-driver-node-lsc2q\" (UID: \"73d345ba-36c0-46ab-b6d8-7351693d21a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsc2q"
Sep 08 09:58:08.716106 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.715980    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/313cffc0-94c1-466a-8a57-750151daa9ea-tmp-dir\") pod \"node-resolver-wdvlk\" (UID: \"313cffc0-94c1-466a-8a57-750151daa9ea\") " pod="openshift-dns/node-resolver-wdvlk"
Sep 08 09:58:08.717979 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.716021    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrb5r\" (UniqueName: \"kubernetes.io/projected/313cffc0-94c1-466a-8a57-750151daa9ea-kube-api-access-qrb5r\") pod \"node-resolver-wdvlk\" (UID: \"313cffc0-94c1-466a-8a57-750151daa9ea\") " pod="openshift-dns/node-resolver-wdvlk"
Sep 08 09:58:08.717979 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.717176    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-l52p6"
Sep 08 09:58:08.719560 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.719521    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-52wcm\""
Sep 08 09:58:08.719658 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.719585    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 08 09:58:08.719785 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.719769    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 08 09:58:08.719850 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.719784    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.719902 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.719852    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 08 09:58:08.720272 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.720250    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 08 09:58:08.720364 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.720309    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7lbr7\""
Sep 08 09:58:08.720364 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.720318    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 08 09:58:08.722662 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.722641    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 08 09:58:08.722846 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.722831    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 08 09:58:08.723193 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.723174    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 08 09:58:08.723470 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.723452    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 08 09:58:08.723543 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.723519    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 08 09:58:08.723692 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.723456    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gbzlz\""
Sep 08 09:58:08.723767 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.723747    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 08 09:58:08.730544 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.730526    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 09:58:08.744841 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.744823    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wcqff"
Sep 08 09:58:08.753502 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.753479    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wcqff"
Sep 08 09:58:08.801466 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.801447    2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 08 09:58:08.818082 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.818059    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0c248488-2449-4ff6-a079-8b466acd152e-log-socket\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.818256 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.818090    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ch5x\" (UniqueName: \"kubernetes.io/projected/0c248488-2449-4ff6-a079-8b466acd152e-kube-api-access-5ch5x\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.818256 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.818111    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1425c284-4dee-4ed4-a65f-8c1dc7283c8f-cnibin\") pod \"multus-additional-cni-plugins-dcfdx\" (UID: \"1425c284-4dee-4ed4-a65f-8c1dc7283c8f\") " pod="openshift-multus/multus-additional-cni-plugins-dcfdx"
Sep 08 09:58:08.818256 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.818137    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/73d345ba-36c0-46ab-b6d8-7351693d21a5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lsc2q\" (UID: \"73d345ba-36c0-46ab-b6d8-7351693d21a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsc2q"
Sep 08 09:58:08.818256 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.818203    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/73d345ba-36c0-46ab-b6d8-7351693d21a5-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lsc2q\" (UID: \"73d345ba-36c0-46ab-b6d8-7351693d21a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsc2q"
Sep 08 09:58:08.818256 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.818208    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/1425c284-4dee-4ed4-a65f-8c1dc7283c8f-cnibin\") pod \"multus-additional-cni-plugins-dcfdx\" (UID: \"1425c284-4dee-4ed4-a65f-8c1dc7283c8f\") " pod="openshift-multus/multus-additional-cni-plugins-dcfdx"
Sep 08 09:58:08.818256 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.818243    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/73d345ba-36c0-46ab-b6d8-7351693d21a5-device-dir\") pod \"aws-ebs-csi-driver-node-lsc2q\" (UID: \"73d345ba-36c0-46ab-b6d8-7351693d21a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsc2q"
Sep 08 09:58:08.818514 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.818271    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4a41ec82-3e27-4c50-b580-861230051e27-host\") pod \"node-ca-2zsx5\" (UID: \"4a41ec82-3e27-4c50-b580-861230051e27\") " pod="openshift-image-registry/node-ca-2zsx5"
Sep 08 09:58:08.818514 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.818292    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/73d345ba-36c0-46ab-b6d8-7351693d21a5-device-dir\") pod \"aws-ebs-csi-driver-node-lsc2q\" (UID: \"73d345ba-36c0-46ab-b6d8-7351693d21a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsc2q"
Sep 08 09:58:08.818514 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.818293    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/90152f2b-6780-4ce9-8938-aedd788ac94c-etc-kubernetes\") pod \"tuned-l52p6\" (UID: \"90152f2b-6780-4ce9-8938-aedd788ac94c\") " pod="openshift-cluster-node-tuning-operator/tuned-l52p6"
Sep 08 09:58:08.818514 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.818338    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4a41ec82-3e27-4c50-b580-861230051e27-host\") pod \"node-ca-2zsx5\" (UID: \"4a41ec82-3e27-4c50-b580-861230051e27\") " pod="openshift-image-registry/node-ca-2zsx5"
Sep 08 09:58:08.818514 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.818385    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/90152f2b-6780-4ce9-8938-aedd788ac94c-etc-systemd\") pod \"tuned-l52p6\" (UID: \"90152f2b-6780-4ce9-8938-aedd788ac94c\") " pod="openshift-cluster-node-tuning-operator/tuned-l52p6"
Sep 08 09:58:08.818514 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.818417    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90152f2b-6780-4ce9-8938-aedd788ac94c-tmp\") pod \"tuned-l52p6\" (UID: \"90152f2b-6780-4ce9-8938-aedd788ac94c\") " pod="openshift-cluster-node-tuning-operator/tuned-l52p6"
Sep 08 09:58:08.818514 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.818443    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03e3282b-d719-4d88-ac22-72691939bdac-system-cni-dir\") pod \"multus-85r8m\" (UID: \"03e3282b-d719-4d88-ac22-72691939bdac\") " pod="openshift-multus/multus-85r8m"
Sep 08 09:58:08.818514 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.818465    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c248488-2449-4ff6-a079-8b466acd152e-host-run-ovn-kubernetes\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.818514 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.818489    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krwls\" (UniqueName: \"kubernetes.io/projected/3868a1c3-46c6-4940-92ed-e460b77d7cfc-kube-api-access-krwls\") pod \"network-metrics-daemon-b5m55\" (UID: \"3868a1c3-46c6-4940-92ed-e460b77d7cfc\") " pod="openshift-multus/network-metrics-daemon-b5m55"
Sep 08 09:58:08.818938 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.818559    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/03e3282b-d719-4d88-ac22-72691939bdac-multus-socket-dir-parent\") pod \"multus-85r8m\" (UID: \"03e3282b-d719-4d88-ac22-72691939bdac\") " pod="openshift-multus/multus-85r8m"
Sep 08 09:58:08.818938 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.818598    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0c248488-2449-4ff6-a079-8b466acd152e-host-slash\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.818938 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.818604    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03e3282b-d719-4d88-ac22-72691939bdac-system-cni-dir\") pod \"multus-85r8m\" (UID: \"03e3282b-d719-4d88-ac22-72691939bdac\") " pod="openshift-multus/multus-85r8m"
Sep 08 09:58:08.818938 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.818620    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/03e3282b-d719-4d88-ac22-72691939bdac-multus-socket-dir-parent\") pod \"multus-85r8m\" (UID: \"03e3282b-d719-4d88-ac22-72691939bdac\") " pod="openshift-multus/multus-85r8m"
Sep 08 09:58:08.818938 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.818623    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0c248488-2449-4ff6-a079-8b466acd152e-run-ovn\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.818938 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.818672    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0c248488-2449-4ff6-a079-8b466acd152e-host-cni-netd\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.818938 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.818700    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8256cd1d-5778-4897-91b2-8a45f97f69dd-konnectivity-ca\") pod \"konnectivity-agent-8l4t6\" (UID: \"8256cd1d-5778-4897-91b2-8a45f97f69dd\") " pod="kube-system/konnectivity-agent-8l4t6"
Sep 08 09:58:08.818938 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.818727    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1425c284-4dee-4ed4-a65f-8c1dc7283c8f-cni-binary-copy\") pod \"multus-additional-cni-plugins-dcfdx\" (UID: \"1425c284-4dee-4ed4-a65f-8c1dc7283c8f\") " pod="openshift-multus/multus-additional-cni-plugins-dcfdx"
Sep 08 09:58:08.818938 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.818751    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/73d345ba-36c0-46ab-b6d8-7351693d21a5-etc-selinux\") pod \"aws-ebs-csi-driver-node-lsc2q\" (UID: \"73d345ba-36c0-46ab-b6d8-7351693d21a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsc2q"
Sep 08 09:58:08.818938 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.818774    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0c248488-2449-4ff6-a079-8b466acd152e-run-systemd\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.818938 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.818797    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1fa9f2a5-3fe1-439f-ac9d-c17fbb4a1e8e-iptables-alerter-script\") pod \"iptables-alerter-pjsr4\" (UID: \"1fa9f2a5-3fe1-439f-ac9d-c17fbb4a1e8e\") " pod="openshift-network-operator/iptables-alerter-pjsr4"
Sep 08 09:58:08.818938 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.818823    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3ce5d383-ffe7-47c5-8960-4553f5dfd4c4-dbus\") pod \"global-pull-secret-syncer-j4t5c\" (UID: \"3ce5d383-ffe7-47c5-8960-4553f5dfd4c4\") " pod="kube-system/global-pull-secret-syncer-j4t5c"
Sep 08 09:58:08.818938 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.818849    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ce5d383-ffe7-47c5-8960-4553f5dfd4c4-original-pull-secret\") pod \"global-pull-secret-syncer-j4t5c\" (UID: \"3ce5d383-ffe7-47c5-8960-4553f5dfd4c4\") " pod="kube-system/global-pull-secret-syncer-j4t5c"
Sep 08 09:58:08.818938 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.818871    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/73d345ba-36c0-46ab-b6d8-7351693d21a5-etc-selinux\") pod \"aws-ebs-csi-driver-node-lsc2q\" (UID: \"73d345ba-36c0-46ab-b6d8-7351693d21a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsc2q"
Sep 08 09:58:08.818938 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.818927    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/03e3282b-d719-4d88-ac22-72691939bdac-cni-binary-copy\") pod \"multus-85r8m\" (UID: \"03e3282b-d719-4d88-ac22-72691939bdac\") " pod="openshift-multus/multus-85r8m"
Sep 08 09:58:08.819523 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.818960    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/03e3282b-d719-4d88-ac22-72691939bdac-host-run-k8s-cni-cncf-io\") pod \"multus-85r8m\" (UID: \"03e3282b-d719-4d88-ac22-72691939bdac\") " pod="openshift-multus/multus-85r8m"
Sep 08 09:58:08.819523 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.818990    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xhck\" (UniqueName: \"kubernetes.io/projected/03e3282b-d719-4d88-ac22-72691939bdac-kube-api-access-6xhck\") pod \"multus-85r8m\" (UID: \"03e3282b-d719-4d88-ac22-72691939bdac\") " pod="openshift-multus/multus-85r8m"
Sep 08 09:58:08.819523 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.819021    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/73d345ba-36c0-46ab-b6d8-7351693d21a5-sys-fs\") pod \"aws-ebs-csi-driver-node-lsc2q\" (UID: \"73d345ba-36c0-46ab-b6d8-7351693d21a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsc2q"
Sep 08 09:58:08.819523 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.819056    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzfrc\" (UniqueName: \"kubernetes.io/projected/6829ca1d-d62e-446a-a557-43217aba9a6f-kube-api-access-xzfrc\") pod \"network-check-target-8lnsn\" (UID: \"6829ca1d-d62e-446a-a557-43217aba9a6f\") " pod="openshift-network-diagnostics/network-check-target-8lnsn"
Sep 08 09:58:08.819523 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.819053    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/03e3282b-d719-4d88-ac22-72691939bdac-host-run-k8s-cni-cncf-io\") pod \"multus-85r8m\" (UID: \"03e3282b-d719-4d88-ac22-72691939bdac\") " pod="openshift-multus/multus-85r8m"
Sep 08 09:58:08.819523 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.819086    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/90152f2b-6780-4ce9-8938-aedd788ac94c-etc-sysctl-d\") pod \"tuned-l52p6\" (UID: \"90152f2b-6780-4ce9-8938-aedd788ac94c\") " pod="openshift-cluster-node-tuning-operator/tuned-l52p6"
Sep 08 09:58:08.819523 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.819256    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/73d345ba-36c0-46ab-b6d8-7351693d21a5-sys-fs\") pod \"aws-ebs-csi-driver-node-lsc2q\" (UID: \"73d345ba-36c0-46ab-b6d8-7351693d21a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsc2q"
Sep 08 09:58:08.819523 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.819313    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c248488-2449-4ff6-a079-8b466acd152e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.819523 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.819396    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/1425c284-4dee-4ed4-a65f-8c1dc7283c8f-cni-binary-copy\") pod \"multus-additional-cni-plugins-dcfdx\" (UID: \"1425c284-4dee-4ed4-a65f-8c1dc7283c8f\") " pod="openshift-multus/multus-additional-cni-plugins-dcfdx"
Sep 08 09:58:08.819523 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.819458    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3868a1c3-46c6-4940-92ed-e460b77d7cfc-metrics-certs\") pod \"network-metrics-daemon-b5m55\" (UID: \"3868a1c3-46c6-4940-92ed-e460b77d7cfc\") " pod="openshift-multus/network-metrics-daemon-b5m55"
Sep 08 09:58:08.819523 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.819524    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/03e3282b-d719-4d88-ac22-72691939bdac-multus-daemon-config\") pod \"multus-85r8m\" (UID: \"03e3282b-d719-4d88-ac22-72691939bdac\") " pod="openshift-multus/multus-85r8m"
Sep 08 09:58:08.819926 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.819551    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03e3282b-d719-4d88-ac22-72691939bdac-etc-kubernetes\") pod \"multus-85r8m\" (UID: \"03e3282b-d719-4d88-ac22-72691939bdac\") " pod="openshift-multus/multus-85r8m"
Sep 08 09:58:08.819926 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.819587    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1425c284-4dee-4ed4-a65f-8c1dc7283c8f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dcfdx\" (UID: \"1425c284-4dee-4ed4-a65f-8c1dc7283c8f\") " pod="openshift-multus/multus-additional-cni-plugins-dcfdx"
Sep 08 09:58:08.819926 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.819610    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/03e3282b-d719-4d88-ac22-72691939bdac-cni-binary-copy\") pod \"multus-85r8m\" (UID: \"03e3282b-d719-4d88-ac22-72691939bdac\") " pod="openshift-multus/multus-85r8m"
Sep 08 09:58:08.819926 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.819603    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqhdq\" (UniqueName: \"kubernetes.io/projected/1425c284-4dee-4ed4-a65f-8c1dc7283c8f-kube-api-access-qqhdq\") pod \"multus-additional-cni-plugins-dcfdx\" (UID: \"1425c284-4dee-4ed4-a65f-8c1dc7283c8f\") " pod="openshift-multus/multus-additional-cni-plugins-dcfdx"
Sep 08 09:58:08.819926 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.819662    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8b9l\" (UniqueName: \"kubernetes.io/projected/73d345ba-36c0-46ab-b6d8-7351693d21a5-kube-api-access-t8b9l\") pod \"aws-ebs-csi-driver-node-lsc2q\" (UID: \"73d345ba-36c0-46ab-b6d8-7351693d21a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsc2q"
Sep 08 09:58:08.819926 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.819691    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90152f2b-6780-4ce9-8938-aedd788ac94c-var-lib-kubelet\") pod \"tuned-l52p6\" (UID: \"90152f2b-6780-4ce9-8938-aedd788ac94c\") " pod="openshift-cluster-node-tuning-operator/tuned-l52p6"
Sep 08 09:58:08.819926 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.819688    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03e3282b-d719-4d88-ac22-72691939bdac-etc-kubernetes\") pod \"multus-85r8m\" (UID: \"03e3282b-d719-4d88-ac22-72691939bdac\") " pod="openshift-multus/multus-85r8m"
Sep 08 09:58:08.819926 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.819715    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/03e3282b-d719-4d88-ac22-72691939bdac-hostroot\") pod \"multus-85r8m\" (UID: \"03e3282b-d719-4d88-ac22-72691939bdac\") " pod="openshift-multus/multus-85r8m"
Sep 08 09:58:08.819926 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.819738    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/313cffc0-94c1-466a-8a57-750151daa9ea-tmp-dir\") pod \"node-resolver-wdvlk\" (UID: \"313cffc0-94c1-466a-8a57-750151daa9ea\") " pod="openshift-dns/node-resolver-wdvlk"
Sep 08 09:58:08.819926 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.819771    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/03e3282b-d719-4d88-ac22-72691939bdac-hostroot\") pod \"multus-85r8m\" (UID: \"03e3282b-d719-4d88-ac22-72691939bdac\") " pod="openshift-multus/multus-85r8m"
Sep 08 09:58:08.819926 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.819824    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/1425c284-4dee-4ed4-a65f-8c1dc7283c8f-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dcfdx\" (UID: \"1425c284-4dee-4ed4-a65f-8c1dc7283c8f\") " pod="openshift-multus/multus-additional-cni-plugins-dcfdx"
Sep 08 09:58:08.819926 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.819863    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c248488-2449-4ff6-a079-8b466acd152e-var-lib-openvswitch\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.819926 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.819890    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3ce5d383-ffe7-47c5-8960-4553f5dfd4c4-kubelet-config\") pod \"global-pull-secret-syncer-j4t5c\" (UID: \"3ce5d383-ffe7-47c5-8960-4553f5dfd4c4\") " pod="kube-system/global-pull-secret-syncer-j4t5c"
Sep 08 09:58:08.820468 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.819919    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5tr4\" (UniqueName: \"kubernetes.io/projected/4a41ec82-3e27-4c50-b580-861230051e27-kube-api-access-z5tr4\") pod \"node-ca-2zsx5\" (UID: \"4a41ec82-3e27-4c50-b580-861230051e27\") " pod="openshift-image-registry/node-ca-2zsx5"
Sep 08 09:58:08.820468 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.819959    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/90152f2b-6780-4ce9-8938-aedd788ac94c-etc-sysctl-conf\") pod \"tuned-l52p6\" (UID: \"90152f2b-6780-4ce9-8938-aedd788ac94c\") " pod="openshift-cluster-node-tuning-operator/tuned-l52p6"
Sep 08 09:58:08.820468 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.819983    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1425c284-4dee-4ed4-a65f-8c1dc7283c8f-system-cni-dir\") pod \"multus-additional-cni-plugins-dcfdx\" (UID: \"1425c284-4dee-4ed4-a65f-8c1dc7283c8f\") " pod="openshift-multus/multus-additional-cni-plugins-dcfdx"
Sep 08 09:58:08.820468 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.820030    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1425c284-4dee-4ed4-a65f-8c1dc7283c8f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dcfdx\" (UID: \"1425c284-4dee-4ed4-a65f-8c1dc7283c8f\") " pod="openshift-multus/multus-additional-cni-plugins-dcfdx"
Sep 08 09:58:08.820468 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.820062    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/73d345ba-36c0-46ab-b6d8-7351693d21a5-socket-dir\") pod \"aws-ebs-csi-driver-node-lsc2q\" (UID: \"73d345ba-36c0-46ab-b6d8-7351693d21a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsc2q"
Sep 08 09:58:08.820468 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.820092    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/90152f2b-6780-4ce9-8938-aedd788ac94c-etc-modprobe-d\") pod \"tuned-l52p6\" (UID: \"90152f2b-6780-4ce9-8938-aedd788ac94c\") " pod="openshift-cluster-node-tuning-operator/tuned-l52p6"
Sep 08 09:58:08.820468 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.820117    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/90152f2b-6780-4ce9-8938-aedd788ac94c-lib-modules\") pod \"tuned-l52p6\" (UID: \"90152f2b-6780-4ce9-8938-aedd788ac94c\") " pod="openshift-cluster-node-tuning-operator/tuned-l52p6"
Sep 08 09:58:08.820468 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.820114    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/03e3282b-d719-4d88-ac22-72691939bdac-multus-daemon-config\") pod \"multus-85r8m\" (UID: \"03e3282b-d719-4d88-ac22-72691939bdac\") " pod="openshift-multus/multus-85r8m"
Sep 08 09:58:08.820468 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.820236    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/73d345ba-36c0-46ab-b6d8-7351693d21a5-socket-dir\") pod \"aws-ebs-csi-driver-node-lsc2q\" (UID: \"73d345ba-36c0-46ab-b6d8-7351693d21a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsc2q"
Sep 08 09:58:08.820468 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.820286    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/90152f2b-6780-4ce9-8938-aedd788ac94c-etc-tuned\") pod \"tuned-l52p6\" (UID: \"90152f2b-6780-4ce9-8938-aedd788ac94c\") " pod="openshift-cluster-node-tuning-operator/tuned-l52p6"
Sep 08 09:58:08.820468 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.820349    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0c248488-2449-4ff6-a079-8b466acd152e-ovnkube-config\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.820468 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.820380    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0c248488-2449-4ff6-a079-8b466acd152e-env-overrides\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.820468 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.820432    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/03e3282b-d719-4d88-ac22-72691939bdac-cnibin\") pod \"multus-85r8m\" (UID: \"03e3282b-d719-4d88-ac22-72691939bdac\") " pod="openshift-multus/multus-85r8m"
Sep 08 09:58:08.821030 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.820484    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1425c284-4dee-4ed4-a65f-8c1dc7283c8f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dcfdx\" (UID: \"1425c284-4dee-4ed4-a65f-8c1dc7283c8f\") " pod="openshift-multus/multus-additional-cni-plugins-dcfdx"
Sep 08 09:58:08.821030 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.820513    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c248488-2449-4ff6-a079-8b466acd152e-host-kubelet\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.821030 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.820578    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/03e3282b-d719-4d88-ac22-72691939bdac-cnibin\") pod \"multus-85r8m\" (UID: \"03e3282b-d719-4d88-ac22-72691939bdac\") " pod="openshift-multus/multus-85r8m"
Sep 08 09:58:08.821030 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.820568    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8256cd1d-5778-4897-91b2-8a45f97f69dd-agent-certs\") pod \"konnectivity-agent-8l4t6\" (UID: \"8256cd1d-5778-4897-91b2-8a45f97f69dd\") " pod="kube-system/konnectivity-agent-8l4t6"
Sep 08 09:58:08.821030 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.820607    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/1425c284-4dee-4ed4-a65f-8c1dc7283c8f-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dcfdx\" (UID: \"1425c284-4dee-4ed4-a65f-8c1dc7283c8f\") " pod="openshift-multus/multus-additional-cni-plugins-dcfdx"
Sep 08 09:58:08.821030 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.820707    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/1425c284-4dee-4ed4-a65f-8c1dc7283c8f-system-cni-dir\") pod \"multus-additional-cni-plugins-dcfdx\" (UID: \"1425c284-4dee-4ed4-a65f-8c1dc7283c8f\") " pod="openshift-multus/multus-additional-cni-plugins-dcfdx"
Sep 08 09:58:08.821030 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.820168    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/313cffc0-94c1-466a-8a57-750151daa9ea-tmp-dir\") pod \"node-resolver-wdvlk\" (UID: \"313cffc0-94c1-466a-8a57-750151daa9ea\") " pod="openshift-dns/node-resolver-wdvlk"
Sep 08 09:58:08.821030 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.820758    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/90152f2b-6780-4ce9-8938-aedd788ac94c-run\") pod \"tuned-l52p6\" (UID: \"90152f2b-6780-4ce9-8938-aedd788ac94c\") " pod="openshift-cluster-node-tuning-operator/tuned-l52p6"
Sep 08 09:58:08.821030 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.820781    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/90152f2b-6780-4ce9-8938-aedd788ac94c-host\") pod \"tuned-l52p6\" (UID: \"90152f2b-6780-4ce9-8938-aedd788ac94c\") " pod="openshift-cluster-node-tuning-operator/tuned-l52p6"
Sep 08 09:58:08.821030 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.820798    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/90152f2b-6780-4ce9-8938-aedd788ac94c-sys\") pod \"tuned-l52p6\" (UID: \"90152f2b-6780-4ce9-8938-aedd788ac94c\") " pod="openshift-cluster-node-tuning-operator/tuned-l52p6"
Sep 08 09:58:08.821030 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.820811    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0c248488-2449-4ff6-a079-8b466acd152e-ovnkube-script-lib\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.821030 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.820855    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/03e3282b-d719-4d88-ac22-72691939bdac-host-var-lib-kubelet\") pod \"multus-85r8m\" (UID: \"03e3282b-d719-4d88-ac22-72691939bdac\") " pod="openshift-multus/multus-85r8m"
Sep 08 09:58:08.821030 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.820884    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/90152f2b-6780-4ce9-8938-aedd788ac94c-etc-sysconfig\") pod \"tuned-l52p6\" (UID: \"90152f2b-6780-4ce9-8938-aedd788ac94c\") " pod="openshift-cluster-node-tuning-operator/tuned-l52p6"
Sep 08 09:58:08.821030 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.820915    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jk7l\" (UniqueName: \"kubernetes.io/projected/90152f2b-6780-4ce9-8938-aedd788ac94c-kube-api-access-4jk7l\") pod \"tuned-l52p6\" (UID: \"90152f2b-6780-4ce9-8938-aedd788ac94c\") " pod="openshift-cluster-node-tuning-operator/tuned-l52p6"
Sep 08 09:58:08.821030 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.820945    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/03e3282b-d719-4d88-ac22-72691939bdac-host-var-lib-kubelet\") pod \"multus-85r8m\" (UID: \"03e3282b-d719-4d88-ac22-72691939bdac\") " pod="openshift-multus/multus-85r8m"
Sep 08 09:58:08.821030 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.820962    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/1425c284-4dee-4ed4-a65f-8c1dc7283c8f-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dcfdx\" (UID: \"1425c284-4dee-4ed4-a65f-8c1dc7283c8f\") " pod="openshift-multus/multus-additional-cni-plugins-dcfdx"
Sep 08 09:58:08.821030 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.820970    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c248488-2449-4ff6-a079-8b466acd152e-host-cni-bin\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.821704 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.820999    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1fa9f2a5-3fe1-439f-ac9d-c17fbb4a1e8e-host-slash\") pod \"iptables-alerter-pjsr4\" (UID: \"1fa9f2a5-3fe1-439f-ac9d-c17fbb4a1e8e\") " pod="openshift-network-operator/iptables-alerter-pjsr4"
Sep 08 09:58:08.821704 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.821029    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/03e3282b-d719-4d88-ac22-72691939bdac-host-run-netns\") pod \"multus-85r8m\" (UID: \"03e3282b-d719-4d88-ac22-72691939bdac\") " pod="openshift-multus/multus-85r8m"
Sep 08 09:58:08.821704 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.821056    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/03e3282b-d719-4d88-ac22-72691939bdac-host-var-lib-cni-bin\") pod \"multus-85r8m\" (UID: \"03e3282b-d719-4d88-ac22-72691939bdac\") " pod="openshift-multus/multus-85r8m"
Sep 08 09:58:08.821704 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.821073    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/03e3282b-d719-4d88-ac22-72691939bdac-host-var-lib-cni-multus\") pod \"multus-85r8m\" (UID: \"03e3282b-d719-4d88-ac22-72691939bdac\") " pod="openshift-multus/multus-85r8m"
Sep 08 09:58:08.821704 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.821097    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/03e3282b-d719-4d88-ac22-72691939bdac-host-run-netns\") pod \"multus-85r8m\" (UID: \"03e3282b-d719-4d88-ac22-72691939bdac\") " pod="openshift-multus/multus-85r8m"
Sep 08 09:58:08.821704 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.821102    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/03e3282b-d719-4d88-ac22-72691939bdac-host-var-lib-cni-bin\") pod \"multus-85r8m\" (UID: \"03e3282b-d719-4d88-ac22-72691939bdac\") " pod="openshift-multus/multus-85r8m"
Sep 08 09:58:08.821704 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.821107    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/03e3282b-d719-4d88-ac22-72691939bdac-host-var-lib-cni-multus\") pod \"multus-85r8m\" (UID: \"03e3282b-d719-4d88-ac22-72691939bdac\") " pod="openshift-multus/multus-85r8m"
Sep 08 09:58:08.821704 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.821123    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/03e3282b-d719-4d88-ac22-72691939bdac-multus-conf-dir\") pod \"multus-85r8m\" (UID: \"03e3282b-d719-4d88-ac22-72691939bdac\") " pod="openshift-multus/multus-85r8m"
Sep 08 09:58:08.821704 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.821141    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrb5r\" (UniqueName: \"kubernetes.io/projected/313cffc0-94c1-466a-8a57-750151daa9ea-kube-api-access-qrb5r\") pod \"node-resolver-wdvlk\" (UID: \"313cffc0-94c1-466a-8a57-750151daa9ea\") " pod="openshift-dns/node-resolver-wdvlk"
Sep 08 09:58:08.821704 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.821157    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c248488-2449-4ff6-a079-8b466acd152e-host-run-netns\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.821704 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.821172    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c248488-2449-4ff6-a079-8b466acd152e-run-openvswitch\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.821704 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.821191    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/03e3282b-d719-4d88-ac22-72691939bdac-multus-conf-dir\") pod \"multus-85r8m\" (UID: \"03e3282b-d719-4d88-ac22-72691939bdac\") " pod="openshift-multus/multus-85r8m"
Sep 08 09:58:08.821704 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.821198    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/73d345ba-36c0-46ab-b6d8-7351693d21a5-registration-dir\") pod \"aws-ebs-csi-driver-node-lsc2q\" (UID: \"73d345ba-36c0-46ab-b6d8-7351693d21a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsc2q"
Sep 08 09:58:08.821704 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.821228    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0c248488-2449-4ff6-a079-8b466acd152e-systemd-units\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.821704 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.821246    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0c248488-2449-4ff6-a079-8b466acd152e-node-log\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.821704 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.821263    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/73d345ba-36c0-46ab-b6d8-7351693d21a5-registration-dir\") pod \"aws-ebs-csi-driver-node-lsc2q\" (UID: \"73d345ba-36c0-46ab-b6d8-7351693d21a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsc2q"
Sep 08 09:58:08.821704 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.821261    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0c248488-2449-4ff6-a079-8b466acd152e-ovn-node-metrics-cert\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.822207 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.821317    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5mrn\" (UniqueName: \"kubernetes.io/projected/1fa9f2a5-3fe1-439f-ac9d-c17fbb4a1e8e-kube-api-access-v5mrn\") pod \"iptables-alerter-pjsr4\" (UID: \"1fa9f2a5-3fe1-439f-ac9d-c17fbb4a1e8e\") " pod="openshift-network-operator/iptables-alerter-pjsr4"
Sep 08 09:58:08.822207 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.821336    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03e3282b-d719-4d88-ac22-72691939bdac-multus-cni-dir\") pod \"multus-85r8m\" (UID: \"03e3282b-d719-4d88-ac22-72691939bdac\") " pod="openshift-multus/multus-85r8m"
Sep 08 09:58:08.822207 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.821381    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/03e3282b-d719-4d88-ac22-72691939bdac-host-run-multus-certs\") pod \"multus-85r8m\" (UID: \"03e3282b-d719-4d88-ac22-72691939bdac\") " pod="openshift-multus/multus-85r8m"
Sep 08 09:58:08.822207 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.821414    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/313cffc0-94c1-466a-8a57-750151daa9ea-hosts-file\") pod \"node-resolver-wdvlk\" (UID: \"313cffc0-94c1-466a-8a57-750151daa9ea\") " pod="openshift-dns/node-resolver-wdvlk"
Sep 08 09:58:08.822207 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.821429    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/03e3282b-d719-4d88-ac22-72691939bdac-host-run-multus-certs\") pod \"multus-85r8m\" (UID: \"03e3282b-d719-4d88-ac22-72691939bdac\") " pod="openshift-multus/multus-85r8m"
Sep 08 09:58:08.822207 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.821439    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03e3282b-d719-4d88-ac22-72691939bdac-multus-cni-dir\") pod \"multus-85r8m\" (UID: \"03e3282b-d719-4d88-ac22-72691939bdac\") " pod="openshift-multus/multus-85r8m"
Sep 08 09:58:08.822207 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.821463    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4a41ec82-3e27-4c50-b580-861230051e27-serviceca\") pod \"node-ca-2zsx5\" (UID: \"4a41ec82-3e27-4c50-b580-861230051e27\") " pod="openshift-image-registry/node-ca-2zsx5"
Sep 08 09:58:08.822207 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.821479    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c248488-2449-4ff6-a079-8b466acd152e-etc-openvswitch\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.822207 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.821573    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/313cffc0-94c1-466a-8a57-750151daa9ea-hosts-file\") pod \"node-resolver-wdvlk\" (UID: \"313cffc0-94c1-466a-8a57-750151daa9ea\") " pod="openshift-dns/node-resolver-wdvlk"
Sep 08 09:58:08.822207 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.821818    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4a41ec82-3e27-4c50-b580-861230051e27-serviceca\") pod \"node-ca-2zsx5\" (UID: \"4a41ec82-3e27-4c50-b580-861230051e27\") " pod="openshift-image-registry/node-ca-2zsx5"
Sep 08 09:58:08.829815 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.829771    2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 08 09:58:08.835571 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.835455    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xhck\" (UniqueName: \"kubernetes.io/projected/03e3282b-d719-4d88-ac22-72691939bdac-kube-api-access-6xhck\") pod \"multus-85r8m\" (UID: \"03e3282b-d719-4d88-ac22-72691939bdac\") " pod="openshift-multus/multus-85r8m"
Sep 08 09:58:08.835751 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.835506    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqhdq\" (UniqueName: \"kubernetes.io/projected/1425c284-4dee-4ed4-a65f-8c1dc7283c8f-kube-api-access-qqhdq\") pod \"multus-additional-cni-plugins-dcfdx\" (UID: \"1425c284-4dee-4ed4-a65f-8c1dc7283c8f\") " pod="openshift-multus/multus-additional-cni-plugins-dcfdx"
Sep 08 09:58:08.835751 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.835506    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5tr4\" (UniqueName: \"kubernetes.io/projected/4a41ec82-3e27-4c50-b580-861230051e27-kube-api-access-z5tr4\") pod \"node-ca-2zsx5\" (UID: \"4a41ec82-3e27-4c50-b580-861230051e27\") " pod="openshift-image-registry/node-ca-2zsx5"
Sep 08 09:58:08.835751 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.835511    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrb5r\" (UniqueName: \"kubernetes.io/projected/313cffc0-94c1-466a-8a57-750151daa9ea-kube-api-access-qrb5r\") pod \"node-resolver-wdvlk\" (UID: \"313cffc0-94c1-466a-8a57-750151daa9ea\") " pod="openshift-dns/node-resolver-wdvlk"
Sep 08 09:58:08.836621 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.836597    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8b9l\" (UniqueName: \"kubernetes.io/projected/73d345ba-36c0-46ab-b6d8-7351693d21a5-kube-api-access-t8b9l\") pod \"aws-ebs-csi-driver-node-lsc2q\" (UID: \"73d345ba-36c0-46ab-b6d8-7351693d21a5\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsc2q"
Sep 08 09:58:08.836925 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.836882    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-96.ec2.internal" event={"ID":"39c5e68f9a1e6fb3d5599c7ac75713d7","Type":"ContainerStarted","Data":"1d7d30a147cd3be755232df3595d3135d94d7a674fe480b84c54aaee375edc14"}
Sep 08 09:58:08.838062 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.838038    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-96.ec2.internal" event={"ID":"ba08d37bcb40217ed6ffc66b79f33b9e","Type":"ContainerStarted","Data":"285019abcaf47c75931ce1cbe8d3d5066612aef09362bbe8063652d34cc8ddc8"}
Sep 08 09:58:08.922452 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.922425    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/90152f2b-6780-4ce9-8938-aedd788ac94c-etc-modprobe-d\") pod \"tuned-l52p6\" (UID: \"90152f2b-6780-4ce9-8938-aedd788ac94c\") " pod="openshift-cluster-node-tuning-operator/tuned-l52p6"
Sep 08 09:58:08.922452 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.922451    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/90152f2b-6780-4ce9-8938-aedd788ac94c-lib-modules\") pod \"tuned-l52p6\" (UID: \"90152f2b-6780-4ce9-8938-aedd788ac94c\") " pod="openshift-cluster-node-tuning-operator/tuned-l52p6"
Sep 08 09:58:08.922632 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.922467    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/90152f2b-6780-4ce9-8938-aedd788ac94c-etc-tuned\") pod \"tuned-l52p6\" (UID: \"90152f2b-6780-4ce9-8938-aedd788ac94c\") " pod="openshift-cluster-node-tuning-operator/tuned-l52p6"
Sep 08 09:58:08.922632 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.922482    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0c248488-2449-4ff6-a079-8b466acd152e-ovnkube-config\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.922632 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.922496    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0c248488-2449-4ff6-a079-8b466acd152e-env-overrides\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.922632 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.922512    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c248488-2449-4ff6-a079-8b466acd152e-host-kubelet\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.922632 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.922535    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8256cd1d-5778-4897-91b2-8a45f97f69dd-agent-certs\") pod \"konnectivity-agent-8l4t6\" (UID: \"8256cd1d-5778-4897-91b2-8a45f97f69dd\") " pod="kube-system/konnectivity-agent-8l4t6"
Sep 08 09:58:08.922632 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.922572    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/90152f2b-6780-4ce9-8938-aedd788ac94c-run\") pod \"tuned-l52p6\" (UID: \"90152f2b-6780-4ce9-8938-aedd788ac94c\") " pod="openshift-cluster-node-tuning-operator/tuned-l52p6"
Sep 08 09:58:08.922632 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.922617    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/90152f2b-6780-4ce9-8938-aedd788ac94c-lib-modules\") pod \"tuned-l52p6\" (UID: \"90152f2b-6780-4ce9-8938-aedd788ac94c\") " pod="openshift-cluster-node-tuning-operator/tuned-l52p6"
Sep 08 09:58:08.922632 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.922628    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/90152f2b-6780-4ce9-8938-aedd788ac94c-etc-modprobe-d\") pod \"tuned-l52p6\" (UID: \"90152f2b-6780-4ce9-8938-aedd788ac94c\") " pod="openshift-cluster-node-tuning-operator/tuned-l52p6"
Sep 08 09:58:08.923052 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.922668    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/90152f2b-6780-4ce9-8938-aedd788ac94c-host\") pod \"tuned-l52p6\" (UID: \"90152f2b-6780-4ce9-8938-aedd788ac94c\") " pod="openshift-cluster-node-tuning-operator/tuned-l52p6"
Sep 08 09:58:08.923052 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.922696    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/90152f2b-6780-4ce9-8938-aedd788ac94c-sys\") pod \"tuned-l52p6\" (UID: \"90152f2b-6780-4ce9-8938-aedd788ac94c\") " pod="openshift-cluster-node-tuning-operator/tuned-l52p6"
Sep 08 09:58:08.923052 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.922700    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c248488-2449-4ff6-a079-8b466acd152e-host-kubelet\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.923052 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.922720    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0c248488-2449-4ff6-a079-8b466acd152e-ovnkube-script-lib\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.923052 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.922746    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/90152f2b-6780-4ce9-8938-aedd788ac94c-etc-sysconfig\") pod \"tuned-l52p6\" (UID: \"90152f2b-6780-4ce9-8938-aedd788ac94c\") " pod="openshift-cluster-node-tuning-operator/tuned-l52p6"
Sep 08 09:58:08.923052 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.922757    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/90152f2b-6780-4ce9-8938-aedd788ac94c-host\") pod \"tuned-l52p6\" (UID: \"90152f2b-6780-4ce9-8938-aedd788ac94c\") " pod="openshift-cluster-node-tuning-operator/tuned-l52p6"
Sep 08 09:58:08.923052 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.922765    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/90152f2b-6780-4ce9-8938-aedd788ac94c-run\") pod \"tuned-l52p6\" (UID: \"90152f2b-6780-4ce9-8938-aedd788ac94c\") " pod="openshift-cluster-node-tuning-operator/tuned-l52p6"
Sep 08 09:58:08.923052 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.922768    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jk7l\" (UniqueName: \"kubernetes.io/projected/90152f2b-6780-4ce9-8938-aedd788ac94c-kube-api-access-4jk7l\") pod \"tuned-l52p6\" (UID: \"90152f2b-6780-4ce9-8938-aedd788ac94c\") " pod="openshift-cluster-node-tuning-operator/tuned-l52p6"
Sep 08 09:58:08.923052 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.922817    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/90152f2b-6780-4ce9-8938-aedd788ac94c-etc-sysconfig\") pod \"tuned-l52p6\" (UID: \"90152f2b-6780-4ce9-8938-aedd788ac94c\") " pod="openshift-cluster-node-tuning-operator/tuned-l52p6"
Sep 08 09:58:08.923052 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.922830    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c248488-2449-4ff6-a079-8b466acd152e-host-cni-bin\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.923052 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.922858    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1fa9f2a5-3fe1-439f-ac9d-c17fbb4a1e8e-host-slash\") pod \"iptables-alerter-pjsr4\" (UID: \"1fa9f2a5-3fe1-439f-ac9d-c17fbb4a1e8e\") " pod="openshift-network-operator/iptables-alerter-pjsr4"
Sep 08 09:58:08.923052 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.922863    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/90152f2b-6780-4ce9-8938-aedd788ac94c-sys\") pod \"tuned-l52p6\" (UID: \"90152f2b-6780-4ce9-8938-aedd788ac94c\") " pod="openshift-cluster-node-tuning-operator/tuned-l52p6"
Sep 08 09:58:08.923052 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.922905    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0c248488-2449-4ff6-a079-8b466acd152e-host-cni-bin\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.923052 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.922946    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c248488-2449-4ff6-a079-8b466acd152e-host-run-netns\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.923052 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.922947    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1fa9f2a5-3fe1-439f-ac9d-c17fbb4a1e8e-host-slash\") pod \"iptables-alerter-pjsr4\" (UID: \"1fa9f2a5-3fe1-439f-ac9d-c17fbb4a1e8e\") " pod="openshift-network-operator/iptables-alerter-pjsr4"
Sep 08 09:58:08.923052 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.922906    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0c248488-2449-4ff6-a079-8b466acd152e-host-run-netns\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.923052 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.923003    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c248488-2449-4ff6-a079-8b466acd152e-run-openvswitch\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.923052 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.923030    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0c248488-2449-4ff6-a079-8b466acd152e-systemd-units\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.924157 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.923055    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0c248488-2449-4ff6-a079-8b466acd152e-node-log\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.924157 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.923076    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/0c248488-2449-4ff6-a079-8b466acd152e-systemd-units\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.924157 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.923080    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0c248488-2449-4ff6-a079-8b466acd152e-ovn-node-metrics-cert\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.924157 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.923029    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c248488-2449-4ff6-a079-8b466acd152e-run-openvswitch\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.924157 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.923094    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/0c248488-2449-4ff6-a079-8b466acd152e-env-overrides\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.924157 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.923107    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5mrn\" (UniqueName: \"kubernetes.io/projected/1fa9f2a5-3fe1-439f-ac9d-c17fbb4a1e8e-kube-api-access-v5mrn\") pod \"iptables-alerter-pjsr4\" (UID: \"1fa9f2a5-3fe1-439f-ac9d-c17fbb4a1e8e\") " pod="openshift-network-operator/iptables-alerter-pjsr4"
Sep 08 09:58:08.924157 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.923132    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/0c248488-2449-4ff6-a079-8b466acd152e-node-log\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.924157 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.923159    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c248488-2449-4ff6-a079-8b466acd152e-etc-openvswitch\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.924157 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.923188    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0c248488-2449-4ff6-a079-8b466acd152e-log-socket\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.924157 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.923201    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/0c248488-2449-4ff6-a079-8b466acd152e-ovnkube-config\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.924157 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.923215    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ch5x\" (UniqueName: \"kubernetes.io/projected/0c248488-2449-4ff6-a079-8b466acd152e-kube-api-access-5ch5x\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.924157 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.923246    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/90152f2b-6780-4ce9-8938-aedd788ac94c-etc-kubernetes\") pod \"tuned-l52p6\" (UID: \"90152f2b-6780-4ce9-8938-aedd788ac94c\") " pod="openshift-cluster-node-tuning-operator/tuned-l52p6"
Sep 08 09:58:08.924157 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.923253    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c248488-2449-4ff6-a079-8b466acd152e-etc-openvswitch\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.924157 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.923270    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/90152f2b-6780-4ce9-8938-aedd788ac94c-etc-systemd\") pod \"tuned-l52p6\" (UID: \"90152f2b-6780-4ce9-8938-aedd788ac94c\") " pod="openshift-cluster-node-tuning-operator/tuned-l52p6"
Sep 08 09:58:08.924157 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.923302    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90152f2b-6780-4ce9-8938-aedd788ac94c-tmp\") pod \"tuned-l52p6\" (UID: \"90152f2b-6780-4ce9-8938-aedd788ac94c\") " pod="openshift-cluster-node-tuning-operator/tuned-l52p6"
Sep 08 09:58:08.924157 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.923327    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c248488-2449-4ff6-a079-8b466acd152e-host-run-ovn-kubernetes\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.924157 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.923353    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krwls\" (UniqueName: \"kubernetes.io/projected/3868a1c3-46c6-4940-92ed-e460b77d7cfc-kube-api-access-krwls\") pod \"network-metrics-daemon-b5m55\" (UID: \"3868a1c3-46c6-4940-92ed-e460b77d7cfc\") " pod="openshift-multus/network-metrics-daemon-b5m55"
Sep 08 09:58:08.925052 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.923358    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/90152f2b-6780-4ce9-8938-aedd788ac94c-etc-kubernetes\") pod \"tuned-l52p6\" (UID: \"90152f2b-6780-4ce9-8938-aedd788ac94c\") " pod="openshift-cluster-node-tuning-operator/tuned-l52p6"
Sep 08 09:58:08.925052 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.923379    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0c248488-2449-4ff6-a079-8b466acd152e-host-slash\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.925052 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.923403    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0c248488-2449-4ff6-a079-8b466acd152e-run-ovn\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.925052 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.923434    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0c248488-2449-4ff6-a079-8b466acd152e-host-cni-netd\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.925052 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.923459    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8256cd1d-5778-4897-91b2-8a45f97f69dd-konnectivity-ca\") pod \"konnectivity-agent-8l4t6\" (UID: \"8256cd1d-5778-4897-91b2-8a45f97f69dd\") " pod="kube-system/konnectivity-agent-8l4t6"
Sep 08 09:58:08.925052 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.923511    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/0c248488-2449-4ff6-a079-8b466acd152e-log-socket\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.925052 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.923551    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0c248488-2449-4ff6-a079-8b466acd152e-run-systemd\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.925052 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.923582    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1fa9f2a5-3fe1-439f-ac9d-c17fbb4a1e8e-iptables-alerter-script\") pod \"iptables-alerter-pjsr4\" (UID: \"1fa9f2a5-3fe1-439f-ac9d-c17fbb4a1e8e\") " pod="openshift-network-operator/iptables-alerter-pjsr4"
Sep 08 09:58:08.925052 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.923609    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3ce5d383-ffe7-47c5-8960-4553f5dfd4c4-dbus\") pod \"global-pull-secret-syncer-j4t5c\" (UID: \"3ce5d383-ffe7-47c5-8960-4553f5dfd4c4\") " pod="kube-system/global-pull-secret-syncer-j4t5c"
Sep 08 09:58:08.925052 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.923635    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/0c248488-2449-4ff6-a079-8b466acd152e-ovnkube-script-lib\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.925052 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.923652    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ce5d383-ffe7-47c5-8960-4553f5dfd4c4-original-pull-secret\") pod \"global-pull-secret-syncer-j4t5c\" (UID: \"3ce5d383-ffe7-47c5-8960-4553f5dfd4c4\") " pod="kube-system/global-pull-secret-syncer-j4t5c"
Sep 08 09:58:08.925052 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.923708    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzfrc\" (UniqueName: \"kubernetes.io/projected/6829ca1d-d62e-446a-a557-43217aba9a6f-kube-api-access-xzfrc\") pod \"network-check-target-8lnsn\" (UID: \"6829ca1d-d62e-446a-a557-43217aba9a6f\") " pod="openshift-network-diagnostics/network-check-target-8lnsn"
Sep 08 09:58:08.925052 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.923739    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/90152f2b-6780-4ce9-8938-aedd788ac94c-etc-sysctl-d\") pod \"tuned-l52p6\" (UID: \"90152f2b-6780-4ce9-8938-aedd788ac94c\") " pod="openshift-cluster-node-tuning-operator/tuned-l52p6"
Sep 08 09:58:08.925052 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:08.923763    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 09:58:08.925052 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.923766    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c248488-2449-4ff6-a079-8b466acd152e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.925052 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.923795    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3868a1c3-46c6-4940-92ed-e460b77d7cfc-metrics-certs\") pod \"network-metrics-daemon-b5m55\" (UID: \"3868a1c3-46c6-4940-92ed-e460b77d7cfc\") " pod="openshift-multus/network-metrics-daemon-b5m55"
Sep 08 09:58:08.925052 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:08.923838    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ce5d383-ffe7-47c5-8960-4553f5dfd4c4-original-pull-secret podName:3ce5d383-ffe7-47c5-8960-4553f5dfd4c4 nodeName:}" failed. No retries permitted until 2026-09-08 09:58:09.423815533 +0000 UTC m=+3.119414420 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3ce5d383-ffe7-47c5-8960-4553f5dfd4c4-original-pull-secret") pod "global-pull-secret-syncer-j4t5c" (UID: "3ce5d383-ffe7-47c5-8960-4553f5dfd4c4") : object "kube-system"/"original-pull-secret" not registered
Sep 08 09:58:08.925686 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.923859    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90152f2b-6780-4ce9-8938-aedd788ac94c-var-lib-kubelet\") pod \"tuned-l52p6\" (UID: \"90152f2b-6780-4ce9-8938-aedd788ac94c\") " pod="openshift-cluster-node-tuning-operator/tuned-l52p6"
Sep 08 09:58:08.925686 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:08.923881    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 09:58:08.925686 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.923891    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c248488-2449-4ff6-a079-8b466acd152e-var-lib-openvswitch\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.925686 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.923918    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3ce5d383-ffe7-47c5-8960-4553f5dfd4c4-kubelet-config\") pod \"global-pull-secret-syncer-j4t5c\" (UID: \"3ce5d383-ffe7-47c5-8960-4553f5dfd4c4\") " pod="kube-system/global-pull-secret-syncer-j4t5c"
Sep 08 09:58:08.925686 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.923946    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/90152f2b-6780-4ce9-8938-aedd788ac94c-etc-sysctl-conf\") pod \"tuned-l52p6\" (UID: \"90152f2b-6780-4ce9-8938-aedd788ac94c\") " pod="openshift-cluster-node-tuning-operator/tuned-l52p6"
Sep 08 09:58:08.925686 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.924046    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8256cd1d-5778-4897-91b2-8a45f97f69dd-konnectivity-ca\") pod \"konnectivity-agent-8l4t6\" (UID: \"8256cd1d-5778-4897-91b2-8a45f97f69dd\") " pod="kube-system/konnectivity-agent-8l4t6"
Sep 08 09:58:08.925686 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.924089    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/90152f2b-6780-4ce9-8938-aedd788ac94c-etc-sysctl-conf\") pod \"tuned-l52p6\" (UID: \"90152f2b-6780-4ce9-8938-aedd788ac94c\") " pod="openshift-cluster-node-tuning-operator/tuned-l52p6"
Sep 08 09:58:08.925686 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.924094    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c248488-2449-4ff6-a079-8b466acd152e-host-run-ovn-kubernetes\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.925686 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:08.924122    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3868a1c3-46c6-4940-92ed-e460b77d7cfc-metrics-certs podName:3868a1c3-46c6-4940-92ed-e460b77d7cfc nodeName:}" failed. No retries permitted until 2026-09-08 09:58:09.424005241 +0000 UTC m=+3.119604122 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3868a1c3-46c6-4940-92ed-e460b77d7cfc-metrics-certs") pod "network-metrics-daemon-b5m55" (UID: "3868a1c3-46c6-4940-92ed-e460b77d7cfc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 09:58:08.925686 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.924134    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/0c248488-2449-4ff6-a079-8b466acd152e-run-systemd\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.925686 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.924136    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0c248488-2449-4ff6-a079-8b466acd152e-host-slash\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.925686 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.924166    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/0c248488-2449-4ff6-a079-8b466acd152e-run-ovn\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.925686 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.924194    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c248488-2449-4ff6-a079-8b466acd152e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.925686 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.924206    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/0c248488-2449-4ff6-a079-8b466acd152e-host-cni-netd\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.925686 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.924254    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/90152f2b-6780-4ce9-8938-aedd788ac94c-etc-systemd\") pod \"tuned-l52p6\" (UID: \"90152f2b-6780-4ce9-8938-aedd788ac94c\") " pod="openshift-cluster-node-tuning-operator/tuned-l52p6"
Sep 08 09:58:08.925686 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.924263    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/90152f2b-6780-4ce9-8938-aedd788ac94c-var-lib-kubelet\") pod \"tuned-l52p6\" (UID: \"90152f2b-6780-4ce9-8938-aedd788ac94c\") " pod="openshift-cluster-node-tuning-operator/tuned-l52p6"
Sep 08 09:58:08.925686 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.924311    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3ce5d383-ffe7-47c5-8960-4553f5dfd4c4-kubelet-config\") pod \"global-pull-secret-syncer-j4t5c\" (UID: \"3ce5d383-ffe7-47c5-8960-4553f5dfd4c4\") " pod="kube-system/global-pull-secret-syncer-j4t5c"
Sep 08 09:58:08.926386 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.924360    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/90152f2b-6780-4ce9-8938-aedd788ac94c-etc-sysctl-d\") pod \"tuned-l52p6\" (UID: \"90152f2b-6780-4ce9-8938-aedd788ac94c\") " pod="openshift-cluster-node-tuning-operator/tuned-l52p6"
Sep 08 09:58:08.926386 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.924383    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3ce5d383-ffe7-47c5-8960-4553f5dfd4c4-dbus\") pod \"global-pull-secret-syncer-j4t5c\" (UID: \"3ce5d383-ffe7-47c5-8960-4553f5dfd4c4\") " pod="kube-system/global-pull-secret-syncer-j4t5c"
Sep 08 09:58:08.926386 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.924408    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/0c248488-2449-4ff6-a079-8b466acd152e-var-lib-openvswitch\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.926386 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.925448    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/90152f2b-6780-4ce9-8938-aedd788ac94c-etc-tuned\") pod \"tuned-l52p6\" (UID: \"90152f2b-6780-4ce9-8938-aedd788ac94c\") " pod="openshift-cluster-node-tuning-operator/tuned-l52p6"
Sep 08 09:58:08.926386 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.925465    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1fa9f2a5-3fe1-439f-ac9d-c17fbb4a1e8e-iptables-alerter-script\") pod \"iptables-alerter-pjsr4\" (UID: \"1fa9f2a5-3fe1-439f-ac9d-c17fbb4a1e8e\") " pod="openshift-network-operator/iptables-alerter-pjsr4"
Sep 08 09:58:08.926386 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.925692    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/90152f2b-6780-4ce9-8938-aedd788ac94c-tmp\") pod \"tuned-l52p6\" (UID: \"90152f2b-6780-4ce9-8938-aedd788ac94c\") " pod="openshift-cluster-node-tuning-operator/tuned-l52p6"
Sep 08 09:58:08.926386 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.926091    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8256cd1d-5778-4897-91b2-8a45f97f69dd-agent-certs\") pod \"konnectivity-agent-8l4t6\" (UID: \"8256cd1d-5778-4897-91b2-8a45f97f69dd\") " pod="kube-system/konnectivity-agent-8l4t6"
Sep 08 09:58:08.926386 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.926183    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/0c248488-2449-4ff6-a079-8b466acd152e-ovn-node-metrics-cert\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:08.944041 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.943995    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jk7l\" (UniqueName: \"kubernetes.io/projected/90152f2b-6780-4ce9-8938-aedd788ac94c-kube-api-access-4jk7l\") pod \"tuned-l52p6\" (UID: \"90152f2b-6780-4ce9-8938-aedd788ac94c\") " pod="openshift-cluster-node-tuning-operator/tuned-l52p6"
Sep 08 09:58:08.950844 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.950827    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krwls\" (UniqueName: \"kubernetes.io/projected/3868a1c3-46c6-4940-92ed-e460b77d7cfc-kube-api-access-krwls\") pod \"network-metrics-daemon-b5m55\" (UID: \"3868a1c3-46c6-4940-92ed-e460b77d7cfc\") " pod="openshift-multus/network-metrics-daemon-b5m55"
Sep 08 09:58:08.953662 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.953638    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5mrn\" (UniqueName: \"kubernetes.io/projected/1fa9f2a5-3fe1-439f-ac9d-c17fbb4a1e8e-kube-api-access-v5mrn\") pod \"iptables-alerter-pjsr4\" (UID: \"1fa9f2a5-3fe1-439f-ac9d-c17fbb4a1e8e\") " pod="openshift-network-operator/iptables-alerter-pjsr4"
Sep 08 09:58:08.954190 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:08.954175    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 09:58:08.954232 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:08.954196    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 09:58:08.954232 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:08.954205    2579 projected.go:196] Error preparing data for projected volume kube-api-access-xzfrc for pod openshift-network-diagnostics/network-check-target-8lnsn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 09:58:08.954307 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:08.954249    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6829ca1d-d62e-446a-a557-43217aba9a6f-kube-api-access-xzfrc podName:6829ca1d-d62e-446a-a557-43217aba9a6f nodeName:}" failed. No retries permitted until 2026-09-08 09:58:09.454236802 +0000 UTC m=+3.149835695 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-xzfrc" (UniqueName: "kubernetes.io/projected/6829ca1d-d62e-446a-a557-43217aba9a6f-kube-api-access-xzfrc") pod "network-check-target-8lnsn" (UID: "6829ca1d-d62e-446a-a557-43217aba9a6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 09:58:08.954881 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:08.954865    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ch5x\" (UniqueName: \"kubernetes.io/projected/0c248488-2449-4ff6-a079-8b466acd152e-kube-api-access-5ch5x\") pod \"ovnkube-node-kz86g\" (UID: \"0c248488-2449-4ff6-a079-8b466acd152e\") " pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:09.003103 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:09.003072    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-85r8m"
Sep 08 09:58:09.010725 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:09.010705    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dcfdx"
Sep 08 09:58:09.013644 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:09.013529    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03e3282b_d719_4d88_ac22_72691939bdac.slice/crio-28331ba8fd7ab19b20a271792b71b4f46c928abd70c81ee969725e567ed0ed0f WatchSource:0}: Error finding container 28331ba8fd7ab19b20a271792b71b4f46c928abd70c81ee969725e567ed0ed0f: Status 404 returned error can't find the container with id 28331ba8fd7ab19b20a271792b71b4f46c928abd70c81ee969725e567ed0ed0f
Sep 08 09:58:09.019481 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:09.019462    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1425c284_4dee_4ed4_a65f_8c1dc7283c8f.slice/crio-4a6434667292e158cba40c6a3e58d94491540ab8f726887bd854ae2292d13329 WatchSource:0}: Error finding container 4a6434667292e158cba40c6a3e58d94491540ab8f726887bd854ae2292d13329: Status 404 returned error can't find the container with id 4a6434667292e158cba40c6a3e58d94491540ab8f726887bd854ae2292d13329
Sep 08 09:58:09.022866 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:09.022841    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsc2q"
Sep 08 09:58:09.027726 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:09.027706    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wdvlk"
Sep 08 09:58:09.033878 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:09.033857    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73d345ba_36c0_46ab_b6d8_7351693d21a5.slice/crio-ff72ee74a2d6076bf7378ee03c63025e23c273c4b13ec1d22fea21600a4d84f8 WatchSource:0}: Error finding container ff72ee74a2d6076bf7378ee03c63025e23c273c4b13ec1d22fea21600a4d84f8: Status 404 returned error can't find the container with id ff72ee74a2d6076bf7378ee03c63025e23c273c4b13ec1d22fea21600a4d84f8
Sep 08 09:58:09.034534 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:09.034515    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2zsx5"
Sep 08 09:58:09.036745 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:09.036725    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod313cffc0_94c1_466a_8a57_750151daa9ea.slice/crio-9edc9e04b056fe5f4c2b5ac0db97e0eb57c748832f7f548923f2ee78285c95e8 WatchSource:0}: Error finding container 9edc9e04b056fe5f4c2b5ac0db97e0eb57c748832f7f548923f2ee78285c95e8: Status 404 returned error can't find the container with id 9edc9e04b056fe5f4c2b5ac0db97e0eb57c748832f7f548923f2ee78285c95e8
Sep 08 09:58:09.043522 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:09.043504    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pjsr4"
Sep 08 09:58:09.045717 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:09.045697    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a41ec82_3e27_4c50_b580_861230051e27.slice/crio-334c04a63980ce72650001742b01c6e279dfed7034bce48158ccb81b9c5a6f41 WatchSource:0}: Error finding container 334c04a63980ce72650001742b01c6e279dfed7034bce48158ccb81b9c5a6f41: Status 404 returned error can't find the container with id 334c04a63980ce72650001742b01c6e279dfed7034bce48158ccb81b9c5a6f41
Sep 08 09:58:09.050479 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:09.050457    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8l4t6"
Sep 08 09:58:09.052486 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:09.052453    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fa9f2a5_3fe1_439f_ac9d_c17fbb4a1e8e.slice/crio-e5e32feedb9e3f57050a6f7d2ba9598b1822155f74d5cf2edf2d66b6e652b0fa WatchSource:0}: Error finding container e5e32feedb9e3f57050a6f7d2ba9598b1822155f74d5cf2edf2d66b6e652b0fa: Status 404 returned error can't find the container with id e5e32feedb9e3f57050a6f7d2ba9598b1822155f74d5cf2edf2d66b6e652b0fa
Sep 08 09:58:09.058386 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:09.058365    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-l52p6"
Sep 08 09:58:09.059600 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:09.059581    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8256cd1d_5778_4897_91b2_8a45f97f69dd.slice/crio-1e2513b31ebe0d78faf7ef7e8eb41421f38fb94d1a03d34f6cf12add8fee8bc5 WatchSource:0}: Error finding container 1e2513b31ebe0d78faf7ef7e8eb41421f38fb94d1a03d34f6cf12add8fee8bc5: Status 404 returned error can't find the container with id 1e2513b31ebe0d78faf7ef7e8eb41421f38fb94d1a03d34f6cf12add8fee8bc5
Sep 08 09:58:09.064340 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:09.064323    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:09.068767 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:09.068742    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90152f2b_6780_4ce9_8938_aedd788ac94c.slice/crio-7e4737cd98755bc859f8f02ffb15c1c811d72741c46b981fc6cff52218ea1693 WatchSource:0}: Error finding container 7e4737cd98755bc859f8f02ffb15c1c811d72741c46b981fc6cff52218ea1693: Status 404 returned error can't find the container with id 7e4737cd98755bc859f8f02ffb15c1c811d72741c46b981fc6cff52218ea1693
Sep 08 09:58:09.074687 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:09.074664    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c248488_2449_4ff6_a079_8b466acd152e.slice/crio-e9b449caed0bece5c0370005f7fbd91921cd3cf215c6d67a299462e9176f8b8d WatchSource:0}: Error finding container e9b449caed0bece5c0370005f7fbd91921cd3cf215c6d67a299462e9176f8b8d: Status 404 returned error can't find the container with id e9b449caed0bece5c0370005f7fbd91921cd3cf215c6d67a299462e9176f8b8d
Sep 08 09:58:09.155152 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:09.155130    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 09:58:09.426593 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:09.426484    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ce5d383-ffe7-47c5-8960-4553f5dfd4c4-original-pull-secret\") pod \"global-pull-secret-syncer-j4t5c\" (UID: \"3ce5d383-ffe7-47c5-8960-4553f5dfd4c4\") " pod="kube-system/global-pull-secret-syncer-j4t5c"
Sep 08 09:58:09.426593 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:09.426546    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3868a1c3-46c6-4940-92ed-e460b77d7cfc-metrics-certs\") pod \"network-metrics-daemon-b5m55\" (UID: \"3868a1c3-46c6-4940-92ed-e460b77d7cfc\") " pod="openshift-multus/network-metrics-daemon-b5m55"
Sep 08 09:58:09.429375 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:09.427047    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 09:58:09.429375 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:09.427139    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ce5d383-ffe7-47c5-8960-4553f5dfd4c4-original-pull-secret podName:3ce5d383-ffe7-47c5-8960-4553f5dfd4c4 nodeName:}" failed. No retries permitted until 2026-09-08 09:58:10.427107666 +0000 UTC m=+4.122706566 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3ce5d383-ffe7-47c5-8960-4553f5dfd4c4-original-pull-secret") pod "global-pull-secret-syncer-j4t5c" (UID: "3ce5d383-ffe7-47c5-8960-4553f5dfd4c4") : object "kube-system"/"original-pull-secret" not registered
Sep 08 09:58:09.429375 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:09.427047    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 09:58:09.429375 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:09.427198    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3868a1c3-46c6-4940-92ed-e460b77d7cfc-metrics-certs podName:3868a1c3-46c6-4940-92ed-e460b77d7cfc nodeName:}" failed. No retries permitted until 2026-09-08 09:58:10.42718631 +0000 UTC m=+4.122785206 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3868a1c3-46c6-4940-92ed-e460b77d7cfc-metrics-certs") pod "network-metrics-daemon-b5m55" (UID: "3868a1c3-46c6-4940-92ed-e460b77d7cfc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 09:58:09.527555 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:09.527501    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzfrc\" (UniqueName: \"kubernetes.io/projected/6829ca1d-d62e-446a-a557-43217aba9a6f-kube-api-access-xzfrc\") pod \"network-check-target-8lnsn\" (UID: \"6829ca1d-d62e-446a-a557-43217aba9a6f\") " pod="openshift-network-diagnostics/network-check-target-8lnsn"
Sep 08 09:58:09.527721 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:09.527693    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 09:58:09.527721 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:09.527709    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 09:58:09.527721 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:09.527721    2579 projected.go:196] Error preparing data for projected volume kube-api-access-xzfrc for pod openshift-network-diagnostics/network-check-target-8lnsn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 09:58:09.527854 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:09.527773    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6829ca1d-d62e-446a-a557-43217aba9a6f-kube-api-access-xzfrc podName:6829ca1d-d62e-446a-a557-43217aba9a6f nodeName:}" failed. No retries permitted until 2026-09-08 09:58:10.527757861 +0000 UTC m=+4.223356740 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-xzfrc" (UniqueName: "kubernetes.io/projected/6829ca1d-d62e-446a-a557-43217aba9a6f-kube-api-access-xzfrc") pod "network-check-target-8lnsn" (UID: "6829ca1d-d62e-446a-a557-43217aba9a6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 09:58:09.757264 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:09.757147    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 09:53:09 +0000 UTC" deadline="2028-06-17 00:18:50.836898992 +0000 UTC"
Sep 08 09:58:09.757264 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:09.757210    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15542h20m41.079692973s"
Sep 08 09:58:09.827551 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:09.827494    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8lnsn"
Sep 08 09:58:09.827715 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:09.827648    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8lnsn" podUID="6829ca1d-d62e-446a-a557-43217aba9a6f"
Sep 08 09:58:09.842723 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:09.842693    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2zsx5" event={"ID":"4a41ec82-3e27-4c50-b580-861230051e27","Type":"ContainerStarted","Data":"334c04a63980ce72650001742b01c6e279dfed7034bce48158ccb81b9c5a6f41"}
Sep 08 09:58:09.846709 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:09.846633    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsc2q" event={"ID":"73d345ba-36c0-46ab-b6d8-7351693d21a5","Type":"ContainerStarted","Data":"ff72ee74a2d6076bf7378ee03c63025e23c273c4b13ec1d22fea21600a4d84f8"}
Sep 08 09:58:09.852651 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:09.852624    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dcfdx" event={"ID":"1425c284-4dee-4ed4-a65f-8c1dc7283c8f","Type":"ContainerStarted","Data":"4a6434667292e158cba40c6a3e58d94491540ab8f726887bd854ae2292d13329"}
Sep 08 09:58:09.855885 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:09.855853    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-85r8m" event={"ID":"03e3282b-d719-4d88-ac22-72691939bdac","Type":"ContainerStarted","Data":"28331ba8fd7ab19b20a271792b71b4f46c928abd70c81ee969725e567ed0ed0f"}
Sep 08 09:58:09.857792 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:09.857762    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kz86g" event={"ID":"0c248488-2449-4ff6-a079-8b466acd152e","Type":"ContainerStarted","Data":"e9b449caed0bece5c0370005f7fbd91921cd3cf215c6d67a299462e9176f8b8d"}
Sep 08 09:58:09.859703 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:09.859677    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-l52p6" event={"ID":"90152f2b-6780-4ce9-8938-aedd788ac94c","Type":"ContainerStarted","Data":"7e4737cd98755bc859f8f02ffb15c1c811d72741c46b981fc6cff52218ea1693"}
Sep 08 09:58:09.861226 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:09.861198    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8l4t6" event={"ID":"8256cd1d-5778-4897-91b2-8a45f97f69dd","Type":"ContainerStarted","Data":"1e2513b31ebe0d78faf7ef7e8eb41421f38fb94d1a03d34f6cf12add8fee8bc5"}
Sep 08 09:58:09.863561 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:09.863531    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pjsr4" event={"ID":"1fa9f2a5-3fe1-439f-ac9d-c17fbb4a1e8e","Type":"ContainerStarted","Data":"e5e32feedb9e3f57050a6f7d2ba9598b1822155f74d5cf2edf2d66b6e652b0fa"}
Sep 08 09:58:09.866146 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:09.866123    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wdvlk" event={"ID":"313cffc0-94c1-466a-8a57-750151daa9ea","Type":"ContainerStarted","Data":"9edc9e04b056fe5f4c2b5ac0db97e0eb57c748832f7f548923f2ee78285c95e8"}
Sep 08 09:58:09.944607 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:09.944575    2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 09:58:10.434939 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:10.434905    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ce5d383-ffe7-47c5-8960-4553f5dfd4c4-original-pull-secret\") pod \"global-pull-secret-syncer-j4t5c\" (UID: \"3ce5d383-ffe7-47c5-8960-4553f5dfd4c4\") " pod="kube-system/global-pull-secret-syncer-j4t5c"
Sep 08 09:58:10.435131 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:10.434954    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3868a1c3-46c6-4940-92ed-e460b77d7cfc-metrics-certs\") pod \"network-metrics-daemon-b5m55\" (UID: \"3868a1c3-46c6-4940-92ed-e460b77d7cfc\") " pod="openshift-multus/network-metrics-daemon-b5m55"
Sep 08 09:58:10.435131 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:10.435068    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 09:58:10.435131 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:10.435119    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3868a1c3-46c6-4940-92ed-e460b77d7cfc-metrics-certs podName:3868a1c3-46c6-4940-92ed-e460b77d7cfc nodeName:}" failed. No retries permitted until 2026-09-08 09:58:12.435105105 +0000 UTC m=+6.130703991 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3868a1c3-46c6-4940-92ed-e460b77d7cfc-metrics-certs") pod "network-metrics-daemon-b5m55" (UID: "3868a1c3-46c6-4940-92ed-e460b77d7cfc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 09:58:10.435131 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:10.435121    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 09:58:10.435355 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:10.435193    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ce5d383-ffe7-47c5-8960-4553f5dfd4c4-original-pull-secret podName:3ce5d383-ffe7-47c5-8960-4553f5dfd4c4 nodeName:}" failed. No retries permitted until 2026-09-08 09:58:12.435173241 +0000 UTC m=+6.130772137 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3ce5d383-ffe7-47c5-8960-4553f5dfd4c4-original-pull-secret") pod "global-pull-secret-syncer-j4t5c" (UID: "3ce5d383-ffe7-47c5-8960-4553f5dfd4c4") : object "kube-system"/"original-pull-secret" not registered
Sep 08 09:58:10.535604 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:10.535545    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzfrc\" (UniqueName: \"kubernetes.io/projected/6829ca1d-d62e-446a-a557-43217aba9a6f-kube-api-access-xzfrc\") pod \"network-check-target-8lnsn\" (UID: \"6829ca1d-d62e-446a-a557-43217aba9a6f\") " pod="openshift-network-diagnostics/network-check-target-8lnsn"
Sep 08 09:58:10.535819 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:10.535769    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 09:58:10.535819 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:10.535792    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 09:58:10.535819 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:10.535805    2579 projected.go:196] Error preparing data for projected volume kube-api-access-xzfrc for pod openshift-network-diagnostics/network-check-target-8lnsn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 09:58:10.536019 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:10.535869    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6829ca1d-d62e-446a-a557-43217aba9a6f-kube-api-access-xzfrc podName:6829ca1d-d62e-446a-a557-43217aba9a6f nodeName:}" failed. No retries permitted until 2026-09-08 09:58:12.535848937 +0000 UTC m=+6.231447841 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-xzfrc" (UniqueName: "kubernetes.io/projected/6829ca1d-d62e-446a-a557-43217aba9a6f-kube-api-access-xzfrc") pod "network-check-target-8lnsn" (UID: "6829ca1d-d62e-446a-a557-43217aba9a6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 09:58:10.758326 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:10.758229    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 09:53:09 +0000 UTC" deadline="2028-04-10 09:58:12.712315527 +0000 UTC"
Sep 08 09:58:10.758326 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:10.758263    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13920h0m1.954055495s"
Sep 08 09:58:10.829419 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:10.829312    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b5m55"
Sep 08 09:58:10.829592 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:10.829456    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b5m55" podUID="3868a1c3-46c6-4940-92ed-e460b77d7cfc"
Sep 08 09:58:10.830723 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:10.829903    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j4t5c"
Sep 08 09:58:10.830723 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:10.830005    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j4t5c" podUID="3ce5d383-ffe7-47c5-8960-4553f5dfd4c4"
Sep 08 09:58:11.827329 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:11.827296    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8lnsn"
Sep 08 09:58:11.827906 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:11.827409    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8lnsn" podUID="6829ca1d-d62e-446a-a557-43217aba9a6f"
Sep 08 09:58:12.452503 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:12.451531    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ce5d383-ffe7-47c5-8960-4553f5dfd4c4-original-pull-secret\") pod \"global-pull-secret-syncer-j4t5c\" (UID: \"3ce5d383-ffe7-47c5-8960-4553f5dfd4c4\") " pod="kube-system/global-pull-secret-syncer-j4t5c"
Sep 08 09:58:12.452503 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:12.451628    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3868a1c3-46c6-4940-92ed-e460b77d7cfc-metrics-certs\") pod \"network-metrics-daemon-b5m55\" (UID: \"3868a1c3-46c6-4940-92ed-e460b77d7cfc\") " pod="openshift-multus/network-metrics-daemon-b5m55"
Sep 08 09:58:12.452503 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:12.451694    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 09:58:12.452503 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:12.451751    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 09:58:12.452503 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:12.451770    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ce5d383-ffe7-47c5-8960-4553f5dfd4c4-original-pull-secret podName:3ce5d383-ffe7-47c5-8960-4553f5dfd4c4 nodeName:}" failed. No retries permitted until 2026-09-08 09:58:16.451747493 +0000 UTC m=+10.147346379 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3ce5d383-ffe7-47c5-8960-4553f5dfd4c4-original-pull-secret") pod "global-pull-secret-syncer-j4t5c" (UID: "3ce5d383-ffe7-47c5-8960-4553f5dfd4c4") : object "kube-system"/"original-pull-secret" not registered
Sep 08 09:58:12.452503 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:12.451807    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3868a1c3-46c6-4940-92ed-e460b77d7cfc-metrics-certs podName:3868a1c3-46c6-4940-92ed-e460b77d7cfc nodeName:}" failed. No retries permitted until 2026-09-08 09:58:16.451789262 +0000 UTC m=+10.147388148 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3868a1c3-46c6-4940-92ed-e460b77d7cfc-metrics-certs") pod "network-metrics-daemon-b5m55" (UID: "3868a1c3-46c6-4940-92ed-e460b77d7cfc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 09:58:12.552281 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:12.552243    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzfrc\" (UniqueName: \"kubernetes.io/projected/6829ca1d-d62e-446a-a557-43217aba9a6f-kube-api-access-xzfrc\") pod \"network-check-target-8lnsn\" (UID: \"6829ca1d-d62e-446a-a557-43217aba9a6f\") " pod="openshift-network-diagnostics/network-check-target-8lnsn"
Sep 08 09:58:12.552465 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:12.552437    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 09:58:12.552465 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:12.552471    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 09:58:12.552718 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:12.552486    2579 projected.go:196] Error preparing data for projected volume kube-api-access-xzfrc for pod openshift-network-diagnostics/network-check-target-8lnsn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 09:58:12.552718 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:12.552550    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6829ca1d-d62e-446a-a557-43217aba9a6f-kube-api-access-xzfrc podName:6829ca1d-d62e-446a-a557-43217aba9a6f nodeName:}" failed. No retries permitted until 2026-09-08 09:58:16.552529555 +0000 UTC m=+10.248128449 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-xzfrc" (UniqueName: "kubernetes.io/projected/6829ca1d-d62e-446a-a557-43217aba9a6f-kube-api-access-xzfrc") pod "network-check-target-8lnsn" (UID: "6829ca1d-d62e-446a-a557-43217aba9a6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 09:58:12.829486 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:12.829394    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j4t5c"
Sep 08 09:58:12.829977 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:12.829537    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j4t5c" podUID="3ce5d383-ffe7-47c5-8960-4553f5dfd4c4"
Sep 08 09:58:12.829977 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:12.829629    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b5m55"
Sep 08 09:58:12.829977 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:12.829726    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b5m55" podUID="3868a1c3-46c6-4940-92ed-e460b77d7cfc"
Sep 08 09:58:13.826801 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:13.826760    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8lnsn"
Sep 08 09:58:13.826990 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:13.826904    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8lnsn" podUID="6829ca1d-d62e-446a-a557-43217aba9a6f"
Sep 08 09:58:14.827728 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:14.827689    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b5m55"
Sep 08 09:58:14.828209 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:14.827852    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b5m55" podUID="3868a1c3-46c6-4940-92ed-e460b77d7cfc"
Sep 08 09:58:14.828775 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:14.828581    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j4t5c"
Sep 08 09:58:14.828775 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:14.828683    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j4t5c" podUID="3ce5d383-ffe7-47c5-8960-4553f5dfd4c4"
Sep 08 09:58:15.827174 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:15.827143    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8lnsn"
Sep 08 09:58:15.827355 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:15.827249    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8lnsn" podUID="6829ca1d-d62e-446a-a557-43217aba9a6f"
Sep 08 09:58:16.494617 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:16.494544    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ce5d383-ffe7-47c5-8960-4553f5dfd4c4-original-pull-secret\") pod \"global-pull-secret-syncer-j4t5c\" (UID: \"3ce5d383-ffe7-47c5-8960-4553f5dfd4c4\") " pod="kube-system/global-pull-secret-syncer-j4t5c"
Sep 08 09:58:16.495173 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:16.494638    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3868a1c3-46c6-4940-92ed-e460b77d7cfc-metrics-certs\") pod \"network-metrics-daemon-b5m55\" (UID: \"3868a1c3-46c6-4940-92ed-e460b77d7cfc\") " pod="openshift-multus/network-metrics-daemon-b5m55"
Sep 08 09:58:16.495173 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:16.494790    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 09:58:16.495173 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:16.494856    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3868a1c3-46c6-4940-92ed-e460b77d7cfc-metrics-certs podName:3868a1c3-46c6-4940-92ed-e460b77d7cfc nodeName:}" failed. No retries permitted until 2026-09-08 09:58:24.494834062 +0000 UTC m=+18.190432947 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3868a1c3-46c6-4940-92ed-e460b77d7cfc-metrics-certs") pod "network-metrics-daemon-b5m55" (UID: "3868a1c3-46c6-4940-92ed-e460b77d7cfc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 09:58:16.495173 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:16.494905    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 09:58:16.495173 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:16.494935    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ce5d383-ffe7-47c5-8960-4553f5dfd4c4-original-pull-secret podName:3ce5d383-ffe7-47c5-8960-4553f5dfd4c4 nodeName:}" failed. No retries permitted until 2026-09-08 09:58:24.494923585 +0000 UTC m=+18.190522466 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3ce5d383-ffe7-47c5-8960-4553f5dfd4c4-original-pull-secret") pod "global-pull-secret-syncer-j4t5c" (UID: "3ce5d383-ffe7-47c5-8960-4553f5dfd4c4") : object "kube-system"/"original-pull-secret" not registered
Sep 08 09:58:16.595792 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:16.595663    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzfrc\" (UniqueName: \"kubernetes.io/projected/6829ca1d-d62e-446a-a557-43217aba9a6f-kube-api-access-xzfrc\") pod \"network-check-target-8lnsn\" (UID: \"6829ca1d-d62e-446a-a557-43217aba9a6f\") " pod="openshift-network-diagnostics/network-check-target-8lnsn"
Sep 08 09:58:16.596010 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:16.595821    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 09:58:16.596010 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:16.595849    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 09:58:16.596010 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:16.595864    2579 projected.go:196] Error preparing data for projected volume kube-api-access-xzfrc for pod openshift-network-diagnostics/network-check-target-8lnsn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 09:58:16.596010 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:16.595936    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6829ca1d-d62e-446a-a557-43217aba9a6f-kube-api-access-xzfrc podName:6829ca1d-d62e-446a-a557-43217aba9a6f nodeName:}" failed. No retries permitted until 2026-09-08 09:58:24.595914158 +0000 UTC m=+18.291513053 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-xzfrc" (UniqueName: "kubernetes.io/projected/6829ca1d-d62e-446a-a557-43217aba9a6f-kube-api-access-xzfrc") pod "network-check-target-8lnsn" (UID: "6829ca1d-d62e-446a-a557-43217aba9a6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 09:58:16.828015 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:16.827927    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b5m55"
Sep 08 09:58:16.828198 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:16.828072    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b5m55" podUID="3868a1c3-46c6-4940-92ed-e460b77d7cfc"
Sep 08 09:58:16.828463 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:16.828444    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j4t5c"
Sep 08 09:58:16.828566 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:16.828546    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j4t5c" podUID="3ce5d383-ffe7-47c5-8960-4553f5dfd4c4"
Sep 08 09:58:17.827003 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:17.826951    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8lnsn"
Sep 08 09:58:17.827450 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:17.827094    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8lnsn" podUID="6829ca1d-d62e-446a-a557-43217aba9a6f"
Sep 08 09:58:18.827394 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:18.827355    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b5m55"
Sep 08 09:58:18.827823 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:18.827355    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j4t5c"
Sep 08 09:58:18.827823 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:18.827539    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b5m55" podUID="3868a1c3-46c6-4940-92ed-e460b77d7cfc"
Sep 08 09:58:18.827823 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:18.827670    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j4t5c" podUID="3ce5d383-ffe7-47c5-8960-4553f5dfd4c4"
Sep 08 09:58:19.826912 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:19.826875    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8lnsn"
Sep 08 09:58:19.827079 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:19.826998    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8lnsn" podUID="6829ca1d-d62e-446a-a557-43217aba9a6f"
Sep 08 09:58:20.827314 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:20.827277    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b5m55"
Sep 08 09:58:20.827763 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:20.827418    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b5m55" podUID="3868a1c3-46c6-4940-92ed-e460b77d7cfc"
Sep 08 09:58:20.827763 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:20.827479    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j4t5c"
Sep 08 09:58:20.827763 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:20.827623    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j4t5c" podUID="3ce5d383-ffe7-47c5-8960-4553f5dfd4c4"
Sep 08 09:58:21.826681 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:21.826651    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8lnsn"
Sep 08 09:58:21.826849 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:21.826773    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8lnsn" podUID="6829ca1d-d62e-446a-a557-43217aba9a6f"
Sep 08 09:58:22.829375 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:22.829345    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j4t5c"
Sep 08 09:58:22.829836 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:22.829352    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b5m55"
Sep 08 09:58:22.829836 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:22.829470    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j4t5c" podUID="3ce5d383-ffe7-47c5-8960-4553f5dfd4c4"
Sep 08 09:58:22.829836 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:22.829613    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b5m55" podUID="3868a1c3-46c6-4940-92ed-e460b77d7cfc"
Sep 08 09:58:23.826755 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:23.826723    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8lnsn"
Sep 08 09:58:23.826944 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:23.826823    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8lnsn" podUID="6829ca1d-d62e-446a-a557-43217aba9a6f"
Sep 08 09:58:24.561223 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:24.561191    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ce5d383-ffe7-47c5-8960-4553f5dfd4c4-original-pull-secret\") pod \"global-pull-secret-syncer-j4t5c\" (UID: \"3ce5d383-ffe7-47c5-8960-4553f5dfd4c4\") " pod="kube-system/global-pull-secret-syncer-j4t5c"
Sep 08 09:58:24.561764 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:24.561237    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3868a1c3-46c6-4940-92ed-e460b77d7cfc-metrics-certs\") pod \"network-metrics-daemon-b5m55\" (UID: \"3868a1c3-46c6-4940-92ed-e460b77d7cfc\") " pod="openshift-multus/network-metrics-daemon-b5m55"
Sep 08 09:58:24.561764 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:24.561335    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 09:58:24.561764 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:24.561343    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 09:58:24.561764 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:24.561382    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3868a1c3-46c6-4940-92ed-e460b77d7cfc-metrics-certs podName:3868a1c3-46c6-4940-92ed-e460b77d7cfc nodeName:}" failed. No retries permitted until 2026-09-08 09:58:40.561368747 +0000 UTC m=+34.256967625 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3868a1c3-46c6-4940-92ed-e460b77d7cfc-metrics-certs") pod "network-metrics-daemon-b5m55" (UID: "3868a1c3-46c6-4940-92ed-e460b77d7cfc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 09:58:24.561764 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:24.561406    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ce5d383-ffe7-47c5-8960-4553f5dfd4c4-original-pull-secret podName:3ce5d383-ffe7-47c5-8960-4553f5dfd4c4 nodeName:}" failed. No retries permitted until 2026-09-08 09:58:40.561388368 +0000 UTC m=+34.256987261 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3ce5d383-ffe7-47c5-8960-4553f5dfd4c4-original-pull-secret") pod "global-pull-secret-syncer-j4t5c" (UID: "3ce5d383-ffe7-47c5-8960-4553f5dfd4c4") : object "kube-system"/"original-pull-secret" not registered
Sep 08 09:58:24.662348 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:24.662319    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzfrc\" (UniqueName: \"kubernetes.io/projected/6829ca1d-d62e-446a-a557-43217aba9a6f-kube-api-access-xzfrc\") pod \"network-check-target-8lnsn\" (UID: \"6829ca1d-d62e-446a-a557-43217aba9a6f\") " pod="openshift-network-diagnostics/network-check-target-8lnsn"
Sep 08 09:58:24.662525 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:24.662501    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 09:58:24.662595 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:24.662554    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 09:58:24.662595 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:24.662571    2579 projected.go:196] Error preparing data for projected volume kube-api-access-xzfrc for pod openshift-network-diagnostics/network-check-target-8lnsn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 09:58:24.662742 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:24.662641    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6829ca1d-d62e-446a-a557-43217aba9a6f-kube-api-access-xzfrc podName:6829ca1d-d62e-446a-a557-43217aba9a6f nodeName:}" failed. No retries permitted until 2026-09-08 09:58:40.662619969 +0000 UTC m=+34.358218849 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-xzfrc" (UniqueName: "kubernetes.io/projected/6829ca1d-d62e-446a-a557-43217aba9a6f-kube-api-access-xzfrc") pod "network-check-target-8lnsn" (UID: "6829ca1d-d62e-446a-a557-43217aba9a6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 09:58:24.829959 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:24.829887    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j4t5c"
Sep 08 09:58:24.830085 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:24.829984    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j4t5c" podUID="3ce5d383-ffe7-47c5-8960-4553f5dfd4c4"
Sep 08 09:58:24.830085 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:24.830048    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b5m55"
Sep 08 09:58:24.830168 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:24.830151    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b5m55" podUID="3868a1c3-46c6-4940-92ed-e460b77d7cfc"
Sep 08 09:58:25.826441 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:25.826409    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8lnsn"
Sep 08 09:58:25.826884 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:25.826554    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8lnsn" podUID="6829ca1d-d62e-446a-a557-43217aba9a6f"
Sep 08 09:58:26.829729 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:26.829699    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j4t5c"
Sep 08 09:58:26.830152 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:26.829796    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j4t5c" podUID="3ce5d383-ffe7-47c5-8960-4553f5dfd4c4"
Sep 08 09:58:26.830152 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:26.829871    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b5m55"
Sep 08 09:58:26.830152 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:26.829996    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b5m55" podUID="3868a1c3-46c6-4940-92ed-e460b77d7cfc"
Sep 08 09:58:27.827193 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:27.827161    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8lnsn"
Sep 08 09:58:27.827367 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:27.827287    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8lnsn" podUID="6829ca1d-d62e-446a-a557-43217aba9a6f"
Sep 08 09:58:28.826703 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:28.826673    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b5m55"
Sep 08 09:58:28.827247 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:28.826811    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b5m55" podUID="3868a1c3-46c6-4940-92ed-e460b77d7cfc"
Sep 08 09:58:28.827247 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:28.826873    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j4t5c"
Sep 08 09:58:28.827247 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:28.826995    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j4t5c" podUID="3ce5d383-ffe7-47c5-8960-4553f5dfd4c4"
Sep 08 09:58:29.827565 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:29.827125    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8lnsn"
Sep 08 09:58:29.828051 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:29.827683    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8lnsn" podUID="6829ca1d-d62e-446a-a557-43217aba9a6f"
Sep 08 09:58:29.910338 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:29.910306    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-96.ec2.internal" event={"ID":"39c5e68f9a1e6fb3d5599c7ac75713d7","Type":"ContainerStarted","Data":"6a5685e920eae9c095b2c0040995ff11ad415500f4fc50b351e21c58880fc13d"}
Sep 08 09:58:29.911985 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:29.911951    2579 generic.go:356] "Generic (PLEG): container finished" podID="ba08d37bcb40217ed6ffc66b79f33b9e" containerID="8c02df80226ed321b0054b5f7b2f3e86d0d609d278e90e6ad08250f46ea9fa58" exitCode=0
Sep 08 09:58:29.912124 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:29.912021    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-96.ec2.internal" event={"ID":"ba08d37bcb40217ed6ffc66b79f33b9e","Type":"ContainerDied","Data":"8c02df80226ed321b0054b5f7b2f3e86d0d609d278e90e6ad08250f46ea9fa58"}
Sep 08 09:58:29.913553 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:29.913506    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2zsx5" event={"ID":"4a41ec82-3e27-4c50-b580-861230051e27","Type":"ContainerStarted","Data":"eded5067f234c38450dddda4a08b61c5bd8ddf19301de4d26f39f83b403561d1"}
Sep 08 09:58:29.915035 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:29.915014    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsc2q" event={"ID":"73d345ba-36c0-46ab-b6d8-7351693d21a5","Type":"ContainerStarted","Data":"80352c6306dc459fe3f01f2ad11b4b599824e52efb17ba7aff3c20ea49ae83c3"}
Sep 08 09:58:29.916387 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:29.916368    2579 generic.go:356] "Generic (PLEG): container finished" podID="1425c284-4dee-4ed4-a65f-8c1dc7283c8f" containerID="e621705e578c6254b5b9f668a004e5a7945d69a3fd7c2477889857e94746db71" exitCode=0
Sep 08 09:58:29.916483 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:29.916416    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dcfdx" event={"ID":"1425c284-4dee-4ed4-a65f-8c1dc7283c8f","Type":"ContainerDied","Data":"e621705e578c6254b5b9f668a004e5a7945d69a3fd7c2477889857e94746db71"}
Sep 08 09:58:29.918317 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:29.918295    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-85r8m" event={"ID":"03e3282b-d719-4d88-ac22-72691939bdac","Type":"ContainerStarted","Data":"8f9c553c42864ee72dd0e8048ccae840c84f0d75c6891644be04c609a94a1d00"}
Sep 08 09:58:29.921991 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:29.921968    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kz86g" event={"ID":"0c248488-2449-4ff6-a079-8b466acd152e","Type":"ContainerStarted","Data":"b62039dd4300caa5b5bc80b23b7c3219775aa905b14ae36a7c8b97afd7652675"}
Sep 08 09:58:29.922075 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:29.922064    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kz86g" event={"ID":"0c248488-2449-4ff6-a079-8b466acd152e","Type":"ContainerStarted","Data":"594a526392c6e3922993473a5a6ec22265acf26590926eb8261e43c2a362d8fe"}
Sep 08 09:58:29.922132 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:29.922115    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kz86g" event={"ID":"0c248488-2449-4ff6-a079-8b466acd152e","Type":"ContainerStarted","Data":"6d88fa6defaf60d4956e9a9951c488956c3e9639ef39004aa67accf72d338636"}
Sep 08 09:58:29.922179 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:29.922166    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kz86g" event={"ID":"0c248488-2449-4ff6-a079-8b466acd152e","Type":"ContainerStarted","Data":"c0425edb51d6734974484382d49ede5b3fcaa1dd12870b9fa4edd3209cab0f7c"}
Sep 08 09:58:29.922225 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:29.922212    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kz86g" event={"ID":"0c248488-2449-4ff6-a079-8b466acd152e","Type":"ContainerStarted","Data":"ac151dd93fc573d437d944db6c0ab35f7481f22d11683b74b7ff0bf2b5434f17"}
Sep 08 09:58:29.922278 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:29.922261    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kz86g" event={"ID":"0c248488-2449-4ff6-a079-8b466acd152e","Type":"ContainerStarted","Data":"ef644d451757f5cd8415805d0640a246c4acc144e5840d85e6c762ed1a1badc5"}
Sep 08 09:58:29.924291 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:29.924239    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-l52p6" event={"ID":"90152f2b-6780-4ce9-8938-aedd788ac94c","Type":"ContainerStarted","Data":"542c348d1c117324ec0e0af0c81138220e207d00994ee82176c0b493c67b7234"}
Sep 08 09:58:29.925554 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:29.925519    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8l4t6" event={"ID":"8256cd1d-5778-4897-91b2-8a45f97f69dd","Type":"ContainerStarted","Data":"356356e72be294f7a6f793dae0b437bd207d067c14497e200b5883689c099a06"}
Sep 08 09:58:29.926733 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:29.926708    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wdvlk" event={"ID":"313cffc0-94c1-466a-8a57-750151daa9ea","Type":"ContainerStarted","Data":"e1be7af9c49578b850f678966f4f94b6eb8143a422a14ee3353e39850da2548d"}
Sep 08 09:58:29.934463 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:29.934425    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-96.ec2.internal" podStartSLOduration=21.934414094 podStartE2EDuration="21.934414094s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 09:58:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 09:58:29.934069075 +0000 UTC m=+23.629667976" watchObservedRunningTime="2026-09-08 09:58:29.934414094 +0000 UTC m=+23.630012991"
Sep 08 09:58:29.976264 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:29.976224    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2zsx5" podStartSLOduration=2.8557187859999997 podStartE2EDuration="22.976210901s" totalImagesPullingTime="20.120492115s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 09:58:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 09:58:29.975857528 +0000 UTC m=+23.671456428" watchObservedRunningTime="2026-09-08 09:58:29.976210901 +0000 UTC m=+23.671809800"
Sep 08 09:58:29.992566 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:29.990860    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8l4t6" podStartSLOduration=2.88462254 podStartE2EDuration="22.990844475s" totalImagesPullingTime="20.106221935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 09:58:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 09:58:29.990760247 +0000 UTC m=+23.686359151" watchObservedRunningTime="2026-09-08 09:58:29.990844475 +0000 UTC m=+23.686443377"
Sep 08 09:58:30.026411 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:30.026378    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-85r8m" podStartSLOduration=2.781265894 podStartE2EDuration="23.026366152s" totalImagesPullingTime="20.245100258s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 09:58:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 09:58:30.025853757 +0000 UTC m=+23.721452657" watchObservedRunningTime="2026-09-08 09:58:30.026366152 +0000 UTC m=+23.721965052"
Sep 08 09:58:30.040776 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:30.040741    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wdvlk" podStartSLOduration=2.908754727 podStartE2EDuration="23.040728838s" totalImagesPullingTime="20.131974111s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 09:58:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 09:58:30.040309982 +0000 UTC m=+23.735908881" watchObservedRunningTime="2026-09-08 09:58:30.040728838 +0000 UTC m=+23.736327739"
Sep 08 09:58:30.056887 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:30.056851    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-l52p6" podStartSLOduration=2.913211934 podStartE2EDuration="23.056839328s" totalImagesPullingTime="20.143627394s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 09:58:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 09:58:30.056704814 +0000 UTC m=+23.752303731" watchObservedRunningTime="2026-09-08 09:58:30.056839328 +0000 UTC m=+23.752438227"
Sep 08 09:58:30.159600 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:30.159570    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 09:58:30.235494 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:30.235463    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 09:58:30.830443 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:30.830413    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j4t5c"
Sep 08 09:58:30.831045 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:30.830522    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j4t5c" podUID="3ce5d383-ffe7-47c5-8960-4553f5dfd4c4"
Sep 08 09:58:30.831045 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:30.830579    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b5m55"
Sep 08 09:58:30.831045 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:30.830711    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b5m55" podUID="3868a1c3-46c6-4940-92ed-e460b77d7cfc"
Sep 08 09:58:30.931117 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:30.931085    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-96.ec2.internal" event={"ID":"ba08d37bcb40217ed6ffc66b79f33b9e","Type":"ContainerStarted","Data":"022ec73d4fe0436adcbb4b3c8244603ed43f1e8fafac565179f8f52c8cf13df8"}
Sep 08 09:58:30.932922 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:30.932892    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pjsr4" event={"ID":"1fa9f2a5-3fe1-439f-ac9d-c17fbb4a1e8e","Type":"ContainerStarted","Data":"2c2bd2c06c744a802abf6e5c5e8511a1386bc8411cc870181d100f209b7716dd"}
Sep 08 09:58:30.965972 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:30.965927    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-96.ec2.internal" podStartSLOduration=22.965913892 podStartE2EDuration="22.965913892s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 09:58:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 09:58:30.948010495 +0000 UTC m=+24.643609387" watchObservedRunningTime="2026-09-08 09:58:30.965913892 +0000 UTC m=+24.661512792"
Sep 08 09:58:30.966101 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:30.966083    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pjsr4" podStartSLOduration=3.848112948 podStartE2EDuration="23.966077509s" totalImagesPullingTime="20.117964561s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 09:58:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 09:58:30.965823076 +0000 UTC m=+24.661421976" watchObservedRunningTime="2026-09-08 09:58:30.966077509 +0000 UTC m=+24.661676408"
Sep 08 09:58:31.204579 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:31.204515    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 09:58:31.305983 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:31.305934    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 09:58:31.434901 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:31.434870    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8l4t6"
Sep 08 09:58:31.435502 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:31.435481    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8l4t6"
Sep 08 09:58:31.650743 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:31.650701    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 09:58:31.826920 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:31.826897    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8lnsn"
Sep 08 09:58:31.827057 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:31.827001    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8lnsn" podUID="6829ca1d-d62e-446a-a557-43217aba9a6f"
Sep 08 09:58:31.898316 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:31.898281    2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 08 09:58:31.937893 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:31.937651    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsc2q" event={"ID":"73d345ba-36c0-46ab-b6d8-7351693d21a5","Type":"ContainerStarted","Data":"0a51ded2fc07da796baaba55c91e3a5e05fbf53a803c104950031079068c559d"}
Sep 08 09:58:31.943365 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:31.943339    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kz86g" event={"ID":"0c248488-2449-4ff6-a079-8b466acd152e","Type":"ContainerStarted","Data":"f195e554b70bbf696b1c0ded043cc3a53e044c82fa95e1db88d83d2fb55622a5"}
Sep 08 09:58:31.944434 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:31.944136    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8l4t6"
Sep 08 09:58:31.944569 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:31.944495    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8l4t6"
Sep 08 09:58:32.772438 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:32.772310    2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-08T09:58:31.898303761Z","UUID":"f47caf9f-f9e5-4491-bbef-87e731bc92a7","Handler":null,"Name":"","Endpoint":""}
Sep 08 09:58:32.774106 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:32.774086    2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 08 09:58:32.774233 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:32.774120    2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 08 09:58:32.827473 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:32.827432    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b5m55"
Sep 08 09:58:32.827654 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:32.827572    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b5m55" podUID="3868a1c3-46c6-4940-92ed-e460b77d7cfc"
Sep 08 09:58:32.827654 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:32.827625    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j4t5c"
Sep 08 09:58:32.827773 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:32.827717    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j4t5c" podUID="3ce5d383-ffe7-47c5-8960-4553f5dfd4c4"
Sep 08 09:58:32.915940 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:32.915882    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 09:58:33.601567 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:33.600525    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 09:58:33.826480 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:33.826443    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8lnsn"
Sep 08 09:58:33.826648 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:33.826571    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8lnsn" podUID="6829ca1d-d62e-446a-a557-43217aba9a6f"
Sep 08 09:58:34.826623 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:34.826363    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b5m55"
Sep 08 09:58:34.827038 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:34.826704    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b5m55" podUID="3868a1c3-46c6-4940-92ed-e460b77d7cfc"
Sep 08 09:58:34.827038 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:34.826871    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j4t5c"
Sep 08 09:58:34.828015 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:34.827969    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j4t5c" podUID="3ce5d383-ffe7-47c5-8960-4553f5dfd4c4"
Sep 08 09:58:34.954051 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:34.954016    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-kz86g" event={"ID":"0c248488-2449-4ff6-a079-8b466acd152e","Type":"ContainerStarted","Data":"361cf4b32e50ce5c87fcd79d23beffb4d26d1153a04cd7e933ee0b56327558ae"}
Sep 08 09:58:34.954272 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:34.954248    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:34.956136 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:34.956112    2579 generic.go:356] "Generic (PLEG): container finished" podID="1425c284-4dee-4ed4-a65f-8c1dc7283c8f" containerID="41242017b9a7eac577f0b08b1374467adc56303c674338bcc297d5ebc9cfa4ad" exitCode=0
Sep 08 09:58:34.956232 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:34.956151    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dcfdx" event={"ID":"1425c284-4dee-4ed4-a65f-8c1dc7283c8f","Type":"ContainerDied","Data":"41242017b9a7eac577f0b08b1374467adc56303c674338bcc297d5ebc9cfa4ad"}
Sep 08 09:58:34.971377 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:34.971357    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:34.983997 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:34.983935    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-kz86g" podStartSLOduration=6.845047457 podStartE2EDuration="26.98392301s" totalImagesPullingTime="20.138875553s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 09:58:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 09:58:34.982458869 +0000 UTC m=+28.678057771" watchObservedRunningTime="2026-09-08 09:58:34.98392301 +0000 UTC m=+28.679521921"
Sep 08 09:58:35.364260 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:35.364185    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 09:58:35.830512 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:35.830484    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8lnsn"
Sep 08 09:58:35.831238 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:35.830625    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8lnsn" podUID="6829ca1d-d62e-446a-a557-43217aba9a6f"
Sep 08 09:58:35.960804 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:35.960770    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsc2q" event={"ID":"73d345ba-36c0-46ab-b6d8-7351693d21a5","Type":"ContainerStarted","Data":"576fc5a30bd6bba5200b9b4a36299b3d1d1102884de5932d6f9474719ca59881"}
Sep 08 09:58:35.963227 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:35.963201    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dcfdx" event={"ID":"1425c284-4dee-4ed4-a65f-8c1dc7283c8f","Type":"ContainerStarted","Data":"05e05505de6d03d1f6819a2352deda249298232ff798fa6ae001d2716dbdaef2"}
Sep 08 09:58:35.963748 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:35.963726    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:35.963814 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:35.963802    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:35.979422 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:35.979396    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:58:35.979980 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:35.979947    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lsc2q" podStartSLOduration=3.481628869 podStartE2EDuration="28.979933849s" totalImagesPullingTime="25.49830498s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 09:58:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 09:58:35.979518971 +0000 UTC m=+29.675117870" watchObservedRunningTime="2026-09-08 09:58:35.979933849 +0000 UTC m=+29.675532796"
Sep 08 09:58:36.544906 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:36.544871    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b5m55"]
Sep 08 09:58:36.545065 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:36.545051    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b5m55"
Sep 08 09:58:36.545190 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:36.545171    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b5m55" podUID="3868a1c3-46c6-4940-92ed-e460b77d7cfc"
Sep 08 09:58:36.548399 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:36.548375    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-j4t5c"]
Sep 08 09:58:36.548490 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:36.548482    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j4t5c"
Sep 08 09:58:36.548623 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:36.548599    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j4t5c" podUID="3ce5d383-ffe7-47c5-8960-4553f5dfd4c4"
Sep 08 09:58:36.548945 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:36.548922    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8lnsn"]
Sep 08 09:58:36.549050 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:36.549009    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8lnsn"
Sep 08 09:58:36.549106 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:36.549088    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8lnsn" podUID="6829ca1d-d62e-446a-a557-43217aba9a6f"
Sep 08 09:58:36.966764 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:36.966731    2579 generic.go:356] "Generic (PLEG): container finished" podID="1425c284-4dee-4ed4-a65f-8c1dc7283c8f" containerID="05e05505de6d03d1f6819a2352deda249298232ff798fa6ae001d2716dbdaef2" exitCode=0
Sep 08 09:58:36.967445 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:36.966811    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dcfdx" event={"ID":"1425c284-4dee-4ed4-a65f-8c1dc7283c8f","Type":"ContainerDied","Data":"05e05505de6d03d1f6819a2352deda249298232ff798fa6ae001d2716dbdaef2"}
Sep 08 09:58:37.827157 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:37.826981    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j4t5c"
Sep 08 09:58:37.827288 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:37.827026    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8lnsn"
Sep 08 09:58:37.827331 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:37.827027    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b5m55"
Sep 08 09:58:37.827362 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:37.827320    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8lnsn" podUID="6829ca1d-d62e-446a-a557-43217aba9a6f"
Sep 08 09:58:37.827420 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:37.827218    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j4t5c" podUID="3ce5d383-ffe7-47c5-8960-4553f5dfd4c4"
Sep 08 09:58:37.827474 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:37.827429    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b5m55" podUID="3868a1c3-46c6-4940-92ed-e460b77d7cfc"
Sep 08 09:58:38.974031 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:38.973992    2579 generic.go:356] "Generic (PLEG): container finished" podID="1425c284-4dee-4ed4-a65f-8c1dc7283c8f" containerID="4ba8d4d716c09a4ebefd9eea28717b48748ce79db626bf1d6c50d7ba40f3b8d5" exitCode=0
Sep 08 09:58:38.974383 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:38.974060    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dcfdx" event={"ID":"1425c284-4dee-4ed4-a65f-8c1dc7283c8f","Type":"ContainerDied","Data":"4ba8d4d716c09a4ebefd9eea28717b48748ce79db626bf1d6c50d7ba40f3b8d5"}
Sep 08 09:58:39.826885 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:39.826847    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8lnsn"
Sep 08 09:58:39.826885 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:39.826894    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b5m55"
Sep 08 09:58:39.827066 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:39.826847    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j4t5c"
Sep 08 09:58:39.827066 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:39.826954    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8lnsn" podUID="6829ca1d-d62e-446a-a557-43217aba9a6f"
Sep 08 09:58:39.827066 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:39.827023    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j4t5c" podUID="3ce5d383-ffe7-47c5-8960-4553f5dfd4c4"
Sep 08 09:58:39.827186 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:39.827088    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b5m55" podUID="3868a1c3-46c6-4940-92ed-e460b77d7cfc"
Sep 08 09:58:40.532712 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:40.532677    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 09:58:40.580677 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:40.580594    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ce5d383-ffe7-47c5-8960-4553f5dfd4c4-original-pull-secret\") pod \"global-pull-secret-syncer-j4t5c\" (UID: \"3ce5d383-ffe7-47c5-8960-4553f5dfd4c4\") " pod="kube-system/global-pull-secret-syncer-j4t5c"
Sep 08 09:58:40.580677 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:40.580651    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3868a1c3-46c6-4940-92ed-e460b77d7cfc-metrics-certs\") pod \"network-metrics-daemon-b5m55\" (UID: \"3868a1c3-46c6-4940-92ed-e460b77d7cfc\") " pod="openshift-multus/network-metrics-daemon-b5m55"
Sep 08 09:58:40.580936 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:40.580755    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 09:58:40.580936 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:40.580770    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 09:58:40.580936 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:40.580829    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3868a1c3-46c6-4940-92ed-e460b77d7cfc-metrics-certs podName:3868a1c3-46c6-4940-92ed-e460b77d7cfc nodeName:}" failed. No retries permitted until 2026-09-08 09:59:12.580809112 +0000 UTC m=+66.276408016 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3868a1c3-46c6-4940-92ed-e460b77d7cfc-metrics-certs") pod "network-metrics-daemon-b5m55" (UID: "3868a1c3-46c6-4940-92ed-e460b77d7cfc") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 09:58:40.580936 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:40.580845    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ce5d383-ffe7-47c5-8960-4553f5dfd4c4-original-pull-secret podName:3ce5d383-ffe7-47c5-8960-4553f5dfd4c4 nodeName:}" failed. No retries permitted until 2026-09-08 09:59:12.580838513 +0000 UTC m=+66.276437391 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/3ce5d383-ffe7-47c5-8960-4553f5dfd4c4-original-pull-secret") pod "global-pull-secret-syncer-j4t5c" (UID: "3ce5d383-ffe7-47c5-8960-4553f5dfd4c4") : object "kube-system"/"original-pull-secret" not registered
Sep 08 09:58:40.632659 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:40.632625    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 09:58:40.681528 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:40.681473    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzfrc\" (UniqueName: \"kubernetes.io/projected/6829ca1d-d62e-446a-a557-43217aba9a6f-kube-api-access-xzfrc\") pod \"network-check-target-8lnsn\" (UID: \"6829ca1d-d62e-446a-a557-43217aba9a6f\") " pod="openshift-network-diagnostics/network-check-target-8lnsn"
Sep 08 09:58:40.681703 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:40.681686    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 09:58:40.681778 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:40.681715    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 09:58:40.681778 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:40.681728    2579 projected.go:196] Error preparing data for projected volume kube-api-access-xzfrc for pod openshift-network-diagnostics/network-check-target-8lnsn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 09:58:40.681889 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:40.681794    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6829ca1d-d62e-446a-a557-43217aba9a6f-kube-api-access-xzfrc podName:6829ca1d-d62e-446a-a557-43217aba9a6f nodeName:}" failed. No retries permitted until 2026-09-08 09:59:12.681774064 +0000 UTC m=+66.377372945 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-xzfrc" (UniqueName: "kubernetes.io/projected/6829ca1d-d62e-446a-a557-43217aba9a6f-kube-api-access-xzfrc") pod "network-check-target-8lnsn" (UID: "6829ca1d-d62e-446a-a557-43217aba9a6f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 09:58:40.691166 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:40.691132    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 09:58:41.109969 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:41.109918    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 09:58:41.678106 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:41.678073    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 09:58:41.826372 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:41.826331    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8lnsn"
Sep 08 09:58:41.826474 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:41.826381    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b5m55"
Sep 08 09:58:41.826474 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:41.826440    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j4t5c"
Sep 08 09:58:41.826474 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:41.826448    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8lnsn" podUID="6829ca1d-d62e-446a-a557-43217aba9a6f"
Sep 08 09:58:41.826598 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:41.826525    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-j4t5c" podUID="3ce5d383-ffe7-47c5-8960-4553f5dfd4c4"
Sep 08 09:58:41.826643 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:41.826626    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-b5m55" podUID="3868a1c3-46c6-4940-92ed-e460b77d7cfc"
Sep 08 09:58:42.135371 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:42.135342    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-96.ec2.internal" event="NodeReady"
Sep 08 09:58:42.135519 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:42.135475    2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 08 09:58:42.188221 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:42.188189    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-w56bl"]
Sep 08 09:58:42.208470 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:42.208445    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-cn8g6"]
Sep 08 09:58:42.208624 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:42.208574    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w56bl"
Sep 08 09:58:42.211095 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:42.211076    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 08 09:58:42.211562 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:42.211519    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vr97k\""
Sep 08 09:58:42.211726 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:42.211708    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 08 09:58:42.234498 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:42.234477    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-w56bl"]
Sep 08 09:58:42.234716 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:42.234519    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cn8g6"]
Sep 08 09:58:42.234716 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:42.234601    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cn8g6"
Sep 08 09:58:42.237357 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:42.237339    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 08 09:58:42.237470 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:42.237412    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 08 09:58:42.237637 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:42.237622    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-knzvw\""
Sep 08 09:58:42.237713 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:42.237641    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 08 09:58:42.296802 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:42.296714    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e35db162-1476-43d4-a08f-b95ca644a417-config-volume\") pod \"dns-default-w56bl\" (UID: \"e35db162-1476-43d4-a08f-b95ca644a417\") " pod="openshift-dns/dns-default-w56bl"
Sep 08 09:58:42.296802 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:42.296751    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e35db162-1476-43d4-a08f-b95ca644a417-metrics-tls\") pod \"dns-default-w56bl\" (UID: \"e35db162-1476-43d4-a08f-b95ca644a417\") " pod="openshift-dns/dns-default-w56bl"
Sep 08 09:58:42.296802 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:42.296786    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nz4wz\" (UniqueName: \"kubernetes.io/projected/e35db162-1476-43d4-a08f-b95ca644a417-kube-api-access-nz4wz\") pod \"dns-default-w56bl\" (UID: \"e35db162-1476-43d4-a08f-b95ca644a417\") " pod="openshift-dns/dns-default-w56bl"
Sep 08 09:58:42.297100 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:42.296842    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e35db162-1476-43d4-a08f-b95ca644a417-tmp-dir\") pod \"dns-default-w56bl\" (UID: \"e35db162-1476-43d4-a08f-b95ca644a417\") " pod="openshift-dns/dns-default-w56bl"
Sep 08 09:58:42.371434 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:42.371400    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 09:58:42.397319 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:42.397288    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e35db162-1476-43d4-a08f-b95ca644a417-config-volume\") pod \"dns-default-w56bl\" (UID: \"e35db162-1476-43d4-a08f-b95ca644a417\") " pod="openshift-dns/dns-default-w56bl"
Sep 08 09:58:42.397484 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:42.397328    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/21f0eabe-633e-42f3-8d52-409164a38bc1-cert\") pod \"ingress-canary-cn8g6\" (UID: \"21f0eabe-633e-42f3-8d52-409164a38bc1\") " pod="openshift-ingress-canary/ingress-canary-cn8g6"
Sep 08 09:58:42.397484 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:42.397353    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e35db162-1476-43d4-a08f-b95ca644a417-metrics-tls\") pod \"dns-default-w56bl\" (UID: \"e35db162-1476-43d4-a08f-b95ca644a417\") " pod="openshift-dns/dns-default-w56bl"
Sep 08 09:58:42.397484 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:42.397429    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zlbv\" (UniqueName: \"kubernetes.io/projected/21f0eabe-633e-42f3-8d52-409164a38bc1-kube-api-access-2zlbv\") pod \"ingress-canary-cn8g6\" (UID: \"21f0eabe-633e-42f3-8d52-409164a38bc1\") " pod="openshift-ingress-canary/ingress-canary-cn8g6"
Sep 08 09:58:42.397484 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:42.397469    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 09:58:42.397714 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:42.397482    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nz4wz\" (UniqueName: \"kubernetes.io/projected/e35db162-1476-43d4-a08f-b95ca644a417-kube-api-access-nz4wz\") pod \"dns-default-w56bl\" (UID: \"e35db162-1476-43d4-a08f-b95ca644a417\") " pod="openshift-dns/dns-default-w56bl"
Sep 08 09:58:42.397714 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:42.397525    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e35db162-1476-43d4-a08f-b95ca644a417-metrics-tls podName:e35db162-1476-43d4-a08f-b95ca644a417 nodeName:}" failed. No retries permitted until 2026-09-08 09:58:42.897505749 +0000 UTC m=+36.593104629 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e35db162-1476-43d4-a08f-b95ca644a417-metrics-tls") pod "dns-default-w56bl" (UID: "e35db162-1476-43d4-a08f-b95ca644a417") : secret "dns-default-metrics-tls" not found
Sep 08 09:58:42.397714 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:42.397693    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e35db162-1476-43d4-a08f-b95ca644a417-tmp-dir\") pod \"dns-default-w56bl\" (UID: \"e35db162-1476-43d4-a08f-b95ca644a417\") " pod="openshift-dns/dns-default-w56bl"
Sep 08 09:58:42.397902 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:42.397881    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e35db162-1476-43d4-a08f-b95ca644a417-tmp-dir\") pod \"dns-default-w56bl\" (UID: \"e35db162-1476-43d4-a08f-b95ca644a417\") " pod="openshift-dns/dns-default-w56bl"
Sep 08 09:58:42.397957 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:42.397903    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e35db162-1476-43d4-a08f-b95ca644a417-config-volume\") pod \"dns-default-w56bl\" (UID: \"e35db162-1476-43d4-a08f-b95ca644a417\") " pod="openshift-dns/dns-default-w56bl"
Sep 08 09:58:42.410923 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:42.410901    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nz4wz\" (UniqueName: \"kubernetes.io/projected/e35db162-1476-43d4-a08f-b95ca644a417-kube-api-access-nz4wz\") pod \"dns-default-w56bl\" (UID: \"e35db162-1476-43d4-a08f-b95ca644a417\") " pod="openshift-dns/dns-default-w56bl"
Sep 08 09:58:42.498950 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:42.498919    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/21f0eabe-633e-42f3-8d52-409164a38bc1-cert\") pod \"ingress-canary-cn8g6\" (UID: \"21f0eabe-633e-42f3-8d52-409164a38bc1\") " pod="openshift-ingress-canary/ingress-canary-cn8g6"
Sep 08 09:58:42.499087 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:42.498982    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zlbv\" (UniqueName: \"kubernetes.io/projected/21f0eabe-633e-42f3-8d52-409164a38bc1-kube-api-access-2zlbv\") pod \"ingress-canary-cn8g6\" (UID: \"21f0eabe-633e-42f3-8d52-409164a38bc1\") " pod="openshift-ingress-canary/ingress-canary-cn8g6"
Sep 08 09:58:42.501704 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:42.501679    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/21f0eabe-633e-42f3-8d52-409164a38bc1-cert\") pod \"ingress-canary-cn8g6\" (UID: \"21f0eabe-633e-42f3-8d52-409164a38bc1\") " pod="openshift-ingress-canary/ingress-canary-cn8g6"
Sep 08 09:58:42.508495 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:42.508471    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zlbv\" (UniqueName: \"kubernetes.io/projected/21f0eabe-633e-42f3-8d52-409164a38bc1-kube-api-access-2zlbv\") pod \"ingress-canary-cn8g6\" (UID: \"21f0eabe-633e-42f3-8d52-409164a38bc1\") " pod="openshift-ingress-canary/ingress-canary-cn8g6"
Sep 08 09:58:42.544406 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:42.544379    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cn8g6"
Sep 08 09:58:42.869394 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:42.869167    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cn8g6"]
Sep 08 09:58:42.901603 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:42.901580    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e35db162-1476-43d4-a08f-b95ca644a417-metrics-tls\") pod \"dns-default-w56bl\" (UID: \"e35db162-1476-43d4-a08f-b95ca644a417\") " pod="openshift-dns/dns-default-w56bl"
Sep 08 09:58:42.901747 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:42.901700    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 09:58:42.901807 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:42.901765    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e35db162-1476-43d4-a08f-b95ca644a417-metrics-tls podName:e35db162-1476-43d4-a08f-b95ca644a417 nodeName:}" failed. No retries permitted until 2026-09-08 09:58:43.90174322 +0000 UTC m=+37.597342110 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e35db162-1476-43d4-a08f-b95ca644a417-metrics-tls") pod "dns-default-w56bl" (UID: "e35db162-1476-43d4-a08f-b95ca644a417") : secret "dns-default-metrics-tls" not found
Sep 08 09:58:43.259813 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:43.259713    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 09:58:43.826824 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:43.826793    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8lnsn"
Sep 08 09:58:43.826983 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:43.826801    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b5m55"
Sep 08 09:58:43.830018 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:43.826793    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j4t5c"
Sep 08 09:58:43.831456 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:43.831433    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 08 09:58:43.831581 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:43.831563    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 08 09:58:43.831640 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:43.831442    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 08 09:58:43.831742 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:43.831660    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-76gfh\""
Sep 08 09:58:43.831742 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:43.831669    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nwsv5\""
Sep 08 09:58:43.831855 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:43.831840    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 08 09:58:43.898370 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:43.898334    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 09:58:43.909702 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:43.909675    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e35db162-1476-43d4-a08f-b95ca644a417-metrics-tls\") pod \"dns-default-w56bl\" (UID: \"e35db162-1476-43d4-a08f-b95ca644a417\") " pod="openshift-dns/dns-default-w56bl"
Sep 08 09:58:43.909813 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:43.909793    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 09:58:43.909866 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:43.909860    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e35db162-1476-43d4-a08f-b95ca644a417-metrics-tls podName:e35db162-1476-43d4-a08f-b95ca644a417 nodeName:}" failed. No retries permitted until 2026-09-08 09:58:45.909841901 +0000 UTC m=+39.605440786 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e35db162-1476-43d4-a08f-b95ca644a417-metrics-tls") pod "dns-default-w56bl" (UID: "e35db162-1476-43d4-a08f-b95ca644a417") : secret "dns-default-metrics-tls" not found
Sep 08 09:58:44.364036 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:58:44.364005    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21f0eabe_633e_42f3_8d52_409164a38bc1.slice/crio-6c942fa4ad2dc3754ea915fbcd44721a2ce19069ea939dc5ec51246934db264d WatchSource:0}: Error finding container 6c942fa4ad2dc3754ea915fbcd44721a2ce19069ea939dc5ec51246934db264d: Status 404 returned error can't find the container with id 6c942fa4ad2dc3754ea915fbcd44721a2ce19069ea939dc5ec51246934db264d
Sep 08 09:58:44.989921 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:44.989850    2579 generic.go:356] "Generic (PLEG): container finished" podID="1425c284-4dee-4ed4-a65f-8c1dc7283c8f" containerID="4f108d4188a71d8e1c3da5a3baec2ebe590795efb8d277f7e04a5a2a3ea28228" exitCode=0
Sep 08 09:58:44.990468 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:44.989936    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dcfdx" event={"ID":"1425c284-4dee-4ed4-a65f-8c1dc7283c8f","Type":"ContainerDied","Data":"4f108d4188a71d8e1c3da5a3baec2ebe590795efb8d277f7e04a5a2a3ea28228"}
Sep 08 09:58:44.991041 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:44.991012    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cn8g6" event={"ID":"21f0eabe-633e-42f3-8d52-409164a38bc1","Type":"ContainerStarted","Data":"6c942fa4ad2dc3754ea915fbcd44721a2ce19069ea939dc5ec51246934db264d"}
Sep 08 09:58:45.763263 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:45.763227    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 09:58:45.874372 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:45.874331    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 09:58:45.923291 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:45.923260    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e35db162-1476-43d4-a08f-b95ca644a417-metrics-tls\") pod \"dns-default-w56bl\" (UID: \"e35db162-1476-43d4-a08f-b95ca644a417\") " pod="openshift-dns/dns-default-w56bl"
Sep 08 09:58:45.923429 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:45.923387    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 09:58:45.923467 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:45.923442    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e35db162-1476-43d4-a08f-b95ca644a417-metrics-tls podName:e35db162-1476-43d4-a08f-b95ca644a417 nodeName:}" failed. No retries permitted until 2026-09-08 09:58:49.923428019 +0000 UTC m=+43.619026897 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e35db162-1476-43d4-a08f-b95ca644a417-metrics-tls") pod "dns-default-w56bl" (UID: "e35db162-1476-43d4-a08f-b95ca644a417") : secret "dns-default-metrics-tls" not found
Sep 08 09:58:45.996702 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:45.996670    2579 generic.go:356] "Generic (PLEG): container finished" podID="1425c284-4dee-4ed4-a65f-8c1dc7283c8f" containerID="97d32785a83d23693c216b85840d345e39af6e3fb0a64c0bb6e64caabad4b64e" exitCode=0
Sep 08 09:58:45.997143 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:45.996734    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dcfdx" event={"ID":"1425c284-4dee-4ed4-a65f-8c1dc7283c8f","Type":"ContainerDied","Data":"97d32785a83d23693c216b85840d345e39af6e3fb0a64c0bb6e64caabad4b64e"}
Sep 08 09:58:47.004144 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:47.004102    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dcfdx" event={"ID":"1425c284-4dee-4ed4-a65f-8c1dc7283c8f","Type":"ContainerStarted","Data":"332e0f76591f971753694cea8c0e1832f07f8734dddca8fc80c9249d2f27ab6c"}
Sep 08 09:58:47.032205 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:47.031834    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dcfdx" podStartSLOduration=6.8987533580000004 podStartE2EDuration="40.031813743s" totalImagesPullingTime="33.133060385s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 09:58:07 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 09:58:47.029804128 +0000 UTC m=+40.725403028" watchObservedRunningTime="2026-09-08 09:58:47.031813743 +0000 UTC m=+40.727412646"
Sep 08 09:58:47.161972 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:47.161872    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 09:58:47.259203 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:47.259117    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 09:58:49.010862 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:49.010834    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cn8g6" event={"ID":"21f0eabe-633e-42f3-8d52-409164a38bc1","Type":"ContainerStarted","Data":"4bbd1f08a5d0364853cd842c35eb8a1cf4b2bace3977cc04dd39099c0174d5d6"}
Sep 08 09:58:49.028091 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:49.028040    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-cn8g6" podStartSLOduration=2.608394675 podStartE2EDuration="7.028023537s" totalImagesPullingTime="4.419628862s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 09:58:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 09:58:49.026670359 +0000 UTC m=+42.722269258" watchObservedRunningTime="2026-09-08 09:58:49.028023537 +0000 UTC m=+42.723622436"
Sep 08 09:58:49.479325 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:49.479293    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 09:58:49.544756 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:49.544724    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 09:58:49.950199 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:49.950161    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e35db162-1476-43d4-a08f-b95ca644a417-metrics-tls\") pod \"dns-default-w56bl\" (UID: \"e35db162-1476-43d4-a08f-b95ca644a417\") " pod="openshift-dns/dns-default-w56bl"
Sep 08 09:58:49.950360 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:49.950274    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 09:58:49.950360 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:49.950326    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e35db162-1476-43d4-a08f-b95ca644a417-metrics-tls podName:e35db162-1476-43d4-a08f-b95ca644a417 nodeName:}" failed. No retries permitted until 2026-09-08 09:58:57.950310567 +0000 UTC m=+51.645909446 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e35db162-1476-43d4-a08f-b95ca644a417-metrics-tls") pod "dns-default-w56bl" (UID: "e35db162-1476-43d4-a08f-b95ca644a417") : secret "dns-default-metrics-tls" not found
Sep 08 09:58:51.317497 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:51.317459    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 09:58:51.382356 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:51.382322    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 09:58:52.431936 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:52.431902    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 09:58:52.510111 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:52.510079    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 09:58:58.002923 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:58:58.002885    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e35db162-1476-43d4-a08f-b95ca644a417-metrics-tls\") pod \"dns-default-w56bl\" (UID: \"e35db162-1476-43d4-a08f-b95ca644a417\") " pod="openshift-dns/dns-default-w56bl"
Sep 08 09:58:58.003474 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:58.003023    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 09:58:58.003474 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:58:58.003099    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e35db162-1476-43d4-a08f-b95ca644a417-metrics-tls podName:e35db162-1476-43d4-a08f-b95ca644a417 nodeName:}" failed. No retries permitted until 2026-09-08 09:59:14.003079106 +0000 UTC m=+67.698677987 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e35db162-1476-43d4-a08f-b95ca644a417-metrics-tls") pod "dns-default-w56bl" (UID: "e35db162-1476-43d4-a08f-b95ca644a417") : secret "dns-default-metrics-tls" not found
Sep 08 09:59:07.979868 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:59:07.979834    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-kz86g"
Sep 08 09:59:08.135652 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:59:08.135613    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 09:59:08.451440 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:59:08.451411    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 09:59:10.757486 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:59:10.757442    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 09:59:10.839288 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:59:10.839244    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 09:59:12.602130 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:59:12.602086    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ce5d383-ffe7-47c5-8960-4553f5dfd4c4-original-pull-secret\") pod \"global-pull-secret-syncer-j4t5c\" (UID: \"3ce5d383-ffe7-47c5-8960-4553f5dfd4c4\") " pod="kube-system/global-pull-secret-syncer-j4t5c"
Sep 08 09:59:12.602130 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:59:12.602141    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3868a1c3-46c6-4940-92ed-e460b77d7cfc-metrics-certs\") pod \"network-metrics-daemon-b5m55\" (UID: \"3868a1c3-46c6-4940-92ed-e460b77d7cfc\") " pod="openshift-multus/network-metrics-daemon-b5m55"
Sep 08 09:59:12.606113 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:59:12.606096    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 08 09:59:12.606113 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:59:12.606112    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 08 09:59:12.613229 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:59:12.613210    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 08 09:59:12.613285 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:59:12.613277    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3868a1c3-46c6-4940-92ed-e460b77d7cfc-metrics-certs podName:3868a1c3-46c6-4940-92ed-e460b77d7cfc nodeName:}" failed. No retries permitted until 2026-09-08 10:00:16.613261637 +0000 UTC m=+130.308860516 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3868a1c3-46c6-4940-92ed-e460b77d7cfc-metrics-certs") pod "network-metrics-daemon-b5m55" (UID: "3868a1c3-46c6-4940-92ed-e460b77d7cfc") : secret "metrics-daemon-secret" not found
Sep 08 09:59:12.616403 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:59:12.616380    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3ce5d383-ffe7-47c5-8960-4553f5dfd4c4-original-pull-secret\") pod \"global-pull-secret-syncer-j4t5c\" (UID: \"3ce5d383-ffe7-47c5-8960-4553f5dfd4c4\") " pod="kube-system/global-pull-secret-syncer-j4t5c"
Sep 08 09:59:12.653908 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:59:12.653882    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-j4t5c"
Sep 08 09:59:12.703904 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:59:12.703879    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzfrc\" (UniqueName: \"kubernetes.io/projected/6829ca1d-d62e-446a-a557-43217aba9a6f-kube-api-access-xzfrc\") pod \"network-check-target-8lnsn\" (UID: \"6829ca1d-d62e-446a-a557-43217aba9a6f\") " pod="openshift-network-diagnostics/network-check-target-8lnsn"
Sep 08 09:59:12.706911 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:59:12.706887    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 08 09:59:12.716993 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:59:12.716969    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 08 09:59:12.726777 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:59:12.726752    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzfrc\" (UniqueName: \"kubernetes.io/projected/6829ca1d-d62e-446a-a557-43217aba9a6f-kube-api-access-xzfrc\") pod \"network-check-target-8lnsn\" (UID: \"6829ca1d-d62e-446a-a557-43217aba9a6f\") " pod="openshift-network-diagnostics/network-check-target-8lnsn"
Sep 08 09:59:12.924492 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:59:12.924288    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-j4t5c"]
Sep 08 09:59:12.926989 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:59:12.926963    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ce5d383_ffe7_47c5_8960_4553f5dfd4c4.slice/crio-4934fa77c1d1fcfa88a95329482a31b720a42e96692488920610e9e4a9c8a95b WatchSource:0}: Error finding container 4934fa77c1d1fcfa88a95329482a31b720a42e96692488920610e9e4a9c8a95b: Status 404 returned error can't find the container with id 4934fa77c1d1fcfa88a95329482a31b720a42e96692488920610e9e4a9c8a95b
Sep 08 09:59:12.943739 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:59:12.943718    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-76gfh\""
Sep 08 09:59:12.951198 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:59:12.951181    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8lnsn"
Sep 08 09:59:13.073410 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:59:13.073376    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-j4t5c" event={"ID":"3ce5d383-ffe7-47c5-8960-4553f5dfd4c4","Type":"ContainerStarted","Data":"4934fa77c1d1fcfa88a95329482a31b720a42e96692488920610e9e4a9c8a95b"}
Sep 08 09:59:13.218359 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:59:13.218290    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8lnsn"]
Sep 08 09:59:13.221346 ip-10-0-132-96 kubenswrapper[2579]: W0908 09:59:13.221316    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6829ca1d_d62e_446a_a557_43217aba9a6f.slice/crio-84ce0de13d350db51a2517ee0f3f326a252714f2832384dfb5c35bddf569d05b WatchSource:0}: Error finding container 84ce0de13d350db51a2517ee0f3f326a252714f2832384dfb5c35bddf569d05b: Status 404 returned error can't find the container with id 84ce0de13d350db51a2517ee0f3f326a252714f2832384dfb5c35bddf569d05b
Sep 08 09:59:14.013102 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:59:14.013067    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e35db162-1476-43d4-a08f-b95ca644a417-metrics-tls\") pod \"dns-default-w56bl\" (UID: \"e35db162-1476-43d4-a08f-b95ca644a417\") " pod="openshift-dns/dns-default-w56bl"
Sep 08 09:59:14.013495 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:59:14.013217    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 09:59:14.013495 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:59:14.013291    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e35db162-1476-43d4-a08f-b95ca644a417-metrics-tls podName:e35db162-1476-43d4-a08f-b95ca644a417 nodeName:}" failed. No retries permitted until 2026-09-08 09:59:46.013270621 +0000 UTC m=+99.708869503 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e35db162-1476-43d4-a08f-b95ca644a417-metrics-tls") pod "dns-default-w56bl" (UID: "e35db162-1476-43d4-a08f-b95ca644a417") : secret "dns-default-metrics-tls" not found
Sep 08 09:59:14.080523 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:59:14.077769    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8lnsn" event={"ID":"6829ca1d-d62e-446a-a557-43217aba9a6f","Type":"ContainerStarted","Data":"84ce0de13d350db51a2517ee0f3f326a252714f2832384dfb5c35bddf569d05b"}
Sep 08 09:59:19.092057 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:59:19.092021    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8lnsn" event={"ID":"6829ca1d-d62e-446a-a557-43217aba9a6f","Type":"ContainerStarted","Data":"5e936484eeb613ec2d25fa33cd3cdfd8118c407de538d31a1eb8848da1c86b48"}
Sep 08 09:59:19.092602 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:59:19.092145    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8lnsn"
Sep 08 09:59:19.093368 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:59:19.093343    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-j4t5c" event={"ID":"3ce5d383-ffe7-47c5-8960-4553f5dfd4c4","Type":"ContainerStarted","Data":"79f5fe0b56a00f7206eab12935c49f4cf5e5284d26f6888709d9ca18a4a70d28"}
Sep 08 09:59:19.113885 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:59:19.113825    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8lnsn" podStartSLOduration=66.97678375 podStartE2EDuration="1m12.113804014s" totalImagesPullingTime="5.137020264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 09:58:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 09:59:19.11249263 +0000 UTC m=+72.808091531" watchObservedRunningTime="2026-09-08 09:59:19.113804014 +0000 UTC m=+72.809402915"
Sep 08 09:59:38.715789 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:59:38.715665    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 09:59:38.775451 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:59:38.775415    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 09:59:46.013494 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:59:46.013463    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e35db162-1476-43d4-a08f-b95ca644a417-metrics-tls\") pod \"dns-default-w56bl\" (UID: \"e35db162-1476-43d4-a08f-b95ca644a417\") " pod="openshift-dns/dns-default-w56bl"
Sep 08 09:59:46.013902 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:59:46.013628    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 09:59:46.013902 ip-10-0-132-96 kubenswrapper[2579]: E0908 09:59:46.013700    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e35db162-1476-43d4-a08f-b95ca644a417-metrics-tls podName:e35db162-1476-43d4-a08f-b95ca644a417 nodeName:}" failed. No retries permitted until 2026-09-08 10:00:50.013683018 +0000 UTC m=+163.709281896 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e35db162-1476-43d4-a08f-b95ca644a417-metrics-tls") pod "dns-default-w56bl" (UID: "e35db162-1476-43d4-a08f-b95ca644a417") : secret "dns-default-metrics-tls" not found
Sep 08 09:59:50.098108 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:59:50.098074    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8lnsn"
Sep 08 09:59:50.115181 ip-10-0-132-96 kubenswrapper[2579]: I0908 09:59:50.115130    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-j4t5c" podStartSLOduration=97.69214659 podStartE2EDuration="1m43.115117552s" totalImagesPullingTime="5.422970962s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 09:58:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 09:59:19.128759677 +0000 UTC m=+72.824358577" watchObservedRunningTime="2026-09-08 09:59:50.115117552 +0000 UTC m=+103.810716479"
Sep 08 10:00:16.713496 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:00:16.713451    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3868a1c3-46c6-4940-92ed-e460b77d7cfc-metrics-certs\") pod \"network-metrics-daemon-b5m55\" (UID: \"3868a1c3-46c6-4940-92ed-e460b77d7cfc\") " pod="openshift-multus/network-metrics-daemon-b5m55"
Sep 08 10:00:16.713912 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:00:16.713621    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 08 10:00:16.713912 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:00:16.713688    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3868a1c3-46c6-4940-92ed-e460b77d7cfc-metrics-certs podName:3868a1c3-46c6-4940-92ed-e460b77d7cfc nodeName:}" failed. No retries permitted until 2026-09-08 10:02:18.71367133 +0000 UTC m=+252.409270207 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3868a1c3-46c6-4940-92ed-e460b77d7cfc-metrics-certs") pod "network-metrics-daemon-b5m55" (UID: "3868a1c3-46c6-4940-92ed-e460b77d7cfc") : secret "metrics-daemon-secret" not found
Sep 08 10:00:45.219150 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:00:45.219110    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-w56bl" podUID="e35db162-1476-43d4-a08f-b95ca644a417"
Sep 08 10:00:45.300227 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:00:45.300207    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w56bl"
Sep 08 10:00:46.847576 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:00:46.847531    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-b5m55" podUID="3868a1c3-46c6-4940-92ed-e460b77d7cfc"
Sep 08 10:00:50.025400 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:00:50.025361    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e35db162-1476-43d4-a08f-b95ca644a417-metrics-tls\") pod \"dns-default-w56bl\" (UID: \"e35db162-1476-43d4-a08f-b95ca644a417\") " pod="openshift-dns/dns-default-w56bl"
Sep 08 10:00:50.025788 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:00:50.025464    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 10:00:50.025788 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:00:50.025512    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e35db162-1476-43d4-a08f-b95ca644a417-metrics-tls podName:e35db162-1476-43d4-a08f-b95ca644a417 nodeName:}" failed. No retries permitted until 2026-09-08 10:02:52.025499599 +0000 UTC m=+285.721098477 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e35db162-1476-43d4-a08f-b95ca644a417-metrics-tls") pod "dns-default-w56bl" (UID: "e35db162-1476-43d4-a08f-b95ca644a417") : secret "dns-default-metrics-tls" not found
Sep 08 10:01:00.826785 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:01:00.826700    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b5m55"
Sep 08 10:01:02.724068 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:01:02.724024    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:02:10.896352 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:10.896318    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-dxh7f"]
Sep 08 10:02:10.899176 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:10.899154    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-dxh7f"
Sep 08 10:02:10.913755 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:02:10.913729    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-132-96.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-service-ca-operator\": no relationship found between node 'ip-10-0-132-96.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Sep 08 10:02:10.913755 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:02:10.913739    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"serving-cert\" is forbidden: User \"system:node:ip-10-0-132-96.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-service-ca-operator\": no relationship found between node 'ip-10-0-132-96.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" type="*v1.Secret"
Sep 08 10:02:10.913970 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:02:10.913739    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"service-ca-operator-config\" is forbidden: User \"system:node:ip-10-0-132-96.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-service-ca-operator\": no relationship found between node 'ip-10-0-132-96.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" type="*v1.ConfigMap"
Sep 08 10:02:10.913970 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:02:10.913728    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"service-ca-operator-859f94c4b-dxh7f\" is forbidden: User \"system:node:ip-10-0-132-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-service-ca-operator\": no relationship found between node 'ip-10-0-132-96.ec2.internal' and this object" podUID="e9472cec-3760-4eca-9c6f-7f0e449c1445" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-dxh7f"
Sep 08 10:02:10.914185 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:02:10.914163    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"service-ca-operator-dockercfg-pgs9d\" is forbidden: User \"system:node:ip-10-0-132-96.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-service-ca-operator\": no relationship found between node 'ip-10-0-132-96.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-pgs9d\"" type="*v1.Secret"
Sep 08 10:02:10.914391 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:02:10.914375    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-132-96.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-service-ca-operator\": no relationship found between node 'ip-10-0-132-96.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Sep 08 10:02:10.936344 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:10.936323    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-dxh7f"]
Sep 08 10:02:10.956247 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:10.956222    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nf99n"]
Sep 08 10:02:10.959073 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:10.959056    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-648dc86df7-dxl7n"]
Sep 08 10:02:10.959199 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:10.959181    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nf99n"
Sep 08 10:02:10.962020 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:10.962001    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-648dc86df7-dxl7n"
Sep 08 10:02:10.962415 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:10.962399    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-9s2pl\""
Sep 08 10:02:10.962477 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:10.962464    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 08 10:02:10.962681 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:10.962659    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 08 10:02:10.962967 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:10.962952    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 08 10:02:10.964983 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:10.964966    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 08 10:02:10.965226 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:10.965208    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 08 10:02:10.966208 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:10.966105    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-chqf2\""
Sep 08 10:02:10.973407 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:10.973389    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 08 10:02:10.974161 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:10.974143    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nf99n"]
Sep 08 10:02:10.987736 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:10.987714    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 08 10:02:11.011671 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.011453    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-648dc86df7-dxl7n"]
Sep 08 10:02:11.034474 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.034447    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wdqrw"]
Sep 08 10:02:11.037183 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.037168    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wdqrw"
Sep 08 10:02:11.041773 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.041746    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-4mk47\""
Sep 08 10:02:11.041773 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.041761    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 08 10:02:11.042631 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.042613    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 08 10:02:11.045449 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.045433    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 08 10:02:11.045678 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.045666    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 08 10:02:11.058906 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.058890    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-registry-tls\") pod \"image-registry-648dc86df7-dxl7n\" (UID: \"e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8\") " pod="openshift-image-registry/image-registry-648dc86df7-dxl7n"
Sep 08 10:02:11.058995 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.058912    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-ca-trust-extracted\") pod \"image-registry-648dc86df7-dxl7n\" (UID: \"e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8\") " pod="openshift-image-registry/image-registry-648dc86df7-dxl7n"
Sep 08 10:02:11.058995 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.058931    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-installation-pull-secrets\") pod \"image-registry-648dc86df7-dxl7n\" (UID: \"e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8\") " pod="openshift-image-registry/image-registry-648dc86df7-dxl7n"
Sep 08 10:02:11.058995 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.058950    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-bound-sa-token\") pod \"image-registry-648dc86df7-dxl7n\" (UID: \"e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8\") " pod="openshift-image-registry/image-registry-648dc86df7-dxl7n"
Sep 08 10:02:11.058995 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.058968    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9xdl\" (UniqueName: \"kubernetes.io/projected/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-kube-api-access-s9xdl\") pod \"image-registry-648dc86df7-dxl7n\" (UID: \"e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8\") " pod="openshift-image-registry/image-registry-648dc86df7-dxl7n"
Sep 08 10:02:11.059154 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.059057    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e9472cec-3760-4eca-9c6f-7f0e449c1445-config\") pod \"service-ca-operator-859f94c4b-dxh7f\" (UID: \"e9472cec-3760-4eca-9c6f-7f0e449c1445\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-dxh7f"
Sep 08 10:02:11.059154 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.059082    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e9472cec-3760-4eca-9c6f-7f0e449c1445-serving-cert\") pod \"service-ca-operator-859f94c4b-dxh7f\" (UID: \"e9472cec-3760-4eca-9c6f-7f0e449c1445\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-dxh7f"
Sep 08 10:02:11.059154 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.059106    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2j4n\" (UniqueName: \"kubernetes.io/projected/e9472cec-3760-4eca-9c6f-7f0e449c1445-kube-api-access-x2j4n\") pod \"service-ca-operator-859f94c4b-dxh7f\" (UID: \"e9472cec-3760-4eca-9c6f-7f0e449c1445\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-dxh7f"
Sep 08 10:02:11.059154 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.059126    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5lgk\" (UniqueName: \"kubernetes.io/projected/d816c15e-c5d3-4149-a6da-3288c3d632e4-kube-api-access-s5lgk\") pod \"cluster-samples-operator-7cdcfcf76c-nf99n\" (UID: \"d816c15e-c5d3-4149-a6da-3288c3d632e4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nf99n"
Sep 08 10:02:11.059154 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.059145    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d816c15e-c5d3-4149-a6da-3288c3d632e4-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-nf99n\" (UID: \"d816c15e-c5d3-4149-a6da-3288c3d632e4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nf99n"
Sep 08 10:02:11.059366 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.059160    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-registry-certificates\") pod \"image-registry-648dc86df7-dxl7n\" (UID: \"e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8\") " pod="openshift-image-registry/image-registry-648dc86df7-dxl7n"
Sep 08 10:02:11.059366 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.059173    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-trusted-ca\") pod \"image-registry-648dc86df7-dxl7n\" (UID: \"e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8\") " pod="openshift-image-registry/image-registry-648dc86df7-dxl7n"
Sep 08 10:02:11.059366 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.059200    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-image-registry-private-configuration\") pod \"image-registry-648dc86df7-dxl7n\" (UID: \"e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8\") " pod="openshift-image-registry/image-registry-648dc86df7-dxl7n"
Sep 08 10:02:11.060959 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.060929    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wdqrw"]
Sep 08 10:02:11.159569 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.159461    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-image-registry-private-configuration\") pod \"image-registry-648dc86df7-dxl7n\" (UID: \"e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8\") " pod="openshift-image-registry/image-registry-648dc86df7-dxl7n"
Sep 08 10:02:11.159569 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.159506    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e4d77eca-04c2-456f-b337-e33b3d1981aa-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-wdqrw\" (UID: \"e4d77eca-04c2-456f-b337-e33b3d1981aa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wdqrw"
Sep 08 10:02:11.159569 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.159524    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4d77eca-04c2-456f-b337-e33b3d1981aa-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-wdqrw\" (UID: \"e4d77eca-04c2-456f-b337-e33b3d1981aa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wdqrw"
Sep 08 10:02:11.159824 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.159634    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgbpf\" (UniqueName: \"kubernetes.io/projected/e4d77eca-04c2-456f-b337-e33b3d1981aa-kube-api-access-kgbpf\") pod \"kube-storage-version-migrator-operator-8d7dd4675-wdqrw\" (UID: \"e4d77eca-04c2-456f-b337-e33b3d1981aa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wdqrw"
Sep 08 10:02:11.159824 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.159677    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-registry-tls\") pod \"image-registry-648dc86df7-dxl7n\" (UID: \"e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8\") " pod="openshift-image-registry/image-registry-648dc86df7-dxl7n"
Sep 08 10:02:11.159824 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.159691    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-ca-trust-extracted\") pod \"image-registry-648dc86df7-dxl7n\" (UID: \"e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8\") " pod="openshift-image-registry/image-registry-648dc86df7-dxl7n"
Sep 08 10:02:11.159824 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.159707    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-installation-pull-secrets\") pod \"image-registry-648dc86df7-dxl7n\" (UID: \"e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8\") " pod="openshift-image-registry/image-registry-648dc86df7-dxl7n"
Sep 08 10:02:11.159824 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:02:11.159781    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 10:02:11.159824 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:02:11.159799    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-648dc86df7-dxl7n: secret "image-registry-tls" not found
Sep 08 10:02:11.159824 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.159817    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-bound-sa-token\") pod \"image-registry-648dc86df7-dxl7n\" (UID: \"e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8\") " pod="openshift-image-registry/image-registry-648dc86df7-dxl7n"
Sep 08 10:02:11.160153 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.159842    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9xdl\" (UniqueName: \"kubernetes.io/projected/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-kube-api-access-s9xdl\") pod \"image-registry-648dc86df7-dxl7n\" (UID: \"e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8\") " pod="openshift-image-registry/image-registry-648dc86df7-dxl7n"
Sep 08 10:02:11.160153 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:02:11.159857    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-registry-tls podName:e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8 nodeName:}" failed. No retries permitted until 2026-09-08 10:02:11.659842606 +0000 UTC m=+245.355441488 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-registry-tls") pod "image-registry-648dc86df7-dxl7n" (UID: "e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8") : secret "image-registry-tls" not found
Sep 08 10:02:11.160153 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.159901    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e9472cec-3760-4eca-9c6f-7f0e449c1445-config\") pod \"service-ca-operator-859f94c4b-dxh7f\" (UID: \"e9472cec-3760-4eca-9c6f-7f0e449c1445\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-dxh7f"
Sep 08 10:02:11.160153 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.159930    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e9472cec-3760-4eca-9c6f-7f0e449c1445-serving-cert\") pod \"service-ca-operator-859f94c4b-dxh7f\" (UID: \"e9472cec-3760-4eca-9c6f-7f0e449c1445\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-dxh7f"
Sep 08 10:02:11.160153 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.159960    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2j4n\" (UniqueName: \"kubernetes.io/projected/e9472cec-3760-4eca-9c6f-7f0e449c1445-kube-api-access-x2j4n\") pod \"service-ca-operator-859f94c4b-dxh7f\" (UID: \"e9472cec-3760-4eca-9c6f-7f0e449c1445\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-dxh7f"
Sep 08 10:02:11.160153 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.159989    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5lgk\" (UniqueName: \"kubernetes.io/projected/d816c15e-c5d3-4149-a6da-3288c3d632e4-kube-api-access-s5lgk\") pod \"cluster-samples-operator-7cdcfcf76c-nf99n\" (UID: \"d816c15e-c5d3-4149-a6da-3288c3d632e4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nf99n"
Sep 08 10:02:11.160153 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.160000    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-ca-trust-extracted\") pod \"image-registry-648dc86df7-dxl7n\" (UID: \"e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8\") " pod="openshift-image-registry/image-registry-648dc86df7-dxl7n"
Sep 08 10:02:11.160153 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.160016    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d816c15e-c5d3-4149-a6da-3288c3d632e4-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-nf99n\" (UID: \"d816c15e-c5d3-4149-a6da-3288c3d632e4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nf99n"
Sep 08 10:02:11.160153 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.160041    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-registry-certificates\") pod \"image-registry-648dc86df7-dxl7n\" (UID: \"e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8\") " pod="openshift-image-registry/image-registry-648dc86df7-dxl7n"
Sep 08 10:02:11.160153 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.160064    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-trusted-ca\") pod \"image-registry-648dc86df7-dxl7n\" (UID: \"e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8\") " pod="openshift-image-registry/image-registry-648dc86df7-dxl7n"
Sep 08 10:02:11.160153 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:02:11.160144    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 08 10:02:11.160883 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:02:11.160203    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d816c15e-c5d3-4149-a6da-3288c3d632e4-samples-operator-tls podName:d816c15e-c5d3-4149-a6da-3288c3d632e4 nodeName:}" failed. No retries permitted until 2026-09-08 10:02:11.660187768 +0000 UTC m=+245.355786660 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d816c15e-c5d3-4149-a6da-3288c3d632e4-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-nf99n" (UID: "d816c15e-c5d3-4149-a6da-3288c3d632e4") : secret "samples-operator-tls" not found
Sep 08 10:02:11.160883 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.160811    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-trusted-ca\") pod \"image-registry-648dc86df7-dxl7n\" (UID: \"e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8\") " pod="openshift-image-registry/image-registry-648dc86df7-dxl7n"
Sep 08 10:02:11.160883 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.160871    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-registry-certificates\") pod \"image-registry-648dc86df7-dxl7n\" (UID: \"e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8\") " pod="openshift-image-registry/image-registry-648dc86df7-dxl7n"
Sep 08 10:02:11.162164 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.162142    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-installation-pull-secrets\") pod \"image-registry-648dc86df7-dxl7n\" (UID: \"e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8\") " pod="openshift-image-registry/image-registry-648dc86df7-dxl7n"
Sep 08 10:02:11.162254 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.162182    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-image-registry-private-configuration\") pod \"image-registry-648dc86df7-dxl7n\" (UID: \"e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8\") " pod="openshift-image-registry/image-registry-648dc86df7-dxl7n"
Sep 08 10:02:11.171231 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.171213    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-bound-sa-token\") pod \"image-registry-648dc86df7-dxl7n\" (UID: \"e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8\") " pod="openshift-image-registry/image-registry-648dc86df7-dxl7n"
Sep 08 10:02:11.171959 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.171943    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9xdl\" (UniqueName: \"kubernetes.io/projected/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-kube-api-access-s9xdl\") pod \"image-registry-648dc86df7-dxl7n\" (UID: \"e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8\") " pod="openshift-image-registry/image-registry-648dc86df7-dxl7n"
Sep 08 10:02:11.172761 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.172743    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5lgk\" (UniqueName: \"kubernetes.io/projected/d816c15e-c5d3-4149-a6da-3288c3d632e4-kube-api-access-s5lgk\") pod \"cluster-samples-operator-7cdcfcf76c-nf99n\" (UID: \"d816c15e-c5d3-4149-a6da-3288c3d632e4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nf99n"
Sep 08 10:02:11.215695 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.215671    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:02:11.260862 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.260832    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e4d77eca-04c2-456f-b337-e33b3d1981aa-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-wdqrw\" (UID: \"e4d77eca-04c2-456f-b337-e33b3d1981aa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wdqrw"
Sep 08 10:02:11.260928 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.260869    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4d77eca-04c2-456f-b337-e33b3d1981aa-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-wdqrw\" (UID: \"e4d77eca-04c2-456f-b337-e33b3d1981aa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wdqrw"
Sep 08 10:02:11.260928 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.260885    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgbpf\" (UniqueName: \"kubernetes.io/projected/e4d77eca-04c2-456f-b337-e33b3d1981aa-kube-api-access-kgbpf\") pod \"kube-storage-version-migrator-operator-8d7dd4675-wdqrw\" (UID: \"e4d77eca-04c2-456f-b337-e33b3d1981aa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wdqrw"
Sep 08 10:02:11.261322 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.261297    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e4d77eca-04c2-456f-b337-e33b3d1981aa-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-wdqrw\" (UID: \"e4d77eca-04c2-456f-b337-e33b3d1981aa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wdqrw"
Sep 08 10:02:11.263063 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.263041    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e4d77eca-04c2-456f-b337-e33b3d1981aa-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-wdqrw\" (UID: \"e4d77eca-04c2-456f-b337-e33b3d1981aa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wdqrw"
Sep 08 10:02:11.269451 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.269427    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgbpf\" (UniqueName: \"kubernetes.io/projected/e4d77eca-04c2-456f-b337-e33b3d1981aa-kube-api-access-kgbpf\") pod \"kube-storage-version-migrator-operator-8d7dd4675-wdqrw\" (UID: \"e4d77eca-04c2-456f-b337-e33b3d1981aa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wdqrw"
Sep 08 10:02:11.315208 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.315178    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:02:11.345605 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.345583    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wdqrw"
Sep 08 10:02:11.611402 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.611367    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wdqrw"]
Sep 08 10:02:11.615685 ip-10-0-132-96 kubenswrapper[2579]: W0908 10:02:11.615657    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4d77eca_04c2_456f_b337_e33b3d1981aa.slice/crio-89f4c7ee6bf93c978f5b1562bf1306aee0fd0d82026d510595283cc46aad0b49 WatchSource:0}: Error finding container 89f4c7ee6bf93c978f5b1562bf1306aee0fd0d82026d510595283cc46aad0b49: Status 404 returned error can't find the container with id 89f4c7ee6bf93c978f5b1562bf1306aee0fd0d82026d510595283cc46aad0b49
Sep 08 10:02:11.663837 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.663809    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d816c15e-c5d3-4149-a6da-3288c3d632e4-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-nf99n\" (UID: \"d816c15e-c5d3-4149-a6da-3288c3d632e4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nf99n"
Sep 08 10:02:11.663938 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.663871    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-registry-tls\") pod \"image-registry-648dc86df7-dxl7n\" (UID: \"e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8\") " pod="openshift-image-registry/image-registry-648dc86df7-dxl7n"
Sep 08 10:02:11.663979 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:02:11.663954    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 08 10:02:11.664018 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:02:11.664009    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d816c15e-c5d3-4149-a6da-3288c3d632e4-samples-operator-tls podName:d816c15e-c5d3-4149-a6da-3288c3d632e4 nodeName:}" failed. No retries permitted until 2026-09-08 10:02:12.663993371 +0000 UTC m=+246.359592248 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d816c15e-c5d3-4149-a6da-3288c3d632e4-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-nf99n" (UID: "d816c15e-c5d3-4149-a6da-3288c3d632e4") : secret "samples-operator-tls" not found
Sep 08 10:02:11.664070 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:02:11.663955    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 10:02:11.664070 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:02:11.664047    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-648dc86df7-dxl7n: secret "image-registry-tls" not found
Sep 08 10:02:11.664146 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:02:11.664089    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-registry-tls podName:e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8 nodeName:}" failed. No retries permitted until 2026-09-08 10:02:12.664076252 +0000 UTC m=+246.359675130 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-registry-tls") pod "image-registry-648dc86df7-dxl7n" (UID: "e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8") : secret "image-registry-tls" not found
Sep 08 10:02:11.771074 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:11.771044    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 08 10:02:12.135290 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:12.135266    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-pgs9d\""
Sep 08 10:02:12.160861 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:02:12.160838    2579 secret.go:189] Couldn't get secret openshift-service-ca-operator/serving-cert: failed to sync secret cache: timed out waiting for the condition
Sep 08 10:02:12.160978 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:02:12.160895    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e9472cec-3760-4eca-9c6f-7f0e449c1445-serving-cert podName:e9472cec-3760-4eca-9c6f-7f0e449c1445 nodeName:}" failed. No retries permitted until 2026-09-08 10:02:12.660881131 +0000 UTC m=+246.356480009 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "serving-cert" (UniqueName: "kubernetes.io/secret/e9472cec-3760-4eca-9c6f-7f0e449c1445-serving-cert") pod "service-ca-operator-859f94c4b-dxh7f" (UID: "e9472cec-3760-4eca-9c6f-7f0e449c1445") : failed to sync secret cache: timed out waiting for the condition
Sep 08 10:02:12.160978 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:02:12.160837    2579 configmap.go:193] Couldn't get configMap openshift-service-ca-operator/service-ca-operator-config: failed to sync configmap cache: timed out waiting for the condition
Sep 08 10:02:12.161059 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:02:12.160989    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e9472cec-3760-4eca-9c6f-7f0e449c1445-config podName:e9472cec-3760-4eca-9c6f-7f0e449c1445 nodeName:}" failed. No retries permitted until 2026-09-08 10:02:12.660975048 +0000 UTC m=+246.356573926 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "config" (UniqueName: "kubernetes.io/configmap/e9472cec-3760-4eca-9c6f-7f0e449c1445-config") pod "service-ca-operator-859f94c4b-dxh7f" (UID: "e9472cec-3760-4eca-9c6f-7f0e449c1445") : failed to sync configmap cache: timed out waiting for the condition
Sep 08 10:02:12.263618 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:12.263585    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 08 10:02:12.403880 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:12.403815    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 08 10:02:12.413450 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:12.413419    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2j4n\" (UniqueName: \"kubernetes.io/projected/e9472cec-3760-4eca-9c6f-7f0e449c1445-kube-api-access-x2j4n\") pod \"service-ca-operator-859f94c4b-dxh7f\" (UID: \"e9472cec-3760-4eca-9c6f-7f0e449c1445\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-dxh7f"
Sep 08 10:02:12.462149 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:12.462126    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 08 10:02:12.506424 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:12.506397    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wdqrw" event={"ID":"e4d77eca-04c2-456f-b337-e33b3d1981aa","Type":"ContainerStarted","Data":"89f4c7ee6bf93c978f5b1562bf1306aee0fd0d82026d510595283cc46aad0b49"}
Sep 08 10:02:12.672310 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:12.672253    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-registry-tls\") pod \"image-registry-648dc86df7-dxl7n\" (UID: \"e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8\") " pod="openshift-image-registry/image-registry-648dc86df7-dxl7n"
Sep 08 10:02:12.672310 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:12.672289    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e9472cec-3760-4eca-9c6f-7f0e449c1445-config\") pod \"service-ca-operator-859f94c4b-dxh7f\" (UID: \"e9472cec-3760-4eca-9c6f-7f0e449c1445\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-dxh7f"
Sep 08 10:02:12.672310 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:12.672307    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e9472cec-3760-4eca-9c6f-7f0e449c1445-serving-cert\") pod \"service-ca-operator-859f94c4b-dxh7f\" (UID: \"e9472cec-3760-4eca-9c6f-7f0e449c1445\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-dxh7f"
Sep 08 10:02:12.672491 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:12.672339    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d816c15e-c5d3-4149-a6da-3288c3d632e4-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-nf99n\" (UID: \"d816c15e-c5d3-4149-a6da-3288c3d632e4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nf99n"
Sep 08 10:02:12.672491 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:02:12.672391    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 10:02:12.672491 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:02:12.672407    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-648dc86df7-dxl7n: secret "image-registry-tls" not found
Sep 08 10:02:12.672491 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:02:12.672437    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 08 10:02:12.672491 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:02:12.672466    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-registry-tls podName:e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8 nodeName:}" failed. No retries permitted until 2026-09-08 10:02:14.672451232 +0000 UTC m=+248.368050110 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-registry-tls") pod "image-registry-648dc86df7-dxl7n" (UID: "e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8") : secret "image-registry-tls" not found
Sep 08 10:02:12.672491 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:02:12.672490    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d816c15e-c5d3-4149-a6da-3288c3d632e4-samples-operator-tls podName:d816c15e-c5d3-4149-a6da-3288c3d632e4 nodeName:}" failed. No retries permitted until 2026-09-08 10:02:14.672473001 +0000 UTC m=+248.368071887 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d816c15e-c5d3-4149-a6da-3288c3d632e4-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-nf99n" (UID: "d816c15e-c5d3-4149-a6da-3288c3d632e4") : secret "samples-operator-tls" not found
Sep 08 10:02:12.672805 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:12.672790    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/e9472cec-3760-4eca-9c6f-7f0e449c1445-config\") pod \"service-ca-operator-859f94c4b-dxh7f\" (UID: \"e9472cec-3760-4eca-9c6f-7f0e449c1445\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-dxh7f"
Sep 08 10:02:12.674675 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:12.674655    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/e9472cec-3760-4eca-9c6f-7f0e449c1445-serving-cert\") pod \"service-ca-operator-859f94c4b-dxh7f\" (UID: \"e9472cec-3760-4eca-9c6f-7f0e449c1445\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-dxh7f"
Sep 08 10:02:12.706803 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:12.706781    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-dxh7f"
Sep 08 10:02:12.983464 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:12.983390    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-dxh7f"]
Sep 08 10:02:12.986961 ip-10-0-132-96 kubenswrapper[2579]: W0908 10:02:12.986936    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9472cec_3760_4eca_9c6f_7f0e449c1445.slice/crio-2ba4debfe88f9afaed17215e8c1c15bc0e919c275e9a67cba5fb3b23982e1709 WatchSource:0}: Error finding container 2ba4debfe88f9afaed17215e8c1c15bc0e919c275e9a67cba5fb3b23982e1709: Status 404 returned error can't find the container with id 2ba4debfe88f9afaed17215e8c1c15bc0e919c275e9a67cba5fb3b23982e1709
Sep 08 10:02:13.509923 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:13.509886    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-dxh7f" event={"ID":"e9472cec-3760-4eca-9c6f-7f0e449c1445","Type":"ContainerStarted","Data":"2ba4debfe88f9afaed17215e8c1c15bc0e919c275e9a67cba5fb3b23982e1709"}
Sep 08 10:02:14.284486 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:14.284428    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:02:14.384505 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:14.384468    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:02:14.685725 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:14.685631    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-registry-tls\") pod \"image-registry-648dc86df7-dxl7n\" (UID: \"e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8\") " pod="openshift-image-registry/image-registry-648dc86df7-dxl7n"
Sep 08 10:02:14.685725 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:14.685708    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d816c15e-c5d3-4149-a6da-3288c3d632e4-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-nf99n\" (UID: \"d816c15e-c5d3-4149-a6da-3288c3d632e4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nf99n"
Sep 08 10:02:14.686171 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:02:14.685824    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 10:02:14.686171 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:02:14.685845    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-648dc86df7-dxl7n: secret "image-registry-tls" not found
Sep 08 10:02:14.686171 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:02:14.685866    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 08 10:02:14.686171 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:02:14.685914    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-registry-tls podName:e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8 nodeName:}" failed. No retries permitted until 2026-09-08 10:02:18.685893249 +0000 UTC m=+252.381492144 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-registry-tls") pod "image-registry-648dc86df7-dxl7n" (UID: "e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8") : secret "image-registry-tls" not found
Sep 08 10:02:14.686171 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:02:14.685933    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d816c15e-c5d3-4149-a6da-3288c3d632e4-samples-operator-tls podName:d816c15e-c5d3-4149-a6da-3288c3d632e4 nodeName:}" failed. No retries permitted until 2026-09-08 10:02:18.685923166 +0000 UTC m=+252.381522050 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d816c15e-c5d3-4149-a6da-3288c3d632e4-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-nf99n" (UID: "d816c15e-c5d3-4149-a6da-3288c3d632e4") : secret "samples-operator-tls" not found
Sep 08 10:02:16.519058 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:16.519017    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wdqrw" event={"ID":"e4d77eca-04c2-456f-b337-e33b3d1981aa","Type":"ContainerStarted","Data":"38df5ee739dabbe03a314bdada4c214c0adb17895768fb0e93c4bee9f0098979"}
Sep 08 10:02:16.520783 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:16.520752    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-dxh7f" event={"ID":"e9472cec-3760-4eca-9c6f-7f0e449c1445","Type":"ContainerStarted","Data":"9dc8cfe609287520a9feeeb0bb3a121fff7b63122cb2da138578f73ed9ca8e6a"}
Sep 08 10:02:16.539885 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:16.539835    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wdqrw" podStartSLOduration=2.723945481 podStartE2EDuration="6.539821331s" totalImagesPullingTime="3.81587585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:02:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:02:16.539029463 +0000 UTC m=+250.234628364" watchObservedRunningTime="2026-09-08 10:02:16.539821331 +0000 UTC m=+250.235420244"
Sep 08 10:02:16.622645 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:16.622588    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-dxh7f" podStartSLOduration=4.137593498 podStartE2EDuration="6.622570376s" totalImagesPullingTime="2.484976878s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:02:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:02:16.568139378 +0000 UTC m=+250.263738296" watchObservedRunningTime="2026-09-08 10:02:16.622570376 +0000 UTC m=+250.318169285"
Sep 08 10:02:16.623096 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:16.623081    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-94xm8"]
Sep 08 10:02:16.625759 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:16.625740    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-94xm8"
Sep 08 10:02:16.628494 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:16.628470    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 08 10:02:16.628623 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:16.628514    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 08 10:02:16.628623 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:16.628470    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-v92cl\""
Sep 08 10:02:16.634502 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:16.634479    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-94xm8"]
Sep 08 10:02:16.801503 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:16.801432    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rzrwj\" (UniqueName: \"kubernetes.io/projected/4c75e142-262c-49b8-89ee-154156d7bd5c-kube-api-access-rzrwj\") pod \"migrator-fdbb8fdff-94xm8\" (UID: \"4c75e142-262c-49b8-89ee-154156d7bd5c\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-94xm8"
Sep 08 10:02:16.902664 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:16.902618    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rzrwj\" (UniqueName: \"kubernetes.io/projected/4c75e142-262c-49b8-89ee-154156d7bd5c-kube-api-access-rzrwj\") pod \"migrator-fdbb8fdff-94xm8\" (UID: \"4c75e142-262c-49b8-89ee-154156d7bd5c\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-94xm8"
Sep 08 10:02:16.912136 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:16.912113    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rzrwj\" (UniqueName: \"kubernetes.io/projected/4c75e142-262c-49b8-89ee-154156d7bd5c-kube-api-access-rzrwj\") pod \"migrator-fdbb8fdff-94xm8\" (UID: \"4c75e142-262c-49b8-89ee-154156d7bd5c\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-94xm8"
Sep 08 10:02:16.939137 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:16.939114    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-94xm8"
Sep 08 10:02:17.209591 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:17.209490    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-94xm8"]
Sep 08 10:02:17.211824 ip-10-0-132-96 kubenswrapper[2579]: W0908 10:02:17.211797    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c75e142_262c_49b8_89ee_154156d7bd5c.slice/crio-5b63bcf2f192d7ec47e3aa7601f741a6e1849968b3191f361f5ed7210f143965 WatchSource:0}: Error finding container 5b63bcf2f192d7ec47e3aa7601f741a6e1849968b3191f361f5ed7210f143965: Status 404 returned error can't find the container with id 5b63bcf2f192d7ec47e3aa7601f741a6e1849968b3191f361f5ed7210f143965
Sep 08 10:02:17.524753 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:17.524722    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-94xm8" event={"ID":"4c75e142-262c-49b8-89ee-154156d7bd5c","Type":"ContainerStarted","Data":"5b63bcf2f192d7ec47e3aa7601f741a6e1849968b3191f361f5ed7210f143965"}
Sep 08 10:02:17.895175 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:17.895084    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:02:17.995730 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:17.995691    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:02:18.715247 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:18.715214    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d816c15e-c5d3-4149-a6da-3288c3d632e4-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-nf99n\" (UID: \"d816c15e-c5d3-4149-a6da-3288c3d632e4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nf99n"
Sep 08 10:02:18.715640 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:18.715266    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3868a1c3-46c6-4940-92ed-e460b77d7cfc-metrics-certs\") pod \"network-metrics-daemon-b5m55\" (UID: \"3868a1c3-46c6-4940-92ed-e460b77d7cfc\") " pod="openshift-multus/network-metrics-daemon-b5m55"
Sep 08 10:02:18.715640 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:18.715312    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-registry-tls\") pod \"image-registry-648dc86df7-dxl7n\" (UID: \"e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8\") " pod="openshift-image-registry/image-registry-648dc86df7-dxl7n"
Sep 08 10:02:18.715640 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:02:18.715379    2579 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 08 10:02:18.715640 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:02:18.715402    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 10:02:18.715640 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:02:18.715414    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-648dc86df7-dxl7n: secret "image-registry-tls" not found
Sep 08 10:02:18.715640 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:02:18.715434    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 08 10:02:18.715640 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:02:18.715453    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d816c15e-c5d3-4149-a6da-3288c3d632e4-samples-operator-tls podName:d816c15e-c5d3-4149-a6da-3288c3d632e4 nodeName:}" failed. No retries permitted until 2026-09-08 10:02:26.715432148 +0000 UTC m=+260.411031048 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d816c15e-c5d3-4149-a6da-3288c3d632e4-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-nf99n" (UID: "d816c15e-c5d3-4149-a6da-3288c3d632e4") : secret "samples-operator-tls" not found
Sep 08 10:02:18.715640 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:02:18.715470    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-registry-tls podName:e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8 nodeName:}" failed. No retries permitted until 2026-09-08 10:02:26.715461455 +0000 UTC m=+260.411060336 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-registry-tls") pod "image-registry-648dc86df7-dxl7n" (UID: "e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8") : secret "image-registry-tls" not found
Sep 08 10:02:18.715640 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:02:18.715484    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3868a1c3-46c6-4940-92ed-e460b77d7cfc-metrics-certs podName:3868a1c3-46c6-4940-92ed-e460b77d7cfc nodeName:}" failed. No retries permitted until 2026-09-08 10:04:20.715476114 +0000 UTC m=+374.411074992 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3868a1c3-46c6-4940-92ed-e460b77d7cfc-metrics-certs") pod "network-metrics-daemon-b5m55" (UID: "3868a1c3-46c6-4940-92ed-e460b77d7cfc") : secret "metrics-daemon-secret" not found
Sep 08 10:02:20.647527 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:20.647493    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:02:20.756007 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:20.755975    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:02:20.874940 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:20.874899    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:02:22.542766 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:22.542722    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-94xm8" event={"ID":"4c75e142-262c-49b8-89ee-154156d7bd5c","Type":"ContainerStarted","Data":"dc9adf4930ca508ebff27273b9cb33fcaff5734bc39c36c85fec33a6431a8c9b"}
Sep 08 10:02:22.543118 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:22.542820    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-94xm8" event={"ID":"4c75e142-262c-49b8-89ee-154156d7bd5c","Type":"ContainerStarted","Data":"0dfb0150c230932c5b0d48a7537300af6d905e8237ac5a7d913faa95aaf56209"}
Sep 08 10:02:22.558470 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:22.558427    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-94xm8" podStartSLOduration=2.228491907 podStartE2EDuration="6.558412974s" totalImagesPullingTime="4.329921067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:02:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:02:22.557726956 +0000 UTC m=+256.253325856" watchObservedRunningTime="2026-09-08 10:02:22.558412974 +0000 UTC m=+256.254011874"
Sep 08 10:02:23.241923 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:23.241887    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:02:23.396925 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:23.396893    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:02:23.745388 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:23.745361    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wdvlk_313cffc0-94c1-466a-8a57-750151daa9ea/dns-node-resolver/0.log"
Sep 08 10:02:24.339341 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:24.339315    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2zsx5_4a41ec82-3e27-4c50-b580-861230051e27/node-ca/0.log"
Sep 08 10:02:25.139968 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:25.139931    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cn8g6_21f0eabe-633e-42f3-8d52-409164a38bc1/serve-healthcheck-canary/0.log"
Sep 08 10:02:25.740512 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:25.740481    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-94xm8_4c75e142-262c-49b8-89ee-154156d7bd5c/migrator/0.log"
Sep 08 10:02:25.940911 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:25.940871    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-94xm8_4c75e142-262c-49b8-89ee-154156d7bd5c/graceful-termination/0.log"
Sep 08 10:02:26.140935 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:26.140900    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-wdqrw_e4d77eca-04c2-456f-b337-e33b3d1981aa/kube-storage-version-migrator-operator/0.log"
Sep 08 10:02:26.347362 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:26.347327    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:02:26.768527 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:26.768488    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-registry-tls\") pod \"image-registry-648dc86df7-dxl7n\" (UID: \"e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8\") " pod="openshift-image-registry/image-registry-648dc86df7-dxl7n"
Sep 08 10:02:26.768721 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:26.768569    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d816c15e-c5d3-4149-a6da-3288c3d632e4-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-nf99n\" (UID: \"d816c15e-c5d3-4149-a6da-3288c3d632e4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nf99n"
Sep 08 10:02:26.768721 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:02:26.768646    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 10:02:26.768721 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:02:26.768668    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-648dc86df7-dxl7n: secret "image-registry-tls" not found
Sep 08 10:02:26.768894 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:02:26.768748    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-registry-tls podName:e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8 nodeName:}" failed. No retries permitted until 2026-09-08 10:02:42.768727927 +0000 UTC m=+276.464326826 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-registry-tls") pod "image-registry-648dc86df7-dxl7n" (UID: "e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8") : secret "image-registry-tls" not found
Sep 08 10:02:26.771017 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:26.770996    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d816c15e-c5d3-4149-a6da-3288c3d632e4-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-nf99n\" (UID: \"d816c15e-c5d3-4149-a6da-3288c3d632e4\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nf99n"
Sep 08 10:02:26.868711 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:26.868677    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nf99n"
Sep 08 10:02:27.136875 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:27.136802    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nf99n"]
Sep 08 10:02:27.558862 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:27.558832    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nf99n" event={"ID":"d816c15e-c5d3-4149-a6da-3288c3d632e4","Type":"ContainerStarted","Data":"f5b49d0ce7f597145c8272fff02903a63f356203857a8c1b0b1db31af20161cb"}
Sep 08 10:02:28.047837 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:28.047799    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:02:28.148246 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:28.148215    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:02:28.248213 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:28.248034    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:02:29.567809 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:29.567773    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nf99n" event={"ID":"d816c15e-c5d3-4149-a6da-3288c3d632e4","Type":"ContainerStarted","Data":"0c9b79241bc3c3c792393f8210e20bbbacec64a5b5432dbf5d72dbffdd37ade9"}
Sep 08 10:02:29.568180 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:29.567823    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nf99n" event={"ID":"d816c15e-c5d3-4149-a6da-3288c3d632e4","Type":"ContainerStarted","Data":"9ade5e2d5adf18df9fefeb151700f327a1ba8cf9761bd60174bbdacaff2c7303"}
Sep 08 10:02:29.584490 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:29.584447    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-nf99n" podStartSLOduration=17.840682132 podStartE2EDuration="19.584434159s" totalImagesPullingTime="1.743752027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:02:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:02:29.583032688 +0000 UTC m=+263.278631587" watchObservedRunningTime="2026-09-08 10:02:29.584434159 +0000 UTC m=+263.280033058"
Sep 08 10:02:30.154675 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:30.154643    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:02:30.255290 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:30.255263    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:02:32.138836 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:32.138804    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:02:34.190778 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:34.190743    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:02:34.291916 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:34.291883    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:02:34.394697 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:34.394666    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:02:41.928940 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:41.928907    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-648dc86df7-dxl7n"]
Sep 08 10:02:41.929426 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:02:41.929141    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-648dc86df7-dxl7n" podUID="e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8"
Sep 08 10:02:41.938893 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:41.938868    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-2kdk4"]
Sep 08 10:02:41.941621 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:41.941601    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2kdk4"
Sep 08 10:02:41.944624 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:41.944594    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 08 10:02:41.944624 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:41.944614    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 08 10:02:41.944879 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:41.944865    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 08 10:02:41.944954 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:41.944913    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8qctm\""
Sep 08 10:02:41.948859 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:41.948845    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 08 10:02:41.959969 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:41.959943    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2kdk4"]
Sep 08 10:02:41.975207 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:41.975179    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e333d509-2175-41f6-9d0f-ebfa94b37e43-crio-socket\") pod \"insights-runtime-extractor-2kdk4\" (UID: \"e333d509-2175-41f6-9d0f-ebfa94b37e43\") " pod="openshift-insights/insights-runtime-extractor-2kdk4"
Sep 08 10:02:41.975321 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:41.975271    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e333d509-2175-41f6-9d0f-ebfa94b37e43-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2kdk4\" (UID: \"e333d509-2175-41f6-9d0f-ebfa94b37e43\") " pod="openshift-insights/insights-runtime-extractor-2kdk4"
Sep 08 10:02:41.975321 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:41.975309    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x552j\" (UniqueName: \"kubernetes.io/projected/e333d509-2175-41f6-9d0f-ebfa94b37e43-kube-api-access-x552j\") pod \"insights-runtime-extractor-2kdk4\" (UID: \"e333d509-2175-41f6-9d0f-ebfa94b37e43\") " pod="openshift-insights/insights-runtime-extractor-2kdk4"
Sep 08 10:02:41.975432 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:41.975335    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e333d509-2175-41f6-9d0f-ebfa94b37e43-data-volume\") pod \"insights-runtime-extractor-2kdk4\" (UID: \"e333d509-2175-41f6-9d0f-ebfa94b37e43\") " pod="openshift-insights/insights-runtime-extractor-2kdk4"
Sep 08 10:02:41.975432 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:41.975364    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e333d509-2175-41f6-9d0f-ebfa94b37e43-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2kdk4\" (UID: \"e333d509-2175-41f6-9d0f-ebfa94b37e43\") " pod="openshift-insights/insights-runtime-extractor-2kdk4"
Sep 08 10:02:42.021692 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:42.021649    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:02:42.076377 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:42.076345    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e333d509-2175-41f6-9d0f-ebfa94b37e43-data-volume\") pod \"insights-runtime-extractor-2kdk4\" (UID: \"e333d509-2175-41f6-9d0f-ebfa94b37e43\") " pod="openshift-insights/insights-runtime-extractor-2kdk4"
Sep 08 10:02:42.076567 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:42.076396    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e333d509-2175-41f6-9d0f-ebfa94b37e43-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2kdk4\" (UID: \"e333d509-2175-41f6-9d0f-ebfa94b37e43\") " pod="openshift-insights/insights-runtime-extractor-2kdk4"
Sep 08 10:02:42.076567 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:42.076428    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e333d509-2175-41f6-9d0f-ebfa94b37e43-crio-socket\") pod \"insights-runtime-extractor-2kdk4\" (UID: \"e333d509-2175-41f6-9d0f-ebfa94b37e43\") " pod="openshift-insights/insights-runtime-extractor-2kdk4"
Sep 08 10:02:42.076567 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:42.076486    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e333d509-2175-41f6-9d0f-ebfa94b37e43-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2kdk4\" (UID: \"e333d509-2175-41f6-9d0f-ebfa94b37e43\") " pod="openshift-insights/insights-runtime-extractor-2kdk4"
Sep 08 10:02:42.076567 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:42.076507    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x552j\" (UniqueName: \"kubernetes.io/projected/e333d509-2175-41f6-9d0f-ebfa94b37e43-kube-api-access-x552j\") pod \"insights-runtime-extractor-2kdk4\" (UID: \"e333d509-2175-41f6-9d0f-ebfa94b37e43\") " pod="openshift-insights/insights-runtime-extractor-2kdk4"
Sep 08 10:02:42.076783 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:42.076598    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/e333d509-2175-41f6-9d0f-ebfa94b37e43-crio-socket\") pod \"insights-runtime-extractor-2kdk4\" (UID: \"e333d509-2175-41f6-9d0f-ebfa94b37e43\") " pod="openshift-insights/insights-runtime-extractor-2kdk4"
Sep 08 10:02:42.076783 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:42.076730    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/e333d509-2175-41f6-9d0f-ebfa94b37e43-data-volume\") pod \"insights-runtime-extractor-2kdk4\" (UID: \"e333d509-2175-41f6-9d0f-ebfa94b37e43\") " pod="openshift-insights/insights-runtime-extractor-2kdk4"
Sep 08 10:02:42.077028 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:42.077008    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/e333d509-2175-41f6-9d0f-ebfa94b37e43-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-2kdk4\" (UID: \"e333d509-2175-41f6-9d0f-ebfa94b37e43\") " pod="openshift-insights/insights-runtime-extractor-2kdk4"
Sep 08 10:02:42.078966 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:42.078945    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/e333d509-2175-41f6-9d0f-ebfa94b37e43-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-2kdk4\" (UID: \"e333d509-2175-41f6-9d0f-ebfa94b37e43\") " pod="openshift-insights/insights-runtime-extractor-2kdk4"
Sep 08 10:02:42.093141 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:42.093114    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x552j\" (UniqueName: \"kubernetes.io/projected/e333d509-2175-41f6-9d0f-ebfa94b37e43-kube-api-access-x552j\") pod \"insights-runtime-extractor-2kdk4\" (UID: \"e333d509-2175-41f6-9d0f-ebfa94b37e43\") " pod="openshift-insights/insights-runtime-extractor-2kdk4"
Sep 08 10:02:42.120322 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:42.120299    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:02:42.216383 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:42.216298    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:02:42.250798 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:42.250762    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-2kdk4"
Sep 08 10:02:42.520896 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:42.520867    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-2kdk4"]
Sep 08 10:02:42.524061 ip-10-0-132-96 kubenswrapper[2579]: W0908 10:02:42.524035    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode333d509_2175_41f6_9d0f_ebfa94b37e43.slice/crio-199797bc6f4c122016506d9c4946da9aeff9e909146357920d639e6d798f0d8f WatchSource:0}: Error finding container 199797bc6f4c122016506d9c4946da9aeff9e909146357920d639e6d798f0d8f: Status 404 returned error can't find the container with id 199797bc6f4c122016506d9c4946da9aeff9e909146357920d639e6d798f0d8f
Sep 08 10:02:42.607767 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:42.607749    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-648dc86df7-dxl7n"
Sep 08 10:02:42.607863 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:42.607742    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2kdk4" event={"ID":"e333d509-2175-41f6-9d0f-ebfa94b37e43","Type":"ContainerStarted","Data":"f7b652e9ddc687511487f5efb6e5e7836ce5bbadd672b0fd6f097b91ceb11e31"}
Sep 08 10:02:42.607908 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:42.607866    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2kdk4" event={"ID":"e333d509-2175-41f6-9d0f-ebfa94b37e43","Type":"ContainerStarted","Data":"199797bc6f4c122016506d9c4946da9aeff9e909146357920d639e6d798f0d8f"}
Sep 08 10:02:42.613909 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:42.613893    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-648dc86df7-dxl7n"
Sep 08 10:02:42.681590 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:42.681559    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-installation-pull-secrets\") pod \"e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8\" (UID: \"e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8\") "
Sep 08 10:02:42.681590 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:42.681598    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-bound-sa-token\") pod \"e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8\" (UID: \"e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8\") "
Sep 08 10:02:42.681757 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:42.681634    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s9xdl\" (UniqueName: \"kubernetes.io/projected/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-kube-api-access-s9xdl\") pod \"e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8\" (UID: \"e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8\") "
Sep 08 10:02:42.681757 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:42.681650    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-trusted-ca\") pod \"e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8\" (UID: \"e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8\") "
Sep 08 10:02:42.681757 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:42.681683    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-ca-trust-extracted\") pod \"e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8\" (UID: \"e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8\") "
Sep 08 10:02:42.681757 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:42.681700    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-registry-certificates\") pod \"e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8\" (UID: \"e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8\") "
Sep 08 10:02:42.681952 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:42.681790    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-image-registry-private-configuration\") pod \"e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8\" (UID: \"e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8\") "
Sep 08 10:02:42.681952 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:42.681931    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8" (UID: "e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:02:42.682054 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:42.682016    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8" (UID: "e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:02:42.682106 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:42.682025    2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-ca-trust-extracted\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:02:42.682106 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:42.682070    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8" (UID: "e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:02:42.683930 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:42.683903    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8" (UID: "e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:02:42.684011 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:42.683951    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8" (UID: "e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:02:42.684011 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:42.683963    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8" (UID: "e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:02:42.684011 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:42.683984    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-kube-api-access-s9xdl" (OuterVolumeSpecName: "kube-api-access-s9xdl") pod "e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8" (UID: "e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8"). InnerVolumeSpecName "kube-api-access-s9xdl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:02:42.782502 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:42.782444    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-registry-tls\") pod \"image-registry-648dc86df7-dxl7n\" (UID: \"e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8\") " pod="openshift-image-registry/image-registry-648dc86df7-dxl7n"
Sep 08 10:02:42.782502 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:42.782491    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s9xdl\" (UniqueName: \"kubernetes.io/projected/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-kube-api-access-s9xdl\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:02:42.782502 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:42.782501    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-trusted-ca\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:02:42.782663 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:42.782510    2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-registry-certificates\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:02:42.782663 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:42.782518    2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-image-registry-private-configuration\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:02:42.782663 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:42.782527    2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-installation-pull-secrets\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:02:42.782663 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:42.782551    2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-bound-sa-token\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:02:42.784668 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:42.784650    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-registry-tls\") pod \"image-registry-648dc86df7-dxl7n\" (UID: \"e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8\") " pod="openshift-image-registry/image-registry-648dc86df7-dxl7n"
Sep 08 10:02:42.882827 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:42.882796    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-registry-tls\") pod \"e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8\" (UID: \"e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8\") "
Sep 08 10:02:42.884694 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:42.884671    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8" (UID: "e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:02:42.983511 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:42.983477    2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8-registry-tls\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:02:43.612415 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:43.612342    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-648dc86df7-dxl7n"
Sep 08 10:02:43.612576 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:43.612333    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2kdk4" event={"ID":"e333d509-2175-41f6-9d0f-ebfa94b37e43","Type":"ContainerStarted","Data":"c69d69a7f1430adde8b816b0d743b13829e31718d95dc6869ff9c8109938d8da"}
Sep 08 10:02:43.648119 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:43.648086    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-648dc86df7-dxl7n"]
Sep 08 10:02:43.653911 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:43.653892    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-648dc86df7-dxl7n"]
Sep 08 10:02:44.831164 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:44.831135    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8" path="/var/lib/kubelet/pods/e7a05ff9-ba6b-41cd-9139-b8d4e18eaca8/volumes"
Sep 08 10:02:45.620995 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:45.620961    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-2kdk4" event={"ID":"e333d509-2175-41f6-9d0f-ebfa94b37e43","Type":"ContainerStarted","Data":"96e325d79020b0f6cd96292b66ca8a5c2c4835cdeb9a32bf9c41233a506d64e4"}
Sep 08 10:02:45.631216 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:45.631189    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:02:45.643591 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:45.643521    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-2kdk4" podStartSLOduration=2.612019007 podStartE2EDuration="4.643507925s" totalImagesPullingTime="2.031488918s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:02:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:02:45.64168048 +0000 UTC m=+279.337279379" watchObservedRunningTime="2026-09-08 10:02:45.643507925 +0000 UTC m=+279.339106824"
Sep 08 10:02:45.727962 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:45.727938    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:02:45.807319 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:45.807287    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rmmms"]
Sep 08 10:02:45.807785 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:45.807739    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:02:45.810436 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:45.810420    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rmmms"
Sep 08 10:02:45.813045 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:45.813029    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 08 10:02:45.813122 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:45.813095    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-qtqrd\""
Sep 08 10:02:45.823348 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:45.823321    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rmmms"]
Sep 08 10:02:45.903480 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:45.903394    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4edd76d7-d6d3-42b2-9058-cc576b9e4971-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-rmmms\" (UID: \"4edd76d7-d6d3-42b2-9058-cc576b9e4971\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rmmms"
Sep 08 10:02:46.003753 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:46.003712    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4edd76d7-d6d3-42b2-9058-cc576b9e4971-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-rmmms\" (UID: \"4edd76d7-d6d3-42b2-9058-cc576b9e4971\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rmmms"
Sep 08 10:02:46.003895 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:02:46.003851    2579 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Sep 08 10:02:46.003937 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:02:46.003913    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4edd76d7-d6d3-42b2-9058-cc576b9e4971-tls-certificates podName:4edd76d7-d6d3-42b2-9058-cc576b9e4971 nodeName:}" failed. No retries permitted until 2026-09-08 10:02:46.503897037 +0000 UTC m=+280.199495915 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/4edd76d7-d6d3-42b2-9058-cc576b9e4971-tls-certificates") pod "prometheus-operator-admission-webhook-78f599db79-rmmms" (UID: "4edd76d7-d6d3-42b2-9058-cc576b9e4971") : secret "prometheus-operator-admission-webhook-tls" not found
Sep 08 10:02:46.508191 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:46.508155    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4edd76d7-d6d3-42b2-9058-cc576b9e4971-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-rmmms\" (UID: \"4edd76d7-d6d3-42b2-9058-cc576b9e4971\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rmmms"
Sep 08 10:02:46.510728 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:46.510706    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/4edd76d7-d6d3-42b2-9058-cc576b9e4971-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-rmmms\" (UID: \"4edd76d7-d6d3-42b2-9058-cc576b9e4971\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rmmms"
Sep 08 10:02:46.647108 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:46.647062    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:02:46.718905 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:46.718883    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rmmms"
Sep 08 10:02:46.985283 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:46.985255    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rmmms"]
Sep 08 10:02:46.988158 ip-10-0-132-96 kubenswrapper[2579]: W0908 10:02:46.988126    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4edd76d7_d6d3_42b2_9058_cc576b9e4971.slice/crio-31ad0c1ac93477a9ee207a72eb039148599d8fc72a5348b03f40dd22c77fd906 WatchSource:0}: Error finding container 31ad0c1ac93477a9ee207a72eb039148599d8fc72a5348b03f40dd22c77fd906: Status 404 returned error can't find the container with id 31ad0c1ac93477a9ee207a72eb039148599d8fc72a5348b03f40dd22c77fd906
Sep 08 10:02:47.628242 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:47.628199    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rmmms" event={"ID":"4edd76d7-d6d3-42b2-9058-cc576b9e4971","Type":"ContainerStarted","Data":"31ad0c1ac93477a9ee207a72eb039148599d8fc72a5348b03f40dd22c77fd906"}
Sep 08 10:02:48.301379 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:02:48.301341    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-w56bl" podUID="e35db162-1476-43d4-a08f-b95ca644a417"
Sep 08 10:02:48.632153 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:48.632072    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w56bl"
Sep 08 10:02:49.637157 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:49.637123    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rmmms" event={"ID":"4edd76d7-d6d3-42b2-9058-cc576b9e4971","Type":"ContainerStarted","Data":"1ec2a934a83328c5d3c03360bfa60d1cec315131bd593abf1468fc3b4d92b597"}
Sep 08 10:02:49.637636 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:49.637320    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rmmms"
Sep 08 10:02:49.641879 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:49.641857    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rmmms"
Sep 08 10:02:49.652960 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:49.652922    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-rmmms" podStartSLOduration=2.454240936 podStartE2EDuration="4.652908781s" totalImagesPullingTime="2.198667845s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:02:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:02:49.65255583 +0000 UTC m=+283.348154721" watchObservedRunningTime="2026-09-08 10:02:49.652908781 +0000 UTC m=+283.348507681"
Sep 08 10:02:49.833052 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:49.833013    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:02:49.874191 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:49.874164    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-47dpb"]
Sep 08 10:02:49.876077 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:49.876062    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-47dpb"
Sep 08 10:02:49.879179 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:49.879158    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 08 10:02:49.879279 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:49.879235    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-qvm4q\""
Sep 08 10:02:49.880663 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:49.880646    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 08 10:02:49.880715 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:49.880648    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Sep 08 10:02:49.880715 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:49.880679    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Sep 08 10:02:49.880798 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:49.880691    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 08 10:02:49.887505 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:49.887460    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-47dpb"]
Sep 08 10:02:49.915138 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:49.915116    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:02:49.929057 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:49.929033    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9b5bcb3b-856b-484a-b3c9-b4477ccb3299-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-47dpb\" (UID: \"9b5bcb3b-856b-484a-b3c9-b4477ccb3299\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-47dpb"
Sep 08 10:02:49.929133 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:49.929064    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9b5bcb3b-856b-484a-b3c9-b4477ccb3299-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-47dpb\" (UID: \"9b5bcb3b-856b-484a-b3c9-b4477ccb3299\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-47dpb"
Sep 08 10:02:49.929133 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:49.929083    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wr7q7\" (UniqueName: \"kubernetes.io/projected/9b5bcb3b-856b-484a-b3c9-b4477ccb3299-kube-api-access-wr7q7\") pod \"prometheus-operator-6f4946db56-47dpb\" (UID: \"9b5bcb3b-856b-484a-b3c9-b4477ccb3299\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-47dpb"
Sep 08 10:02:49.929201 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:49.929144    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b5bcb3b-856b-484a-b3c9-b4477ccb3299-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-47dpb\" (UID: \"9b5bcb3b-856b-484a-b3c9-b4477ccb3299\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-47dpb"
Sep 08 10:02:50.029648 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:50.029616    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9b5bcb3b-856b-484a-b3c9-b4477ccb3299-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-47dpb\" (UID: \"9b5bcb3b-856b-484a-b3c9-b4477ccb3299\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-47dpb"
Sep 08 10:02:50.029778 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:50.029652    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wr7q7\" (UniqueName: \"kubernetes.io/projected/9b5bcb3b-856b-484a-b3c9-b4477ccb3299-kube-api-access-wr7q7\") pod \"prometheus-operator-6f4946db56-47dpb\" (UID: \"9b5bcb3b-856b-484a-b3c9-b4477ccb3299\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-47dpb"
Sep 08 10:02:50.029778 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:50.029691    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b5bcb3b-856b-484a-b3c9-b4477ccb3299-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-47dpb\" (UID: \"9b5bcb3b-856b-484a-b3c9-b4477ccb3299\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-47dpb"
Sep 08 10:02:50.029778 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:50.029735    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9b5bcb3b-856b-484a-b3c9-b4477ccb3299-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-47dpb\" (UID: \"9b5bcb3b-856b-484a-b3c9-b4477ccb3299\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-47dpb"
Sep 08 10:02:50.029883 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:02:50.029833    2579 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Sep 08 10:02:50.029940 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:02:50.029929    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9b5bcb3b-856b-484a-b3c9-b4477ccb3299-prometheus-operator-tls podName:9b5bcb3b-856b-484a-b3c9-b4477ccb3299 nodeName:}" failed. No retries permitted until 2026-09-08 10:02:50.529910155 +0000 UTC m=+284.225509034 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/9b5bcb3b-856b-484a-b3c9-b4477ccb3299-prometheus-operator-tls") pod "prometheus-operator-6f4946db56-47dpb" (UID: "9b5bcb3b-856b-484a-b3c9-b4477ccb3299") : secret "prometheus-operator-tls" not found
Sep 08 10:02:50.030468 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:50.030396    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b5bcb3b-856b-484a-b3c9-b4477ccb3299-metrics-client-ca\") pod \"prometheus-operator-6f4946db56-47dpb\" (UID: \"9b5bcb3b-856b-484a-b3c9-b4477ccb3299\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-47dpb"
Sep 08 10:02:50.032074 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:50.032054    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9b5bcb3b-856b-484a-b3c9-b4477ccb3299-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-6f4946db56-47dpb\" (UID: \"9b5bcb3b-856b-484a-b3c9-b4477ccb3299\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-47dpb"
Sep 08 10:02:50.038521 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:50.038498    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wr7q7\" (UniqueName: \"kubernetes.io/projected/9b5bcb3b-856b-484a-b3c9-b4477ccb3299-kube-api-access-wr7q7\") pod \"prometheus-operator-6f4946db56-47dpb\" (UID: \"9b5bcb3b-856b-484a-b3c9-b4477ccb3299\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-47dpb"
Sep 08 10:02:50.345984 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:50.345953    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:02:50.533522 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:50.533483    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9b5bcb3b-856b-484a-b3c9-b4477ccb3299-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-47dpb\" (UID: \"9b5bcb3b-856b-484a-b3c9-b4477ccb3299\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-47dpb"
Sep 08 10:02:50.535999 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:50.535968    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/9b5bcb3b-856b-484a-b3c9-b4477ccb3299-prometheus-operator-tls\") pod \"prometheus-operator-6f4946db56-47dpb\" (UID: \"9b5bcb3b-856b-484a-b3c9-b4477ccb3299\") " pod="openshift-monitoring/prometheus-operator-6f4946db56-47dpb"
Sep 08 10:02:50.785893 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:50.785858    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-6f4946db56-47dpb"
Sep 08 10:02:51.058080 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:51.057901    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-6f4946db56-47dpb"]
Sep 08 10:02:51.060494 ip-10-0-132-96 kubenswrapper[2579]: W0908 10:02:51.060468    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b5bcb3b_856b_484a_b3c9_b4477ccb3299.slice/crio-cea1d65bfb416aefe44fb83e70d6b5f90c7d5e57926ba480f51a72ce181ea962 WatchSource:0}: Error finding container cea1d65bfb416aefe44fb83e70d6b5f90c7d5e57926ba480f51a72ce181ea962: Status 404 returned error can't find the container with id cea1d65bfb416aefe44fb83e70d6b5f90c7d5e57926ba480f51a72ce181ea962
Sep 08 10:02:51.645347 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:51.645311    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-47dpb" event={"ID":"9b5bcb3b-856b-484a-b3c9-b4477ccb3299","Type":"ContainerStarted","Data":"cea1d65bfb416aefe44fb83e70d6b5f90c7d5e57926ba480f51a72ce181ea962"}
Sep 08 10:02:52.042098 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:52.042060    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e35db162-1476-43d4-a08f-b95ca644a417-metrics-tls\") pod \"dns-default-w56bl\" (UID: \"e35db162-1476-43d4-a08f-b95ca644a417\") " pod="openshift-dns/dns-default-w56bl"
Sep 08 10:02:52.044799 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:52.044778    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e35db162-1476-43d4-a08f-b95ca644a417-metrics-tls\") pod \"dns-default-w56bl\" (UID: \"e35db162-1476-43d4-a08f-b95ca644a417\") " pod="openshift-dns/dns-default-w56bl"
Sep 08 10:02:52.235803 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:52.235780    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-vr97k\""
Sep 08 10:02:52.243223 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:52.243203    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w56bl"
Sep 08 10:02:52.490524 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:52.490484    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:02:52.519669 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:52.519640    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-w56bl"]
Sep 08 10:02:52.522439 ip-10-0-132-96 kubenswrapper[2579]: W0908 10:02:52.522411    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode35db162_1476_43d4_a08f_b95ca644a417.slice/crio-e95f0e1b9fad58a8a7587f0071596aecc897656436dc845147b7bc1f86aca5dd WatchSource:0}: Error finding container e95f0e1b9fad58a8a7587f0071596aecc897656436dc845147b7bc1f86aca5dd: Status 404 returned error can't find the container with id e95f0e1b9fad58a8a7587f0071596aecc897656436dc845147b7bc1f86aca5dd
Sep 08 10:02:52.650334 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:52.650245    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-47dpb" event={"ID":"9b5bcb3b-856b-484a-b3c9-b4477ccb3299","Type":"ContainerStarted","Data":"87b5d8ac63683bc7f76974611c50470e748270be37d2f961fade0c6fdacb6e78"}
Sep 08 10:02:52.650334 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:52.650301    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-6f4946db56-47dpb" event={"ID":"9b5bcb3b-856b-484a-b3c9-b4477ccb3299","Type":"ContainerStarted","Data":"deb0d143578d9fce123c3284cdef192dff41f65f28b847a2ad924df1838f9a16"}
Sep 08 10:02:52.651467 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:52.651443    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w56bl" event={"ID":"e35db162-1476-43d4-a08f-b95ca644a417","Type":"ContainerStarted","Data":"e95f0e1b9fad58a8a7587f0071596aecc897656436dc845147b7bc1f86aca5dd"}
Sep 08 10:02:52.667884 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:52.667835    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-6f4946db56-47dpb" podStartSLOduration=2.526773429 podStartE2EDuration="3.667822105s" totalImagesPullingTime="1.141048676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:02:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:02:52.667291449 +0000 UTC m=+286.362890363" watchObservedRunningTime="2026-09-08 10:02:52.667822105 +0000 UTC m=+286.363421005"
Sep 08 10:02:53.987157 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:53.987107    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:02:54.205200 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.205159    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:02:54.237382 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.237310    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-t25pb"]
Sep 08 10:02:54.241064 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.241045    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t25pb"
Sep 08 10:02:54.243825 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.243786    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 08 10:02:54.243943 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.243799    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 08 10:02:54.243943 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.243801    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-bdrr2\""
Sep 08 10:02:54.250840 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.250823    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-t25pb"]
Sep 08 10:02:54.255636 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.255615    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-9j9l6"]
Sep 08 10:02:54.259006 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.258988    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-9j9l6"
Sep 08 10:02:54.262277 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.262068    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Sep 08 10:02:54.262277 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.262084    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Sep 08 10:02:54.262277 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.262102    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-d7r8g\""
Sep 08 10:02:54.262730 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.262699    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Sep 08 10:02:54.275760 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.275740    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-9j9l6"]
Sep 08 10:02:54.285940 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.285920    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-pws49"]
Sep 08 10:02:54.289403 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.289383    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pws49"
Sep 08 10:02:54.292078 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.292057    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qnzqn\""
Sep 08 10:02:54.292078 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.292069    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 08 10:02:54.292214 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.292115    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 08 10:02:54.292395 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.292379    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 08 10:02:54.313727 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.313692    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:02:54.356822 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.356793    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae8d0e32-e1b2-42d6-9bcd-e34035c43977-metrics-client-ca\") pod \"node-exporter-pws49\" (UID: \"ae8d0e32-e1b2-42d6-9bcd-e34035c43977\") " pod="openshift-monitoring/node-exporter-pws49"
Sep 08 10:02:54.356953 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.356834    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ea2bf78c-a59f-4206-b2e3-769f6b81347f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-t25pb\" (UID: \"ea2bf78c-a59f-4206-b2e3-769f6b81347f\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t25pb"
Sep 08 10:02:54.356953 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.356885    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ea2bf78c-a59f-4206-b2e3-769f6b81347f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-t25pb\" (UID: \"ea2bf78c-a59f-4206-b2e3-769f6b81347f\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t25pb"
Sep 08 10:02:54.357057 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.356945    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea2bf78c-a59f-4206-b2e3-769f6b81347f-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-t25pb\" (UID: \"ea2bf78c-a59f-4206-b2e3-769f6b81347f\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t25pb"
Sep 08 10:02:54.357057 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.356995    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e5b6c74f-f7d5-498f-819b-774611df756f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-9j9l6\" (UID: \"e5b6c74f-f7d5-498f-819b-774611df756f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-9j9l6"
Sep 08 10:02:54.357057 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.357042    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ae8d0e32-e1b2-42d6-9bcd-e34035c43977-sys\") pod \"node-exporter-pws49\" (UID: \"ae8d0e32-e1b2-42d6-9bcd-e34035c43977\") " pod="openshift-monitoring/node-exporter-pws49"
Sep 08 10:02:54.357176 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.357076    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ae8d0e32-e1b2-42d6-9bcd-e34035c43977-node-exporter-wtmp\") pod \"node-exporter-pws49\" (UID: \"ae8d0e32-e1b2-42d6-9bcd-e34035c43977\") " pod="openshift-monitoring/node-exporter-pws49"
Sep 08 10:02:54.357176 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.357111    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e5b6c74f-f7d5-498f-819b-774611df756f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-9j9l6\" (UID: \"e5b6c74f-f7d5-498f-819b-774611df756f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-9j9l6"
Sep 08 10:02:54.357176 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.357142    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ae8d0e32-e1b2-42d6-9bcd-e34035c43977-node-exporter-accelerators-collector-config\") pod \"node-exporter-pws49\" (UID: \"ae8d0e32-e1b2-42d6-9bcd-e34035c43977\") " pod="openshift-monitoring/node-exporter-pws49"
Sep 08 10:02:54.357176 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.357173    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5b6c74f-f7d5-498f-819b-774611df756f-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-9j9l6\" (UID: \"e5b6c74f-f7d5-498f-819b-774611df756f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-9j9l6"
Sep 08 10:02:54.357363 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.357197    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stjnw\" (UniqueName: \"kubernetes.io/projected/ae8d0e32-e1b2-42d6-9bcd-e34035c43977-kube-api-access-stjnw\") pod \"node-exporter-pws49\" (UID: \"ae8d0e32-e1b2-42d6-9bcd-e34035c43977\") " pod="openshift-monitoring/node-exporter-pws49"
Sep 08 10:02:54.357363 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.357248    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn8wl\" (UniqueName: \"kubernetes.io/projected/ea2bf78c-a59f-4206-b2e3-769f6b81347f-kube-api-access-hn8wl\") pod \"openshift-state-metrics-657fd6c54-t25pb\" (UID: \"ea2bf78c-a59f-4206-b2e3-769f6b81347f\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t25pb"
Sep 08 10:02:54.357363 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.357301    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e5b6c74f-f7d5-498f-819b-774611df756f-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-9j9l6\" (UID: \"e5b6c74f-f7d5-498f-819b-774611df756f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-9j9l6"
Sep 08 10:02:54.357363 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.357332    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5b6c74f-f7d5-498f-819b-774611df756f-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-9j9l6\" (UID: \"e5b6c74f-f7d5-498f-819b-774611df756f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-9j9l6"
Sep 08 10:02:54.357589 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.357368    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ae8d0e32-e1b2-42d6-9bcd-e34035c43977-root\") pod \"node-exporter-pws49\" (UID: \"ae8d0e32-e1b2-42d6-9bcd-e34035c43977\") " pod="openshift-monitoring/node-exporter-pws49"
Sep 08 10:02:54.357589 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.357397    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ae8d0e32-e1b2-42d6-9bcd-e34035c43977-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pws49\" (UID: \"ae8d0e32-e1b2-42d6-9bcd-e34035c43977\") " pod="openshift-monitoring/node-exporter-pws49"
Sep 08 10:02:54.357589 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.357429    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ae8d0e32-e1b2-42d6-9bcd-e34035c43977-node-exporter-textfile\") pod \"node-exporter-pws49\" (UID: \"ae8d0e32-e1b2-42d6-9bcd-e34035c43977\") " pod="openshift-monitoring/node-exporter-pws49"
Sep 08 10:02:54.357589 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.357455    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4jhq\" (UniqueName: \"kubernetes.io/projected/e5b6c74f-f7d5-498f-819b-774611df756f-kube-api-access-j4jhq\") pod \"kube-state-metrics-74cb57df7-9j9l6\" (UID: \"e5b6c74f-f7d5-498f-819b-774611df756f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-9j9l6"
Sep 08 10:02:54.357589 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.357493    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ae8d0e32-e1b2-42d6-9bcd-e34035c43977-node-exporter-tls\") pod \"node-exporter-pws49\" (UID: \"ae8d0e32-e1b2-42d6-9bcd-e34035c43977\") " pod="openshift-monitoring/node-exporter-pws49"
Sep 08 10:02:54.430945 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.430910    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:02:54.458363 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.458334    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e5b6c74f-f7d5-498f-819b-774611df756f-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-9j9l6\" (UID: \"e5b6c74f-f7d5-498f-819b-774611df756f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-9j9l6"
Sep 08 10:02:54.458520 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.458370    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5b6c74f-f7d5-498f-819b-774611df756f-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-9j9l6\" (UID: \"e5b6c74f-f7d5-498f-819b-774611df756f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-9j9l6"
Sep 08 10:02:54.458520 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.458392    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ae8d0e32-e1b2-42d6-9bcd-e34035c43977-root\") pod \"node-exporter-pws49\" (UID: \"ae8d0e32-e1b2-42d6-9bcd-e34035c43977\") " pod="openshift-monitoring/node-exporter-pws49"
Sep 08 10:02:54.458520 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.458410    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ae8d0e32-e1b2-42d6-9bcd-e34035c43977-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pws49\" (UID: \"ae8d0e32-e1b2-42d6-9bcd-e34035c43977\") " pod="openshift-monitoring/node-exporter-pws49"
Sep 08 10:02:54.458520 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.458429    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ae8d0e32-e1b2-42d6-9bcd-e34035c43977-node-exporter-textfile\") pod \"node-exporter-pws49\" (UID: \"ae8d0e32-e1b2-42d6-9bcd-e34035c43977\") " pod="openshift-monitoring/node-exporter-pws49"
Sep 08 10:02:54.458520 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.458444    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4jhq\" (UniqueName: \"kubernetes.io/projected/e5b6c74f-f7d5-498f-819b-774611df756f-kube-api-access-j4jhq\") pod \"kube-state-metrics-74cb57df7-9j9l6\" (UID: \"e5b6c74f-f7d5-498f-819b-774611df756f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-9j9l6"
Sep 08 10:02:54.458520 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.458481    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ae8d0e32-e1b2-42d6-9bcd-e34035c43977-root\") pod \"node-exporter-pws49\" (UID: \"ae8d0e32-e1b2-42d6-9bcd-e34035c43977\") " pod="openshift-monitoring/node-exporter-pws49"
Sep 08 10:02:54.458847 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.458556    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ae8d0e32-e1b2-42d6-9bcd-e34035c43977-node-exporter-tls\") pod \"node-exporter-pws49\" (UID: \"ae8d0e32-e1b2-42d6-9bcd-e34035c43977\") " pod="openshift-monitoring/node-exporter-pws49"
Sep 08 10:02:54.458847 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.458599    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae8d0e32-e1b2-42d6-9bcd-e34035c43977-metrics-client-ca\") pod \"node-exporter-pws49\" (UID: \"ae8d0e32-e1b2-42d6-9bcd-e34035c43977\") " pod="openshift-monitoring/node-exporter-pws49"
Sep 08 10:02:54.458847 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:02:54.458620    2579 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 08 10:02:54.458847 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.458626    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ea2bf78c-a59f-4206-b2e3-769f6b81347f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-t25pb\" (UID: \"ea2bf78c-a59f-4206-b2e3-769f6b81347f\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t25pb"
Sep 08 10:02:54.458847 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:02:54.458685    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ae8d0e32-e1b2-42d6-9bcd-e34035c43977-node-exporter-tls podName:ae8d0e32-e1b2-42d6-9bcd-e34035c43977 nodeName:}" failed. No retries permitted until 2026-09-08 10:02:54.958664144 +0000 UTC m=+288.654263035 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ae8d0e32-e1b2-42d6-9bcd-e34035c43977-node-exporter-tls") pod "node-exporter-pws49" (UID: "ae8d0e32-e1b2-42d6-9bcd-e34035c43977") : secret "node-exporter-tls" not found
Sep 08 10:02:54.458847 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.458707    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ea2bf78c-a59f-4206-b2e3-769f6b81347f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-t25pb\" (UID: \"ea2bf78c-a59f-4206-b2e3-769f6b81347f\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t25pb"
Sep 08 10:02:54.458847 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:02:54.458742    2579 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Sep 08 10:02:54.458847 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.458748    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea2bf78c-a59f-4206-b2e3-769f6b81347f-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-t25pb\" (UID: \"ea2bf78c-a59f-4206-b2e3-769f6b81347f\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t25pb"
Sep 08 10:02:54.458847 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.458775    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e5b6c74f-f7d5-498f-819b-774611df756f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-9j9l6\" (UID: \"e5b6c74f-f7d5-498f-819b-774611df756f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-9j9l6"
Sep 08 10:02:54.458847 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:02:54.458797    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ea2bf78c-a59f-4206-b2e3-769f6b81347f-openshift-state-metrics-tls podName:ea2bf78c-a59f-4206-b2e3-769f6b81347f nodeName:}" failed. No retries permitted until 2026-09-08 10:02:54.958781824 +0000 UTC m=+288.654380718 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/ea2bf78c-a59f-4206-b2e3-769f6b81347f-openshift-state-metrics-tls") pod "openshift-state-metrics-657fd6c54-t25pb" (UID: "ea2bf78c-a59f-4206-b2e3-769f6b81347f") : secret "openshift-state-metrics-tls" not found
Sep 08 10:02:54.458847 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.458798    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e5b6c74f-f7d5-498f-819b-774611df756f-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-9j9l6\" (UID: \"e5b6c74f-f7d5-498f-819b-774611df756f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-9j9l6"
Sep 08 10:02:54.458847 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.458824    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ae8d0e32-e1b2-42d6-9bcd-e34035c43977-sys\") pod \"node-exporter-pws49\" (UID: \"ae8d0e32-e1b2-42d6-9bcd-e34035c43977\") " pod="openshift-monitoring/node-exporter-pws49"
Sep 08 10:02:54.459431 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.458862    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ae8d0e32-e1b2-42d6-9bcd-e34035c43977-node-exporter-wtmp\") pod \"node-exporter-pws49\" (UID: \"ae8d0e32-e1b2-42d6-9bcd-e34035c43977\") " pod="openshift-monitoring/node-exporter-pws49"
Sep 08 10:02:54.459431 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.458878    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ae8d0e32-e1b2-42d6-9bcd-e34035c43977-node-exporter-textfile\") pod \"node-exporter-pws49\" (UID: \"ae8d0e32-e1b2-42d6-9bcd-e34035c43977\") " pod="openshift-monitoring/node-exporter-pws49"
Sep 08 10:02:54.459431 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.458895    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e5b6c74f-f7d5-498f-819b-774611df756f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-9j9l6\" (UID: \"e5b6c74f-f7d5-498f-819b-774611df756f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-9j9l6"
Sep 08 10:02:54.459431 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.458933    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ae8d0e32-e1b2-42d6-9bcd-e34035c43977-sys\") pod \"node-exporter-pws49\" (UID: \"ae8d0e32-e1b2-42d6-9bcd-e34035c43977\") " pod="openshift-monitoring/node-exporter-pws49"
Sep 08 10:02:54.459431 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.458934    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ae8d0e32-e1b2-42d6-9bcd-e34035c43977-node-exporter-accelerators-collector-config\") pod \"node-exporter-pws49\" (UID: \"ae8d0e32-e1b2-42d6-9bcd-e34035c43977\") " pod="openshift-monitoring/node-exporter-pws49"
Sep 08 10:02:54.459431 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.458977    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5b6c74f-f7d5-498f-819b-774611df756f-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-9j9l6\" (UID: \"e5b6c74f-f7d5-498f-819b-774611df756f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-9j9l6"
Sep 08 10:02:54.459431 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.459000    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stjnw\" (UniqueName: \"kubernetes.io/projected/ae8d0e32-e1b2-42d6-9bcd-e34035c43977-kube-api-access-stjnw\") pod \"node-exporter-pws49\" (UID: \"ae8d0e32-e1b2-42d6-9bcd-e34035c43977\") " pod="openshift-monitoring/node-exporter-pws49"
Sep 08 10:02:54.459431 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.459029    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hn8wl\" (UniqueName: \"kubernetes.io/projected/ea2bf78c-a59f-4206-b2e3-769f6b81347f-kube-api-access-hn8wl\") pod \"openshift-state-metrics-657fd6c54-t25pb\" (UID: \"ea2bf78c-a59f-4206-b2e3-769f6b81347f\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t25pb"
Sep 08 10:02:54.459431 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.459046    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ae8d0e32-e1b2-42d6-9bcd-e34035c43977-node-exporter-wtmp\") pod \"node-exporter-pws49\" (UID: \"ae8d0e32-e1b2-42d6-9bcd-e34035c43977\") " pod="openshift-monitoring/node-exporter-pws49"
Sep 08 10:02:54.459431 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:02:54.459127    2579 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Sep 08 10:02:54.459431 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.459145    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5b6c74f-f7d5-498f-819b-774611df756f-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-9j9l6\" (UID: \"e5b6c74f-f7d5-498f-819b-774611df756f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-9j9l6"
Sep 08 10:02:54.459431 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:02:54.459169    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5b6c74f-f7d5-498f-819b-774611df756f-kube-state-metrics-tls podName:e5b6c74f-f7d5-498f-819b-774611df756f nodeName:}" failed. No retries permitted until 2026-09-08 10:02:54.959154779 +0000 UTC m=+288.654753670 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/e5b6c74f-f7d5-498f-819b-774611df756f-kube-state-metrics-tls") pod "kube-state-metrics-74cb57df7-9j9l6" (UID: "e5b6c74f-f7d5-498f-819b-774611df756f") : secret "kube-state-metrics-tls" not found
Sep 08 10:02:54.459431 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.459375    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ae8d0e32-e1b2-42d6-9bcd-e34035c43977-metrics-client-ca\") pod \"node-exporter-pws49\" (UID: \"ae8d0e32-e1b2-42d6-9bcd-e34035c43977\") " pod="openshift-monitoring/node-exporter-pws49"
Sep 08 10:02:54.460103 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.459638    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e5b6c74f-f7d5-498f-819b-774611df756f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-9j9l6\" (UID: \"e5b6c74f-f7d5-498f-819b-774611df756f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-9j9l6"
Sep 08 10:02:54.460103 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.459778    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ae8d0e32-e1b2-42d6-9bcd-e34035c43977-node-exporter-accelerators-collector-config\") pod \"node-exporter-pws49\" (UID: \"ae8d0e32-e1b2-42d6-9bcd-e34035c43977\") " pod="openshift-monitoring/node-exporter-pws49"
Sep 08 10:02:54.460103 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.460063    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea2bf78c-a59f-4206-b2e3-769f6b81347f-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-t25pb\" (UID: \"ea2bf78c-a59f-4206-b2e3-769f6b81347f\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t25pb"
Sep 08 10:02:54.461007 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.460983    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ae8d0e32-e1b2-42d6-9bcd-e34035c43977-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-pws49\" (UID: \"ae8d0e32-e1b2-42d6-9bcd-e34035c43977\") " pod="openshift-monitoring/node-exporter-pws49"
Sep 08 10:02:54.461870 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.461850    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ea2bf78c-a59f-4206-b2e3-769f6b81347f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-t25pb\" (UID: \"ea2bf78c-a59f-4206-b2e3-769f6b81347f\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t25pb"
Sep 08 10:02:54.461988 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.461973    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e5b6c74f-f7d5-498f-819b-774611df756f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-9j9l6\" (UID: \"e5b6c74f-f7d5-498f-819b-774611df756f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-9j9l6"
Sep 08 10:02:54.478130 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.478106    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4jhq\" (UniqueName: \"kubernetes.io/projected/e5b6c74f-f7d5-498f-819b-774611df756f-kube-api-access-j4jhq\") pod \"kube-state-metrics-74cb57df7-9j9l6\" (UID: \"e5b6c74f-f7d5-498f-819b-774611df756f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-9j9l6"
Sep 08 10:02:54.478352 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.478334    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stjnw\" (UniqueName: \"kubernetes.io/projected/ae8d0e32-e1b2-42d6-9bcd-e34035c43977-kube-api-access-stjnw\") pod \"node-exporter-pws49\" (UID: \"ae8d0e32-e1b2-42d6-9bcd-e34035c43977\") " pod="openshift-monitoring/node-exporter-pws49"
Sep 08 10:02:54.481496 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.481477    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn8wl\" (UniqueName: \"kubernetes.io/projected/ea2bf78c-a59f-4206-b2e3-769f6b81347f-kube-api-access-hn8wl\") pod \"openshift-state-metrics-657fd6c54-t25pb\" (UID: \"ea2bf78c-a59f-4206-b2e3-769f6b81347f\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t25pb"
Sep 08 10:02:54.661672 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.661634    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w56bl" event={"ID":"e35db162-1476-43d4-a08f-b95ca644a417","Type":"ContainerStarted","Data":"53a399e0351f4904f437adc44999dcddd85edd76d2a851bf30ce28f71d3d2fb4"}
Sep 08 10:02:54.962236 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.962198    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5b6c74f-f7d5-498f-819b-774611df756f-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-9j9l6\" (UID: \"e5b6c74f-f7d5-498f-819b-774611df756f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-9j9l6"
Sep 08 10:02:54.962409 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.962261    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ae8d0e32-e1b2-42d6-9bcd-e34035c43977-node-exporter-tls\") pod \"node-exporter-pws49\" (UID: \"ae8d0e32-e1b2-42d6-9bcd-e34035c43977\") " pod="openshift-monitoring/node-exporter-pws49"
Sep 08 10:02:54.962409 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.962296    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ea2bf78c-a59f-4206-b2e3-769f6b81347f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-t25pb\" (UID: \"ea2bf78c-a59f-4206-b2e3-769f6b81347f\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t25pb"
Sep 08 10:02:54.964690 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.964666    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/ea2bf78c-a59f-4206-b2e3-769f6b81347f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-t25pb\" (UID: \"ea2bf78c-a59f-4206-b2e3-769f6b81347f\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t25pb"
Sep 08 10:02:54.965005 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.964670    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ae8d0e32-e1b2-42d6-9bcd-e34035c43977-node-exporter-tls\") pod \"node-exporter-pws49\" (UID: \"ae8d0e32-e1b2-42d6-9bcd-e34035c43977\") " pod="openshift-monitoring/node-exporter-pws49"
Sep 08 10:02:54.965005 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:54.964802    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e5b6c74f-f7d5-498f-819b-774611df756f-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-9j9l6\" (UID: \"e5b6c74f-f7d5-498f-819b-774611df756f\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-9j9l6"
Sep 08 10:02:55.151916 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:55.151872    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t25pb"
Sep 08 10:02:55.169165 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:55.169140    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-9j9l6"
Sep 08 10:02:55.198792 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:55.198760    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-pws49"
Sep 08 10:02:55.211894 ip-10-0-132-96 kubenswrapper[2579]: W0908 10:02:55.211853    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae8d0e32_e1b2_42d6_9bcd_e34035c43977.slice/crio-dab92979cd3696d8097ee7463cb6bf899582909d5616507edf12059f8f2acada WatchSource:0}: Error finding container dab92979cd3696d8097ee7463cb6bf899582909d5616507edf12059f8f2acada: Status 404 returned error can't find the container with id dab92979cd3696d8097ee7463cb6bf899582909d5616507edf12059f8f2acada
Sep 08 10:02:55.430227 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:55.430195    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-t25pb"]
Sep 08 10:02:55.433379 ip-10-0-132-96 kubenswrapper[2579]: W0908 10:02:55.433352    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea2bf78c_a59f_4206_b2e3_769f6b81347f.slice/crio-8a15234f76e3196cf26c8c6b2023492461a09b3e6af1a0f3ac2f2dfb3fde5507 WatchSource:0}: Error finding container 8a15234f76e3196cf26c8c6b2023492461a09b3e6af1a0f3ac2f2dfb3fde5507: Status 404 returned error can't find the container with id 8a15234f76e3196cf26c8c6b2023492461a09b3e6af1a0f3ac2f2dfb3fde5507
Sep 08 10:02:55.470441 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:55.470373    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-9j9l6"]
Sep 08 10:02:55.473481 ip-10-0-132-96 kubenswrapper[2579]: W0908 10:02:55.473452    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5b6c74f_f7d5_498f_819b_774611df756f.slice/crio-049fbd79a380a16dceec06d8ee10d69146386931adbfa93392bb1a7e6f1e6ec6 WatchSource:0}: Error finding container 049fbd79a380a16dceec06d8ee10d69146386931adbfa93392bb1a7e6f1e6ec6: Status 404 returned error can't find the container with id 049fbd79a380a16dceec06d8ee10d69146386931adbfa93392bb1a7e6f1e6ec6
Sep 08 10:02:55.666401 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:55.666366    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t25pb" event={"ID":"ea2bf78c-a59f-4206-b2e3-769f6b81347f","Type":"ContainerStarted","Data":"1b1b471f8afa39816d35a25970cf994225148a5e4e86041e29efb81dc57f86ac"}
Sep 08 10:02:55.666567 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:55.666430    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t25pb" event={"ID":"ea2bf78c-a59f-4206-b2e3-769f6b81347f","Type":"ContainerStarted","Data":"f06e6e622d8780826e8860a3136f3120106ec018134a75181f36ae87ed98e89c"}
Sep 08 10:02:55.666567 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:55.666461    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t25pb" event={"ID":"ea2bf78c-a59f-4206-b2e3-769f6b81347f","Type":"ContainerStarted","Data":"8a15234f76e3196cf26c8c6b2023492461a09b3e6af1a0f3ac2f2dfb3fde5507"}
Sep 08 10:02:55.668115 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:55.668090    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w56bl" event={"ID":"e35db162-1476-43d4-a08f-b95ca644a417","Type":"ContainerStarted","Data":"a64397e14c69056347860ddabfc33787c988afeae9e8abd16c40c6d0955d6092"}
Sep 08 10:02:55.668246 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:55.668199    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-w56bl"
Sep 08 10:02:55.669330 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:55.669309    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pws49" event={"ID":"ae8d0e32-e1b2-42d6-9bcd-e34035c43977","Type":"ContainerStarted","Data":"dab92979cd3696d8097ee7463cb6bf899582909d5616507edf12059f8f2acada"}
Sep 08 10:02:55.670468 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:55.670449    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-9j9l6" event={"ID":"e5b6c74f-f7d5-498f-819b-774611df756f","Type":"ContainerStarted","Data":"049fbd79a380a16dceec06d8ee10d69146386931adbfa93392bb1a7e6f1e6ec6"}
Sep 08 10:02:56.147348 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:56.147313    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:02:56.228789 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:56.228727    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-w56bl" podStartSLOduration=252.243704882 podStartE2EDuration="4m14.228703119s" totalImagesPullingTime="1.984998237s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 09:58:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:02:55.691162691 +0000 UTC m=+289.386761592" watchObservedRunningTime="2026-09-08 10:02:56.228703119 +0000 UTC m=+289.924302035"
Sep 08 10:02:56.230038 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:56.230012    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-68c8ff8794-bvptf"]
Sep 08 10:02:56.233993 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:56.233971    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-68c8ff8794-bvptf"
Sep 08 10:02:56.237280 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:56.236757    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 08 10:02:56.237280 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:56.236916    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-1dlod4ogeo9es\""
Sep 08 10:02:56.237280 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:56.236922    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 08 10:02:56.237280 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:56.237115    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-6bhtl\""
Sep 08 10:02:56.237280 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:56.237185    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 08 10:02:56.238427 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:56.238058    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 08 10:02:56.238427 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:56.238146    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 08 10:02:56.245168 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:56.245089    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-68c8ff8794-bvptf"]
Sep 08 10:02:56.272903 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:56.272862    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f157192f-2fa4-486c-b1e2-645848557a0a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-68c8ff8794-bvptf\" (UID: \"f157192f-2fa4-486c-b1e2-645848557a0a\") " pod="openshift-monitoring/thanos-querier-68c8ff8794-bvptf"
Sep 08 10:02:56.273034 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:56.272905    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f157192f-2fa4-486c-b1e2-645848557a0a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-68c8ff8794-bvptf\" (UID: \"f157192f-2fa4-486c-b1e2-645848557a0a\") " pod="openshift-monitoring/thanos-querier-68c8ff8794-bvptf"
Sep 08 10:02:56.273034 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:56.273003    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f157192f-2fa4-486c-b1e2-645848557a0a-metrics-client-ca\") pod \"thanos-querier-68c8ff8794-bvptf\" (UID: \"f157192f-2fa4-486c-b1e2-645848557a0a\") " pod="openshift-monitoring/thanos-querier-68c8ff8794-bvptf"
Sep 08 10:02:56.273153 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:56.273036    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f157192f-2fa4-486c-b1e2-645848557a0a-secret-grpc-tls\") pod \"thanos-querier-68c8ff8794-bvptf\" (UID: \"f157192f-2fa4-486c-b1e2-645848557a0a\") " pod="openshift-monitoring/thanos-querier-68c8ff8794-bvptf"
Sep 08 10:02:56.273153 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:56.273072    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f157192f-2fa4-486c-b1e2-645848557a0a-secret-thanos-querier-tls\") pod \"thanos-querier-68c8ff8794-bvptf\" (UID: \"f157192f-2fa4-486c-b1e2-645848557a0a\") " pod="openshift-monitoring/thanos-querier-68c8ff8794-bvptf"
Sep 08 10:02:56.273254 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:56.273172    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrxg4\" (UniqueName: \"kubernetes.io/projected/f157192f-2fa4-486c-b1e2-645848557a0a-kube-api-access-qrxg4\") pod \"thanos-querier-68c8ff8794-bvptf\" (UID: \"f157192f-2fa4-486c-b1e2-645848557a0a\") " pod="openshift-monitoring/thanos-querier-68c8ff8794-bvptf"
Sep 08 10:02:56.273254 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:56.273211    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f157192f-2fa4-486c-b1e2-645848557a0a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-68c8ff8794-bvptf\" (UID: \"f157192f-2fa4-486c-b1e2-645848557a0a\") " pod="openshift-monitoring/thanos-querier-68c8ff8794-bvptf"
Sep 08 10:02:56.273254 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:56.273240    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f157192f-2fa4-486c-b1e2-645848557a0a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-68c8ff8794-bvptf\" (UID: \"f157192f-2fa4-486c-b1e2-645848557a0a\") " pod="openshift-monitoring/thanos-querier-68c8ff8794-bvptf"
Sep 08 10:02:56.374510 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:56.374479    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f157192f-2fa4-486c-b1e2-645848557a0a-secret-thanos-querier-tls\") pod \"thanos-querier-68c8ff8794-bvptf\" (UID: \"f157192f-2fa4-486c-b1e2-645848557a0a\") " pod="openshift-monitoring/thanos-querier-68c8ff8794-bvptf"
Sep 08 10:02:56.374696 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:56.374531    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrxg4\" (UniqueName: \"kubernetes.io/projected/f157192f-2fa4-486c-b1e2-645848557a0a-kube-api-access-qrxg4\") pod \"thanos-querier-68c8ff8794-bvptf\" (UID: \"f157192f-2fa4-486c-b1e2-645848557a0a\") " pod="openshift-monitoring/thanos-querier-68c8ff8794-bvptf"
Sep 08 10:02:56.374696 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:56.374585    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f157192f-2fa4-486c-b1e2-645848557a0a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-68c8ff8794-bvptf\" (UID: \"f157192f-2fa4-486c-b1e2-645848557a0a\") " pod="openshift-monitoring/thanos-querier-68c8ff8794-bvptf"
Sep 08 10:02:56.374801 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:56.374608    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f157192f-2fa4-486c-b1e2-645848557a0a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-68c8ff8794-bvptf\" (UID: \"f157192f-2fa4-486c-b1e2-645848557a0a\") " pod="openshift-monitoring/thanos-querier-68c8ff8794-bvptf"
Sep 08 10:02:56.374801 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:56.374784    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f157192f-2fa4-486c-b1e2-645848557a0a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-68c8ff8794-bvptf\" (UID: \"f157192f-2fa4-486c-b1e2-645848557a0a\") " pod="openshift-monitoring/thanos-querier-68c8ff8794-bvptf"
Sep 08 10:02:56.374897 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:56.374817    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f157192f-2fa4-486c-b1e2-645848557a0a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-68c8ff8794-bvptf\" (UID: \"f157192f-2fa4-486c-b1e2-645848557a0a\") " pod="openshift-monitoring/thanos-querier-68c8ff8794-bvptf"
Sep 08 10:02:56.374897 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:56.374891    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f157192f-2fa4-486c-b1e2-645848557a0a-metrics-client-ca\") pod \"thanos-querier-68c8ff8794-bvptf\" (UID: \"f157192f-2fa4-486c-b1e2-645848557a0a\") " pod="openshift-monitoring/thanos-querier-68c8ff8794-bvptf"
Sep 08 10:02:56.374994 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:56.374923    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f157192f-2fa4-486c-b1e2-645848557a0a-secret-grpc-tls\") pod \"thanos-querier-68c8ff8794-bvptf\" (UID: \"f157192f-2fa4-486c-b1e2-645848557a0a\") " pod="openshift-monitoring/thanos-querier-68c8ff8794-bvptf"
Sep 08 10:02:56.376009 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:56.375962    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f157192f-2fa4-486c-b1e2-645848557a0a-metrics-client-ca\") pod \"thanos-querier-68c8ff8794-bvptf\" (UID: \"f157192f-2fa4-486c-b1e2-645848557a0a\") " pod="openshift-monitoring/thanos-querier-68c8ff8794-bvptf"
Sep 08 10:02:56.377802 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:56.377759    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/f157192f-2fa4-486c-b1e2-645848557a0a-secret-thanos-querier-tls\") pod \"thanos-querier-68c8ff8794-bvptf\" (UID: \"f157192f-2fa4-486c-b1e2-645848557a0a\") " pod="openshift-monitoring/thanos-querier-68c8ff8794-bvptf"
Sep 08 10:02:56.377894 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:56.377855    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f157192f-2fa4-486c-b1e2-645848557a0a-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-68c8ff8794-bvptf\" (UID: \"f157192f-2fa4-486c-b1e2-645848557a0a\") " pod="openshift-monitoring/thanos-querier-68c8ff8794-bvptf"
Sep 08 10:02:56.378277 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:56.378246    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/f157192f-2fa4-486c-b1e2-645848557a0a-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-68c8ff8794-bvptf\" (UID: \"f157192f-2fa4-486c-b1e2-645848557a0a\") " pod="openshift-monitoring/thanos-querier-68c8ff8794-bvptf"
Sep 08 10:02:56.378421 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:56.378396    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f157192f-2fa4-486c-b1e2-645848557a0a-secret-grpc-tls\") pod \"thanos-querier-68c8ff8794-bvptf\" (UID: \"f157192f-2fa4-486c-b1e2-645848557a0a\") " pod="openshift-monitoring/thanos-querier-68c8ff8794-bvptf"
Sep 08 10:02:56.378489 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:56.378444    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/f157192f-2fa4-486c-b1e2-645848557a0a-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-68c8ff8794-bvptf\" (UID: \"f157192f-2fa4-486c-b1e2-645848557a0a\") " pod="openshift-monitoring/thanos-querier-68c8ff8794-bvptf"
Sep 08 10:02:56.378939 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:56.378917    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f157192f-2fa4-486c-b1e2-645848557a0a-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-68c8ff8794-bvptf\" (UID: \"f157192f-2fa4-486c-b1e2-645848557a0a\") " pod="openshift-monitoring/thanos-querier-68c8ff8794-bvptf"
Sep 08 10:02:56.383269 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:56.383249    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrxg4\" (UniqueName: \"kubernetes.io/projected/f157192f-2fa4-486c-b1e2-645848557a0a-kube-api-access-qrxg4\") pod \"thanos-querier-68c8ff8794-bvptf\" (UID: \"f157192f-2fa4-486c-b1e2-645848557a0a\") " pod="openshift-monitoring/thanos-querier-68c8ff8794-bvptf"
Sep 08 10:02:56.546348 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:56.546315    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-68c8ff8794-bvptf"
Sep 08 10:02:56.676847 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:56.676759    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t25pb" event={"ID":"ea2bf78c-a59f-4206-b2e3-769f6b81347f","Type":"ContainerStarted","Data":"9453672da3d80f48ca3e702b4a5d42bc81bfcdb43a3f678ea06529646e42c769"}
Sep 08 10:02:56.696286 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:56.696235    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-t25pb" podStartSLOduration=1.8592395210000001 podStartE2EDuration="2.696220231s" totalImagesPullingTime="836.98071ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:02:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:02:56.694766956 +0000 UTC m=+290.390365855" watchObservedRunningTime="2026-09-08 10:02:56.696220231 +0000 UTC m=+290.391819131"
Sep 08 10:02:57.103318 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:57.103276    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-68c8ff8794-bvptf"]
Sep 08 10:02:57.105946 ip-10-0-132-96 kubenswrapper[2579]: W0908 10:02:57.105910    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf157192f_2fa4_486c_b1e2_645848557a0a.slice/crio-27919188529e7447724ef584e1fb0bca66fbb2e06bed529cd1c7428b4818579b WatchSource:0}: Error finding container 27919188529e7447724ef584e1fb0bca66fbb2e06bed529cd1c7428b4818579b: Status 404 returned error can't find the container with id 27919188529e7447724ef584e1fb0bca66fbb2e06bed529cd1c7428b4818579b
Sep 08 10:02:57.683399 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:57.683358    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68c8ff8794-bvptf" event={"ID":"f157192f-2fa4-486c-b1e2-645848557a0a","Type":"ContainerStarted","Data":"27919188529e7447724ef584e1fb0bca66fbb2e06bed529cd1c7428b4818579b"}
Sep 08 10:02:57.686021 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:57.685994    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-9j9l6" event={"ID":"e5b6c74f-f7d5-498f-819b-774611df756f","Type":"ContainerStarted","Data":"9e174c92a99922a06438904666c0d43f09db28214c853335eb841ec5a7a1f74e"}
Sep 08 10:02:57.686150 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:57.686046    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-9j9l6" event={"ID":"e5b6c74f-f7d5-498f-819b-774611df756f","Type":"ContainerStarted","Data":"c82ef07e2df0db9e9e7fb271d33f77fc92e8aa58140231578130b4cc0ba4dd02"}
Sep 08 10:02:57.686150 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:57.686069    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-9j9l6" event={"ID":"e5b6c74f-f7d5-498f-819b-774611df756f","Type":"ContainerStarted","Data":"f36a5428dc4bb0b6c2caf2793ce3ee1eb338d5b25132ce69050239d74a68ca89"}
Sep 08 10:02:57.706558 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:57.706494    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-9j9l6" podStartSLOduration=2.303201357 podStartE2EDuration="3.706481007s" totalImagesPullingTime="1.40327965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:02:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:02:57.704805353 +0000 UTC m=+291.400404256" watchObservedRunningTime="2026-09-08 10:02:57.706481007 +0000 UTC m=+291.402079906"
Sep 08 10:02:58.652059 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:58.652025    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-595bdb6d6-xpshs"]
Sep 08 10:02:58.657348 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:58.657168    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-595bdb6d6-xpshs"
Sep 08 10:02:58.661698 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:58.661498    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 08 10:02:58.661698 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:58.661532    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 08 10:02:58.661698 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:58.661564    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-jjmz4\""
Sep 08 10:02:58.661698 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:58.661581    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 08 10:02:58.661698 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:58.661584    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-c5aa88lsb3k6q\""
Sep 08 10:02:58.661698 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:58.661638    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 08 10:02:58.670444 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:58.670395    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-595bdb6d6-xpshs"]
Sep 08 10:02:58.692010 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:58.691983    2579 generic.go:356] "Generic (PLEG): container finished" podID="ae8d0e32-e1b2-42d6-9bcd-e34035c43977" containerID="f45abfe5f58759a14b202aba71e830998c43f012540c3cfae2d0e744b5b3b6fc" exitCode=0
Sep 08 10:02:58.692306 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:58.692068    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pws49" event={"ID":"ae8d0e32-e1b2-42d6-9bcd-e34035c43977","Type":"ContainerDied","Data":"f45abfe5f58759a14b202aba71e830998c43f012540c3cfae2d0e744b5b3b6fc"}
Sep 08 10:02:58.693852 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:58.693834    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8b4376f5-2a08-4626-afdc-651fae8159e3-client-ca-bundle\") pod \"metrics-server-595bdb6d6-xpshs\" (UID: \"8b4376f5-2a08-4626-afdc-651fae8159e3\") " pod="openshift-monitoring/metrics-server-595bdb6d6-xpshs"
Sep 08 10:02:58.693921 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:58.693864    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8b4376f5-2a08-4626-afdc-651fae8159e3-metrics-server-audit-profiles\") pod \"metrics-server-595bdb6d6-xpshs\" (UID: \"8b4376f5-2a08-4626-afdc-651fae8159e3\") " pod="openshift-monitoring/metrics-server-595bdb6d6-xpshs"
Sep 08 10:02:58.693921 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:58.693881    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gq72\" (UniqueName: \"kubernetes.io/projected/8b4376f5-2a08-4626-afdc-651fae8159e3-kube-api-access-5gq72\") pod \"metrics-server-595bdb6d6-xpshs\" (UID: \"8b4376f5-2a08-4626-afdc-651fae8159e3\") " pod="openshift-monitoring/metrics-server-595bdb6d6-xpshs"
Sep 08 10:02:58.693921 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:58.693909    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b4376f5-2a08-4626-afdc-651fae8159e3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-595bdb6d6-xpshs\" (UID: \"8b4376f5-2a08-4626-afdc-651fae8159e3\") " pod="openshift-monitoring/metrics-server-595bdb6d6-xpshs"
Sep 08 10:02:58.694053 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:58.694033    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8b4376f5-2a08-4626-afdc-651fae8159e3-secret-metrics-server-client-certs\") pod \"metrics-server-595bdb6d6-xpshs\" (UID: \"8b4376f5-2a08-4626-afdc-651fae8159e3\") " pod="openshift-monitoring/metrics-server-595bdb6d6-xpshs"
Sep 08 10:02:58.694099 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:58.694084    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8b4376f5-2a08-4626-afdc-651fae8159e3-audit-log\") pod \"metrics-server-595bdb6d6-xpshs\" (UID: \"8b4376f5-2a08-4626-afdc-651fae8159e3\") " pod="openshift-monitoring/metrics-server-595bdb6d6-xpshs"
Sep 08 10:02:58.694233 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:58.694216    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8b4376f5-2a08-4626-afdc-651fae8159e3-secret-metrics-server-tls\") pod \"metrics-server-595bdb6d6-xpshs\" (UID: \"8b4376f5-2a08-4626-afdc-651fae8159e3\") " pod="openshift-monitoring/metrics-server-595bdb6d6-xpshs"
Sep 08 10:02:58.795432 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:58.795404    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8b4376f5-2a08-4626-afdc-651fae8159e3-audit-log\") pod \"metrics-server-595bdb6d6-xpshs\" (UID: \"8b4376f5-2a08-4626-afdc-651fae8159e3\") " pod="openshift-monitoring/metrics-server-595bdb6d6-xpshs"
Sep 08 10:02:58.795551 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:58.795448    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8b4376f5-2a08-4626-afdc-651fae8159e3-secret-metrics-server-tls\") pod \"metrics-server-595bdb6d6-xpshs\" (UID: \"8b4376f5-2a08-4626-afdc-651fae8159e3\") " pod="openshift-monitoring/metrics-server-595bdb6d6-xpshs"
Sep 08 10:02:58.795619 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:58.795530    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8b4376f5-2a08-4626-afdc-651fae8159e3-client-ca-bundle\") pod \"metrics-server-595bdb6d6-xpshs\" (UID: \"8b4376f5-2a08-4626-afdc-651fae8159e3\") " pod="openshift-monitoring/metrics-server-595bdb6d6-xpshs"
Sep 08 10:02:58.795619 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:58.795584    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8b4376f5-2a08-4626-afdc-651fae8159e3-metrics-server-audit-profiles\") pod \"metrics-server-595bdb6d6-xpshs\" (UID: \"8b4376f5-2a08-4626-afdc-651fae8159e3\") " pod="openshift-monitoring/metrics-server-595bdb6d6-xpshs"
Sep 08 10:02:58.795619 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:58.795608    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gq72\" (UniqueName: \"kubernetes.io/projected/8b4376f5-2a08-4626-afdc-651fae8159e3-kube-api-access-5gq72\") pod \"metrics-server-595bdb6d6-xpshs\" (UID: \"8b4376f5-2a08-4626-afdc-651fae8159e3\") " pod="openshift-monitoring/metrics-server-595bdb6d6-xpshs"
Sep 08 10:02:58.795770 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:58.795693    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b4376f5-2a08-4626-afdc-651fae8159e3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-595bdb6d6-xpshs\" (UID: \"8b4376f5-2a08-4626-afdc-651fae8159e3\") " pod="openshift-monitoring/metrics-server-595bdb6d6-xpshs"
Sep 08 10:02:58.795825 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:58.795811    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/8b4376f5-2a08-4626-afdc-651fae8159e3-audit-log\") pod \"metrics-server-595bdb6d6-xpshs\" (UID: \"8b4376f5-2a08-4626-afdc-651fae8159e3\") " pod="openshift-monitoring/metrics-server-595bdb6d6-xpshs"
Sep 08 10:02:58.796430 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:58.796044    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8b4376f5-2a08-4626-afdc-651fae8159e3-secret-metrics-server-client-certs\") pod \"metrics-server-595bdb6d6-xpshs\" (UID: \"8b4376f5-2a08-4626-afdc-651fae8159e3\") " pod="openshift-monitoring/metrics-server-595bdb6d6-xpshs"
Sep 08 10:02:58.796883 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:58.796847    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8b4376f5-2a08-4626-afdc-651fae8159e3-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-595bdb6d6-xpshs\" (UID: \"8b4376f5-2a08-4626-afdc-651fae8159e3\") " pod="openshift-monitoring/metrics-server-595bdb6d6-xpshs"
Sep 08 10:02:58.797126 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:58.797095    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/8b4376f5-2a08-4626-afdc-651fae8159e3-metrics-server-audit-profiles\") pod \"metrics-server-595bdb6d6-xpshs\" (UID: \"8b4376f5-2a08-4626-afdc-651fae8159e3\") " pod="openshift-monitoring/metrics-server-595bdb6d6-xpshs"
Sep 08 10:02:58.798149 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:58.798127    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/8b4376f5-2a08-4626-afdc-651fae8159e3-secret-metrics-server-tls\") pod \"metrics-server-595bdb6d6-xpshs\" (UID: \"8b4376f5-2a08-4626-afdc-651fae8159e3\") " pod="openshift-monitoring/metrics-server-595bdb6d6-xpshs"
Sep 08 10:02:58.798361 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:58.798346    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/8b4376f5-2a08-4626-afdc-651fae8159e3-client-ca-bundle\") pod \"metrics-server-595bdb6d6-xpshs\" (UID: \"8b4376f5-2a08-4626-afdc-651fae8159e3\") " pod="openshift-monitoring/metrics-server-595bdb6d6-xpshs"
Sep 08 10:02:58.798526 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:58.798509    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/8b4376f5-2a08-4626-afdc-651fae8159e3-secret-metrics-server-client-certs\") pod \"metrics-server-595bdb6d6-xpshs\" (UID: \"8b4376f5-2a08-4626-afdc-651fae8159e3\") " pod="openshift-monitoring/metrics-server-595bdb6d6-xpshs"
Sep 08 10:02:58.805163 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:58.805139    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gq72\" (UniqueName: \"kubernetes.io/projected/8b4376f5-2a08-4626-afdc-651fae8159e3-kube-api-access-5gq72\") pod \"metrics-server-595bdb6d6-xpshs\" (UID: \"8b4376f5-2a08-4626-afdc-651fae8159e3\") " pod="openshift-monitoring/metrics-server-595bdb6d6-xpshs"
Sep 08 10:02:58.968109 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:58.968033    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-595bdb6d6-xpshs"
Sep 08 10:02:59.649103 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:59.649055    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-595bdb6d6-xpshs"]
Sep 08 10:02:59.651370 ip-10-0-132-96 kubenswrapper[2579]: W0908 10:02:59.651346    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b4376f5_2a08_4626_afdc_651fae8159e3.slice/crio-cb0763e6ff628c804a0aeab95b76f8b689e07c19d0bf15820c76a3eccbf68a31 WatchSource:0}: Error finding container cb0763e6ff628c804a0aeab95b76f8b689e07c19d0bf15820c76a3eccbf68a31: Status 404 returned error can't find the container with id cb0763e6ff628c804a0aeab95b76f8b689e07c19d0bf15820c76a3eccbf68a31
Sep 08 10:02:59.697369 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:59.697341    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pws49" event={"ID":"ae8d0e32-e1b2-42d6-9bcd-e34035c43977","Type":"ContainerStarted","Data":"c77460ffebe95f86dba4b9f22e526b9d868eb188a6ead4cf16c6b8dba3dab30c"}
Sep 08 10:02:59.697728 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:59.697389    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-pws49" event={"ID":"ae8d0e32-e1b2-42d6-9bcd-e34035c43977","Type":"ContainerStarted","Data":"4e3e4e1251a2e9b7732e8fe5f4102a2e06cf827a377acdb56dc9702f1fdca7fb"}
Sep 08 10:02:59.699512 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:59.699491    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68c8ff8794-bvptf" event={"ID":"f157192f-2fa4-486c-b1e2-645848557a0a","Type":"ContainerStarted","Data":"a7df37a6108c4d8e07539d0557bb4c4befe6d01b31fcfa60da8079177f919615"}
Sep 08 10:02:59.699642 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:59.699563    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68c8ff8794-bvptf" event={"ID":"f157192f-2fa4-486c-b1e2-645848557a0a","Type":"ContainerStarted","Data":"4d50ec17cdf7b8ffefec902e998ce589f1d88aea9443022ff1c9f9287e109e3a"}
Sep 08 10:02:59.699642 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:59.699596    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68c8ff8794-bvptf" event={"ID":"f157192f-2fa4-486c-b1e2-645848557a0a","Type":"ContainerStarted","Data":"7d44cb26a9c64178ac87733930b8dd0aaaf640d801e808c6d72fdce872aa7101"}
Sep 08 10:02:59.700702 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:59.700681    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-595bdb6d6-xpshs" event={"ID":"8b4376f5-2a08-4626-afdc-651fae8159e3","Type":"ContainerStarted","Data":"cb0763e6ff628c804a0aeab95b76f8b689e07c19d0bf15820c76a3eccbf68a31"}
Sep 08 10:02:59.716476 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:02:59.716428    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-pws49" podStartSLOduration=2.797916816 podStartE2EDuration="5.716412233s" totalImagesPullingTime="2.841718608s" totalInitContainerRuntime="76.776809ms" isStatefulPod=true podCreationTimestamp="2026-09-08 10:02:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:02:59.715738916 +0000 UTC m=+293.411337841" watchObservedRunningTime="2026-09-08 10:02:59.716412233 +0000 UTC m=+293.412011133"
Sep 08 10:03:02.552078 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:02.552049    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:03:02.714159 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:02.714123    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-595bdb6d6-xpshs" event={"ID":"8b4376f5-2a08-4626-afdc-651fae8159e3","Type":"ContainerStarted","Data":"a279ad54460cc56eb5d564ae617444703365efb846cfdc1e75252b8f3f9fb8d0"}
Sep 08 10:03:02.735740 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:02.735682    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-595bdb6d6-xpshs" podStartSLOduration=1.89285763 podStartE2EDuration="4.735661231s" totalImagesPullingTime="2.842803601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:02:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:03:02.735114902 +0000 UTC m=+296.430713802" watchObservedRunningTime="2026-09-08 10:03:02.735661231 +0000 UTC m=+296.431260133"
Sep 08 10:03:03.827341 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:03:03.827310    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-b5m55" podUID="3868a1c3-46c6-4940-92ed-e460b77d7cfc"
Sep 08 10:03:04.464705 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:04.464668    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:03:04.563110 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:04.563068    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:03:04.724224 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:04.724138    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68c8ff8794-bvptf" event={"ID":"f157192f-2fa4-486c-b1e2-645848557a0a","Type":"ContainerStarted","Data":"9550d0cccede76fd941ff9a5109ed5ea049e5a92b91c779165086b8507f34575"}
Sep 08 10:03:04.724391 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:04.724227    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68c8ff8794-bvptf" event={"ID":"f157192f-2fa4-486c-b1e2-645848557a0a","Type":"ContainerStarted","Data":"37921082ab7838553c87260ac1baa34431fb7df0e0e3dc7e07b0e440f0f21907"}
Sep 08 10:03:04.724391 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:04.724253    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-68c8ff8794-bvptf" event={"ID":"f157192f-2fa4-486c-b1e2-645848557a0a","Type":"ContainerStarted","Data":"9c3262243cbf57575527fbf44d576b8378ab584cf1f8af65dfb4c37eec0e328b"}
Sep 08 10:03:04.724498 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:04.724411    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-68c8ff8794-bvptf"
Sep 08 10:03:04.730064 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:04.730045    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-68c8ff8794-bvptf"
Sep 08 10:03:04.750165 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:04.750122    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-68c8ff8794-bvptf" podStartSLOduration=2.3179853870000002 podStartE2EDuration="8.750108214s" totalImagesPullingTime="6.432122827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:02:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:03:04.747819709 +0000 UTC m=+298.443418608" watchObservedRunningTime="2026-09-08 10:03:04.750108214 +0000 UTC m=+298.445707149"
Sep 08 10:03:05.032849 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:05.032816    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-ndfx2"]
Sep 08 10:03:05.036163 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:05.036146    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-ndfx2"
Sep 08 10:03:05.041439 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:05.041417    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 08 10:03:05.041567 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:05.041483    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-jz5ft\""
Sep 08 10:03:05.041567 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:05.041493    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 08 10:03:05.052353 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:05.052331    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-ndfx2"]
Sep 08 10:03:05.055928 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:05.055877    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:03:05.118974 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:05.118943    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:03:05.149687 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:05.149652    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsncx\" (UniqueName: \"kubernetes.io/projected/e3dcea29-6e18-4218-ba86-a06ccb4544ca-kube-api-access-dsncx\") pod \"downloads-85d98c998f-ndfx2\" (UID: \"e3dcea29-6e18-4218-ba86-a06ccb4544ca\") " pod="openshift-console/downloads-85d98c998f-ndfx2"
Sep 08 10:03:05.178566 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:05.178507    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:03:05.252279 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:05.252237    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsncx\" (UniqueName: \"kubernetes.io/projected/e3dcea29-6e18-4218-ba86-a06ccb4544ca-kube-api-access-dsncx\") pod \"downloads-85d98c998f-ndfx2\" (UID: \"e3dcea29-6e18-4218-ba86-a06ccb4544ca\") " pod="openshift-console/downloads-85d98c998f-ndfx2"
Sep 08 10:03:05.262512 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:05.262485    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsncx\" (UniqueName: \"kubernetes.io/projected/e3dcea29-6e18-4218-ba86-a06ccb4544ca-kube-api-access-dsncx\") pod \"downloads-85d98c998f-ndfx2\" (UID: \"e3dcea29-6e18-4218-ba86-a06ccb4544ca\") " pod="openshift-console/downloads-85d98c998f-ndfx2"
Sep 08 10:03:05.314124 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:05.314030    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:03:05.344850 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:05.344827    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-ndfx2"
Sep 08 10:03:05.518809 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:05.518776    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:03:05.615513 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:05.615431    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:03:05.628105 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:05.627835    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-ndfx2"]
Sep 08 10:03:05.630836 ip-10-0-132-96 kubenswrapper[2579]: W0908 10:03:05.630769    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3dcea29_6e18_4218_ba86_a06ccb4544ca.slice/crio-23b3c164464821aa2ae527eb9258426d70de579d24a8670116d0896db3aa992f WatchSource:0}: Error finding container 23b3c164464821aa2ae527eb9258426d70de579d24a8670116d0896db3aa992f: Status 404 returned error can't find the container with id 23b3c164464821aa2ae527eb9258426d70de579d24a8670116d0896db3aa992f
Sep 08 10:03:05.679096 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:05.679067    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-w56bl"
Sep 08 10:03:05.730248 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:05.730202    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-ndfx2" event={"ID":"e3dcea29-6e18-4218-ba86-a06ccb4544ca","Type":"ContainerStarted","Data":"23b3c164464821aa2ae527eb9258426d70de579d24a8670116d0896db3aa992f"}
Sep 08 10:03:05.899409 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:05.899318    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:03:05.961040 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:05.960996    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:03:06.092809 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:06.092764    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:03:06.156549 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:06.156455    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:03:06.708007 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:06.707976    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:03:06.740857 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:06.740832    2579 kubelet.go:1648] "Image garbage collection succeeded"
Sep 08 10:03:06.910399 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:06.910370    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:03:07.075335 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:07.075301    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:03:07.930889 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:07.930854    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:03:10.974439 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:10.974397    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b6547b8f7-cgj6s"]
Sep 08 10:03:10.977990 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:10.977963    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b6547b8f7-cgj6s"
Sep 08 10:03:10.980869 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:10.980830    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 08 10:03:10.981000 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:10.980830    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 08 10:03:10.982302 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:10.982025    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-qjc4l\""
Sep 08 10:03:10.982302 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:10.982097    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 08 10:03:10.982302 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:10.982090    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 08 10:03:10.982302 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:10.982152    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 08 10:03:10.991669 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:10.991644    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b6547b8f7-cgj6s"]
Sep 08 10:03:11.104645 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:11.104611    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/08c42055-abf4-434f-897a-847c71cf13d4-console-oauth-config\") pod \"console-6b6547b8f7-cgj6s\" (UID: \"08c42055-abf4-434f-897a-847c71cf13d4\") " pod="openshift-console/console-6b6547b8f7-cgj6s"
Sep 08 10:03:11.104645 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:11.104651    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/08c42055-abf4-434f-897a-847c71cf13d4-oauth-serving-cert\") pod \"console-6b6547b8f7-cgj6s\" (UID: \"08c42055-abf4-434f-897a-847c71cf13d4\") " pod="openshift-console/console-6b6547b8f7-cgj6s"
Sep 08 10:03:11.104883 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:11.104738    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/08c42055-abf4-434f-897a-847c71cf13d4-console-config\") pod \"console-6b6547b8f7-cgj6s\" (UID: \"08c42055-abf4-434f-897a-847c71cf13d4\") " pod="openshift-console/console-6b6547b8f7-cgj6s"
Sep 08 10:03:11.104883 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:11.104772    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/08c42055-abf4-434f-897a-847c71cf13d4-console-serving-cert\") pod \"console-6b6547b8f7-cgj6s\" (UID: \"08c42055-abf4-434f-897a-847c71cf13d4\") " pod="openshift-console/console-6b6547b8f7-cgj6s"
Sep 08 10:03:11.104883 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:11.104825    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwwgp\" (UniqueName: \"kubernetes.io/projected/08c42055-abf4-434f-897a-847c71cf13d4-kube-api-access-cwwgp\") pod \"console-6b6547b8f7-cgj6s\" (UID: \"08c42055-abf4-434f-897a-847c71cf13d4\") " pod="openshift-console/console-6b6547b8f7-cgj6s"
Sep 08 10:03:11.104883 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:11.104866    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/08c42055-abf4-434f-897a-847c71cf13d4-service-ca\") pod \"console-6b6547b8f7-cgj6s\" (UID: \"08c42055-abf4-434f-897a-847c71cf13d4\") " pod="openshift-console/console-6b6547b8f7-cgj6s"
Sep 08 10:03:11.138314 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:11.138262    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:03:11.195150 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:11.195117    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:03:11.205366 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:11.205341    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwwgp\" (UniqueName: \"kubernetes.io/projected/08c42055-abf4-434f-897a-847c71cf13d4-kube-api-access-cwwgp\") pod \"console-6b6547b8f7-cgj6s\" (UID: \"08c42055-abf4-434f-897a-847c71cf13d4\") " pod="openshift-console/console-6b6547b8f7-cgj6s"
Sep 08 10:03:11.205494 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:11.205382    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/08c42055-abf4-434f-897a-847c71cf13d4-service-ca\") pod \"console-6b6547b8f7-cgj6s\" (UID: \"08c42055-abf4-434f-897a-847c71cf13d4\") " pod="openshift-console/console-6b6547b8f7-cgj6s"
Sep 08 10:03:11.205494 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:11.205418    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/08c42055-abf4-434f-897a-847c71cf13d4-console-oauth-config\") pod \"console-6b6547b8f7-cgj6s\" (UID: \"08c42055-abf4-434f-897a-847c71cf13d4\") " pod="openshift-console/console-6b6547b8f7-cgj6s"
Sep 08 10:03:11.205494 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:11.205442    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/08c42055-abf4-434f-897a-847c71cf13d4-oauth-serving-cert\") pod \"console-6b6547b8f7-cgj6s\" (UID: \"08c42055-abf4-434f-897a-847c71cf13d4\") " pod="openshift-console/console-6b6547b8f7-cgj6s"
Sep 08 10:03:11.205668 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:11.205527    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/08c42055-abf4-434f-897a-847c71cf13d4-console-config\") pod \"console-6b6547b8f7-cgj6s\" (UID: \"08c42055-abf4-434f-897a-847c71cf13d4\") " pod="openshift-console/console-6b6547b8f7-cgj6s"
Sep 08 10:03:11.205668 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:11.205584    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/08c42055-abf4-434f-897a-847c71cf13d4-console-serving-cert\") pod \"console-6b6547b8f7-cgj6s\" (UID: \"08c42055-abf4-434f-897a-847c71cf13d4\") " pod="openshift-console/console-6b6547b8f7-cgj6s"
Sep 08 10:03:11.206345 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:11.206295    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/08c42055-abf4-434f-897a-847c71cf13d4-oauth-serving-cert\") pod \"console-6b6547b8f7-cgj6s\" (UID: \"08c42055-abf4-434f-897a-847c71cf13d4\") " pod="openshift-console/console-6b6547b8f7-cgj6s"
Sep 08 10:03:11.206345 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:11.206312    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/08c42055-abf4-434f-897a-847c71cf13d4-service-ca\") pod \"console-6b6547b8f7-cgj6s\" (UID: \"08c42055-abf4-434f-897a-847c71cf13d4\") " pod="openshift-console/console-6b6547b8f7-cgj6s"
Sep 08 10:03:11.206521 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:11.206347    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/08c42055-abf4-434f-897a-847c71cf13d4-console-config\") pod \"console-6b6547b8f7-cgj6s\" (UID: \"08c42055-abf4-434f-897a-847c71cf13d4\") " pod="openshift-console/console-6b6547b8f7-cgj6s"
Sep 08 10:03:11.208465 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:11.208444    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/08c42055-abf4-434f-897a-847c71cf13d4-console-serving-cert\") pod \"console-6b6547b8f7-cgj6s\" (UID: \"08c42055-abf4-434f-897a-847c71cf13d4\") " pod="openshift-console/console-6b6547b8f7-cgj6s"
Sep 08 10:03:11.208597 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:11.208475    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/08c42055-abf4-434f-897a-847c71cf13d4-console-oauth-config\") pod \"console-6b6547b8f7-cgj6s\" (UID: \"08c42055-abf4-434f-897a-847c71cf13d4\") " pod="openshift-console/console-6b6547b8f7-cgj6s"
Sep 08 10:03:11.214218 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:11.214197    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwwgp\" (UniqueName: \"kubernetes.io/projected/08c42055-abf4-434f-897a-847c71cf13d4-kube-api-access-cwwgp\") pod \"console-6b6547b8f7-cgj6s\" (UID: \"08c42055-abf4-434f-897a-847c71cf13d4\") " pod="openshift-console/console-6b6547b8f7-cgj6s"
Sep 08 10:03:11.290176 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:11.290136    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b6547b8f7-cgj6s"
Sep 08 10:03:11.570597 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:11.570371    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b6547b8f7-cgj6s"]
Sep 08 10:03:11.573130 ip-10-0-132-96 kubenswrapper[2579]: W0908 10:03:11.573101    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08c42055_abf4_434f_897a_847c71cf13d4.slice/crio-e022a12e8ecbf062e8c0d6732de47aeabcea18948cb8d12336a72a133b9dfe94 WatchSource:0}: Error finding container e022a12e8ecbf062e8c0d6732de47aeabcea18948cb8d12336a72a133b9dfe94: Status 404 returned error can't find the container with id e022a12e8ecbf062e8c0d6732de47aeabcea18948cb8d12336a72a133b9dfe94
Sep 08 10:03:11.575408 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:11.575386    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 10:03:11.759111 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:11.759074    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b6547b8f7-cgj6s" event={"ID":"08c42055-abf4-434f-897a-847c71cf13d4","Type":"ContainerStarted","Data":"e022a12e8ecbf062e8c0d6732de47aeabcea18948cb8d12336a72a133b9dfe94"}
Sep 08 10:03:14.776909 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:14.776882    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b6547b8f7-cgj6s" event={"ID":"08c42055-abf4-434f-897a-847c71cf13d4","Type":"ContainerStarted","Data":"6b741a88f2da1539ace27db0062aa8258eb1ef2fb5bc50b00f1dc4ffca766e76"}
Sep 08 10:03:14.826823 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:14.826791    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b5m55"
Sep 08 10:03:15.640736 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:15.640683    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:03:15.744053 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:15.743954    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:03:15.809554 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:15.809471    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6b6547b8f7-cgj6s" podStartSLOduration=2.695323068 podStartE2EDuration="5.809444847s" totalImagesPullingTime="3.114121779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:03:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:03:15.80726951 +0000 UTC m=+309.502868410" watchObservedRunningTime="2026-09-08 10:03:15.809444847 +0000 UTC m=+309.505043792"
Sep 08 10:03:16.935767 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:16.935729    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:03:17.034745 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:17.034706    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:03:18.969149 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:18.969114    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-595bdb6d6-xpshs"
Sep 08 10:03:18.969705 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:18.969192    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-595bdb6d6-xpshs"
Sep 08 10:03:20.202582 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:20.202520    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:03:20.532243 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:20.532213    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66497d8576-qkxrw"]
Sep 08 10:03:20.536910 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:20.536889    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66497d8576-qkxrw"
Sep 08 10:03:20.546132 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:20.546112    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 08 10:03:20.547553 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:20.547516    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66497d8576-qkxrw"]
Sep 08 10:03:20.697523 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:20.697480    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d37c3277-68b5-485a-a1d2-c75e5bdfbeb2-trusted-ca-bundle\") pod \"console-66497d8576-qkxrw\" (UID: \"d37c3277-68b5-485a-a1d2-c75e5bdfbeb2\") " pod="openshift-console/console-66497d8576-qkxrw"
Sep 08 10:03:20.697709 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:20.697594    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d37c3277-68b5-485a-a1d2-c75e5bdfbeb2-console-config\") pod \"console-66497d8576-qkxrw\" (UID: \"d37c3277-68b5-485a-a1d2-c75e5bdfbeb2\") " pod="openshift-console/console-66497d8576-qkxrw"
Sep 08 10:03:20.697709 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:20.697618    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d37c3277-68b5-485a-a1d2-c75e5bdfbeb2-console-oauth-config\") pod \"console-66497d8576-qkxrw\" (UID: \"d37c3277-68b5-485a-a1d2-c75e5bdfbeb2\") " pod="openshift-console/console-66497d8576-qkxrw"
Sep 08 10:03:20.697709 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:20.697663    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmh8d\" (UniqueName: \"kubernetes.io/projected/d37c3277-68b5-485a-a1d2-c75e5bdfbeb2-kube-api-access-tmh8d\") pod \"console-66497d8576-qkxrw\" (UID: \"d37c3277-68b5-485a-a1d2-c75e5bdfbeb2\") " pod="openshift-console/console-66497d8576-qkxrw"
Sep 08 10:03:20.697845 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:20.697715    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d37c3277-68b5-485a-a1d2-c75e5bdfbeb2-oauth-serving-cert\") pod \"console-66497d8576-qkxrw\" (UID: \"d37c3277-68b5-485a-a1d2-c75e5bdfbeb2\") " pod="openshift-console/console-66497d8576-qkxrw"
Sep 08 10:03:20.697845 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:20.697741    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d37c3277-68b5-485a-a1d2-c75e5bdfbeb2-console-serving-cert\") pod \"console-66497d8576-qkxrw\" (UID: \"d37c3277-68b5-485a-a1d2-c75e5bdfbeb2\") " pod="openshift-console/console-66497d8576-qkxrw"
Sep 08 10:03:20.697845 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:20.697756    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d37c3277-68b5-485a-a1d2-c75e5bdfbeb2-service-ca\") pod \"console-66497d8576-qkxrw\" (UID: \"d37c3277-68b5-485a-a1d2-c75e5bdfbeb2\") " pod="openshift-console/console-66497d8576-qkxrw"
Sep 08 10:03:20.798523 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:20.798435    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmh8d\" (UniqueName: \"kubernetes.io/projected/d37c3277-68b5-485a-a1d2-c75e5bdfbeb2-kube-api-access-tmh8d\") pod \"console-66497d8576-qkxrw\" (UID: \"d37c3277-68b5-485a-a1d2-c75e5bdfbeb2\") " pod="openshift-console/console-66497d8576-qkxrw"
Sep 08 10:03:20.798523 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:20.798488    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d37c3277-68b5-485a-a1d2-c75e5bdfbeb2-oauth-serving-cert\") pod \"console-66497d8576-qkxrw\" (UID: \"d37c3277-68b5-485a-a1d2-c75e5bdfbeb2\") " pod="openshift-console/console-66497d8576-qkxrw"
Sep 08 10:03:20.798523 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:20.798524    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d37c3277-68b5-485a-a1d2-c75e5bdfbeb2-console-serving-cert\") pod \"console-66497d8576-qkxrw\" (UID: \"d37c3277-68b5-485a-a1d2-c75e5bdfbeb2\") " pod="openshift-console/console-66497d8576-qkxrw"
Sep 08 10:03:20.798808 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:20.798677    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d37c3277-68b5-485a-a1d2-c75e5bdfbeb2-service-ca\") pod \"console-66497d8576-qkxrw\" (UID: \"d37c3277-68b5-485a-a1d2-c75e5bdfbeb2\") " pod="openshift-console/console-66497d8576-qkxrw"
Sep 08 10:03:20.798808 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:20.798728    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d37c3277-68b5-485a-a1d2-c75e5bdfbeb2-trusted-ca-bundle\") pod \"console-66497d8576-qkxrw\" (UID: \"d37c3277-68b5-485a-a1d2-c75e5bdfbeb2\") " pod="openshift-console/console-66497d8576-qkxrw"
Sep 08 10:03:20.798911 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:20.798809    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d37c3277-68b5-485a-a1d2-c75e5bdfbeb2-console-config\") pod \"console-66497d8576-qkxrw\" (UID: \"d37c3277-68b5-485a-a1d2-c75e5bdfbeb2\") " pod="openshift-console/console-66497d8576-qkxrw"
Sep 08 10:03:20.798911 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:20.798840    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d37c3277-68b5-485a-a1d2-c75e5bdfbeb2-console-oauth-config\") pod \"console-66497d8576-qkxrw\" (UID: \"d37c3277-68b5-485a-a1d2-c75e5bdfbeb2\") " pod="openshift-console/console-66497d8576-qkxrw"
Sep 08 10:03:20.799370 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:20.799316    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d37c3277-68b5-485a-a1d2-c75e5bdfbeb2-oauth-serving-cert\") pod \"console-66497d8576-qkxrw\" (UID: \"d37c3277-68b5-485a-a1d2-c75e5bdfbeb2\") " pod="openshift-console/console-66497d8576-qkxrw"
Sep 08 10:03:20.799491 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:20.799382    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d37c3277-68b5-485a-a1d2-c75e5bdfbeb2-service-ca\") pod \"console-66497d8576-qkxrw\" (UID: \"d37c3277-68b5-485a-a1d2-c75e5bdfbeb2\") " pod="openshift-console/console-66497d8576-qkxrw"
Sep 08 10:03:20.799667 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:20.799646    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d37c3277-68b5-485a-a1d2-c75e5bdfbeb2-trusted-ca-bundle\") pod \"console-66497d8576-qkxrw\" (UID: \"d37c3277-68b5-485a-a1d2-c75e5bdfbeb2\") " pod="openshift-console/console-66497d8576-qkxrw"
Sep 08 10:03:20.799757 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:20.799721    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d37c3277-68b5-485a-a1d2-c75e5bdfbeb2-console-config\") pod \"console-66497d8576-qkxrw\" (UID: \"d37c3277-68b5-485a-a1d2-c75e5bdfbeb2\") " pod="openshift-console/console-66497d8576-qkxrw"
Sep 08 10:03:20.801529 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:20.801499    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d37c3277-68b5-485a-a1d2-c75e5bdfbeb2-console-oauth-config\") pod \"console-66497d8576-qkxrw\" (UID: \"d37c3277-68b5-485a-a1d2-c75e5bdfbeb2\") " pod="openshift-console/console-66497d8576-qkxrw"
Sep 08 10:03:20.801678 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:20.801658    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d37c3277-68b5-485a-a1d2-c75e5bdfbeb2-console-serving-cert\") pod \"console-66497d8576-qkxrw\" (UID: \"d37c3277-68b5-485a-a1d2-c75e5bdfbeb2\") " pod="openshift-console/console-66497d8576-qkxrw"
Sep 08 10:03:20.807815 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:20.807789    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmh8d\" (UniqueName: \"kubernetes.io/projected/d37c3277-68b5-485a-a1d2-c75e5bdfbeb2-kube-api-access-tmh8d\") pod \"console-66497d8576-qkxrw\" (UID: \"d37c3277-68b5-485a-a1d2-c75e5bdfbeb2\") " pod="openshift-console/console-66497d8576-qkxrw"
Sep 08 10:03:20.848479 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:20.848457    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66497d8576-qkxrw"
Sep 08 10:03:21.223695 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:21.223554    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:03:21.291299 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:21.291265    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b6547b8f7-cgj6s"
Sep 08 10:03:21.291573 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:21.291526    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b6547b8f7-cgj6s"
Sep 08 10:03:21.297039 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:21.297017    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b6547b8f7-cgj6s"
Sep 08 10:03:21.417476 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:21.417438    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:03:21.517753 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:21.517715    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:03:21.817784 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:21.817664    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b6547b8f7-cgj6s"
Sep 08 10:03:23.572925 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:23.572886    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:03:23.981003 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:23.980917    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:03:25.359514 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:25.359483    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66497d8576-qkxrw"]
Sep 08 10:03:25.362267 ip-10-0-132-96 kubenswrapper[2579]: W0908 10:03:25.362236    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd37c3277_68b5_485a_a1d2_c75e5bdfbeb2.slice/crio-0f851219c46a10a3fe2533eee5a143c61699a539c3664ae7a58580cce5d37195 WatchSource:0}: Error finding container 0f851219c46a10a3fe2533eee5a143c61699a539c3664ae7a58580cce5d37195: Status 404 returned error can't find the container with id 0f851219c46a10a3fe2533eee5a143c61699a539c3664ae7a58580cce5d37195
Sep 08 10:03:25.536829 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:25.536793    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:03:25.831973 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:25.831935    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66497d8576-qkxrw" event={"ID":"d37c3277-68b5-485a-a1d2-c75e5bdfbeb2","Type":"ContainerStarted","Data":"ad113b7f8d5b8a34a277403d520755c1b223d1e5a067bf8a6b5b6426aab03dfb"}
Sep 08 10:03:25.832169 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:25.831988    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66497d8576-qkxrw" event={"ID":"d37c3277-68b5-485a-a1d2-c75e5bdfbeb2","Type":"ContainerStarted","Data":"0f851219c46a10a3fe2533eee5a143c61699a539c3664ae7a58580cce5d37195"}
Sep 08 10:03:25.834068 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:25.834038    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-ndfx2" event={"ID":"e3dcea29-6e18-4218-ba86-a06ccb4544ca","Type":"ContainerStarted","Data":"7eced39ac65e5c06745e669c64ac72688a10d5147019aa7f2b700bf4dca2fba4"}
Sep 08 10:03:25.834199 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:25.834095    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-ndfx2"
Sep 08 10:03:25.845830 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:25.845804    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-ndfx2"
Sep 08 10:03:25.855013 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:25.854954    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66497d8576-qkxrw" podStartSLOduration=5.854935777 podStartE2EDuration="5.854935777s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:03:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:03:25.853783248 +0000 UTC m=+319.549382145" watchObservedRunningTime="2026-09-08 10:03:25.854935777 +0000 UTC m=+319.550534731"
Sep 08 10:03:25.876387 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:25.876334    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-ndfx2" podStartSLOduration=1.32061407 podStartE2EDuration="20.876318356s" totalImagesPullingTime="19.555704286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:03:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:03:25.87572057 +0000 UTC m=+319.571319470" watchObservedRunningTime="2026-09-08 10:03:25.876318356 +0000 UTC m=+319.571917257"
Sep 08 10:03:26.147458 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:26.147297    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:03:29.130202 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:29.130160    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:03:30.311283 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:30.311239    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:03:30.849161 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:30.849134    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-66497d8576-qkxrw"
Sep 08 10:03:30.849339 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:30.849197    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66497d8576-qkxrw"
Sep 08 10:03:30.854701 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:30.854676    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-66497d8576-qkxrw"
Sep 08 10:03:30.858956 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:30.858930    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-66497d8576-qkxrw"
Sep 08 10:03:30.934504 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:30.934472    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b6547b8f7-cgj6s"]
Sep 08 10:03:31.245825 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:31.245743    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:03:31.861090 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:31.861052    2579 generic.go:356] "Generic (PLEG): container finished" podID="e4d77eca-04c2-456f-b337-e33b3d1981aa" containerID="38df5ee739dabbe03a314bdada4c214c0adb17895768fb0e93c4bee9f0098979" exitCode=0
Sep 08 10:03:31.861556 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:31.861135    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wdqrw" event={"ID":"e4d77eca-04c2-456f-b337-e33b3d1981aa","Type":"ContainerDied","Data":"38df5ee739dabbe03a314bdada4c214c0adb17895768fb0e93c4bee9f0098979"}
Sep 08 10:03:31.861670 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:31.861653    2579 scope.go:117] "RemoveContainer" containerID="38df5ee739dabbe03a314bdada4c214c0adb17895768fb0e93c4bee9f0098979"
Sep 08 10:03:32.867684 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:32.867645    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-wdqrw" event={"ID":"e4d77eca-04c2-456f-b337-e33b3d1981aa","Type":"ContainerStarted","Data":"af1c1398d9aefce7bc0ecf1e2d5656a538c2d956e2be28bff920642945581688"}
Sep 08 10:03:35.693450 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:35.693405    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:03:36.337197 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:36.337162    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:03:38.974193 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:38.974166    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-595bdb6d6-xpshs"
Sep 08 10:03:38.977911 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:38.977893    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-595bdb6d6-xpshs"
Sep 08 10:03:42.316455 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:42.316416    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:03:45.575097 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:45.575054    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:03:45.919037 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:45.919004    2579 generic.go:356] "Generic (PLEG): container finished" podID="e9472cec-3760-4eca-9c6f-7f0e449c1445" containerID="9dc8cfe609287520a9feeeb0bb3a121fff7b63122cb2da138578f73ed9ca8e6a" exitCode=0
Sep 08 10:03:45.919175 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:45.919076    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-dxh7f" event={"ID":"e9472cec-3760-4eca-9c6f-7f0e449c1445","Type":"ContainerDied","Data":"9dc8cfe609287520a9feeeb0bb3a121fff7b63122cb2da138578f73ed9ca8e6a"}
Sep 08 10:03:45.919377 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:45.919357    2579 scope.go:117] "RemoveContainer" containerID="9dc8cfe609287520a9feeeb0bb3a121fff7b63122cb2da138578f73ed9ca8e6a"
Sep 08 10:03:46.924593 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:46.924553    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-dxh7f" event={"ID":"e9472cec-3760-4eca-9c6f-7f0e449c1445","Type":"ContainerStarted","Data":"9535f764fc94bae444435c53a0f39554e57a12d862b88493ad99c80788e30c19"}
Sep 08 10:03:55.959728 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:55.959677    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6b6547b8f7-cgj6s" podUID="08c42055-abf4-434f-897a-847c71cf13d4" containerName="console" containerID="cri-o://6b741a88f2da1539ace27db0062aa8258eb1ef2fb5bc50b00f1dc4ffca766e76" gracePeriod=15
Sep 08 10:03:56.236524 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:56.236467    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b6547b8f7-cgj6s"
Sep 08 10:03:56.304366 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:56.304335    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/08c42055-abf4-434f-897a-847c71cf13d4-service-ca\") pod \"08c42055-abf4-434f-897a-847c71cf13d4\" (UID: \"08c42055-abf4-434f-897a-847c71cf13d4\") "
Sep 08 10:03:56.304519 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:56.304372    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/08c42055-abf4-434f-897a-847c71cf13d4-console-oauth-config\") pod \"08c42055-abf4-434f-897a-847c71cf13d4\" (UID: \"08c42055-abf4-434f-897a-847c71cf13d4\") "
Sep 08 10:03:56.304519 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:56.304389    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cwwgp\" (UniqueName: \"kubernetes.io/projected/08c42055-abf4-434f-897a-847c71cf13d4-kube-api-access-cwwgp\") pod \"08c42055-abf4-434f-897a-847c71cf13d4\" (UID: \"08c42055-abf4-434f-897a-847c71cf13d4\") "
Sep 08 10:03:56.304519 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:56.304412    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/08c42055-abf4-434f-897a-847c71cf13d4-console-config\") pod \"08c42055-abf4-434f-897a-847c71cf13d4\" (UID: \"08c42055-abf4-434f-897a-847c71cf13d4\") "
Sep 08 10:03:56.304710 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:56.304562    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/08c42055-abf4-434f-897a-847c71cf13d4-console-serving-cert\") pod \"08c42055-abf4-434f-897a-847c71cf13d4\" (UID: \"08c42055-abf4-434f-897a-847c71cf13d4\") "
Sep 08 10:03:56.304710 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:56.304626    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/08c42055-abf4-434f-897a-847c71cf13d4-oauth-serving-cert\") pod \"08c42055-abf4-434f-897a-847c71cf13d4\" (UID: \"08c42055-abf4-434f-897a-847c71cf13d4\") "
Sep 08 10:03:56.304847 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:56.304812    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08c42055-abf4-434f-897a-847c71cf13d4-console-config" (OuterVolumeSpecName: "console-config") pod "08c42055-abf4-434f-897a-847c71cf13d4" (UID: "08c42055-abf4-434f-897a-847c71cf13d4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:03:56.304964 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:56.304864    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08c42055-abf4-434f-897a-847c71cf13d4-service-ca" (OuterVolumeSpecName: "service-ca") pod "08c42055-abf4-434f-897a-847c71cf13d4" (UID: "08c42055-abf4-434f-897a-847c71cf13d4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:03:56.304964 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:56.304906    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/08c42055-abf4-434f-897a-847c71cf13d4-console-config\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:03:56.305060 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:56.304980    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08c42055-abf4-434f-897a-847c71cf13d4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "08c42055-abf4-434f-897a-847c71cf13d4" (UID: "08c42055-abf4-434f-897a-847c71cf13d4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:03:56.306883 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:56.306860    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08c42055-abf4-434f-897a-847c71cf13d4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "08c42055-abf4-434f-897a-847c71cf13d4" (UID: "08c42055-abf4-434f-897a-847c71cf13d4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:03:56.307165 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:56.307138    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/08c42055-abf4-434f-897a-847c71cf13d4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "08c42055-abf4-434f-897a-847c71cf13d4" (UID: "08c42055-abf4-434f-897a-847c71cf13d4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:03:56.307211 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:56.307156    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08c42055-abf4-434f-897a-847c71cf13d4-kube-api-access-cwwgp" (OuterVolumeSpecName: "kube-api-access-cwwgp") pod "08c42055-abf4-434f-897a-847c71cf13d4" (UID: "08c42055-abf4-434f-897a-847c71cf13d4"). InnerVolumeSpecName "kube-api-access-cwwgp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:03:56.406159 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:56.406127    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/08c42055-abf4-434f-897a-847c71cf13d4-oauth-serving-cert\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:03:56.406159 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:56.406155    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/08c42055-abf4-434f-897a-847c71cf13d4-service-ca\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:03:56.406325 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:56.406167    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/08c42055-abf4-434f-897a-847c71cf13d4-console-oauth-config\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:03:56.406325 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:56.406196    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cwwgp\" (UniqueName: \"kubernetes.io/projected/08c42055-abf4-434f-897a-847c71cf13d4-kube-api-access-cwwgp\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:03:56.406325 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:56.406209    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/08c42055-abf4-434f-897a-847c71cf13d4-console-serving-cert\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:03:56.967805 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:56.967766    2579 generic.go:356] "Generic (PLEG): container finished" podID="08c42055-abf4-434f-897a-847c71cf13d4" containerID="6b741a88f2da1539ace27db0062aa8258eb1ef2fb5bc50b00f1dc4ffca766e76" exitCode=0
Sep 08 10:03:56.968204 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:56.967813    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b6547b8f7-cgj6s"
Sep 08 10:03:56.968204 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:56.967852    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b6547b8f7-cgj6s" event={"ID":"08c42055-abf4-434f-897a-847c71cf13d4","Type":"ContainerDied","Data":"6b741a88f2da1539ace27db0062aa8258eb1ef2fb5bc50b00f1dc4ffca766e76"}
Sep 08 10:03:56.968204 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:56.967905    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b6547b8f7-cgj6s" event={"ID":"08c42055-abf4-434f-897a-847c71cf13d4","Type":"ContainerDied","Data":"e022a12e8ecbf062e8c0d6732de47aeabcea18948cb8d12336a72a133b9dfe94"}
Sep 08 10:03:56.968204 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:56.967936    2579 scope.go:117] "RemoveContainer" containerID="6b741a88f2da1539ace27db0062aa8258eb1ef2fb5bc50b00f1dc4ffca766e76"
Sep 08 10:03:56.976495 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:56.976471    2579 scope.go:117] "RemoveContainer" containerID="6b741a88f2da1539ace27db0062aa8258eb1ef2fb5bc50b00f1dc4ffca766e76"
Sep 08 10:03:56.976784 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:03:56.976764    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b741a88f2da1539ace27db0062aa8258eb1ef2fb5bc50b00f1dc4ffca766e76\": container with ID starting with 6b741a88f2da1539ace27db0062aa8258eb1ef2fb5bc50b00f1dc4ffca766e76 not found: ID does not exist" containerID="6b741a88f2da1539ace27db0062aa8258eb1ef2fb5bc50b00f1dc4ffca766e76"
Sep 08 10:03:56.976852 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:56.976792    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b741a88f2da1539ace27db0062aa8258eb1ef2fb5bc50b00f1dc4ffca766e76"} err="failed to get container status \"6b741a88f2da1539ace27db0062aa8258eb1ef2fb5bc50b00f1dc4ffca766e76\": rpc error: code = NotFound desc = could not find container \"6b741a88f2da1539ace27db0062aa8258eb1ef2fb5bc50b00f1dc4ffca766e76\": container with ID starting with 6b741a88f2da1539ace27db0062aa8258eb1ef2fb5bc50b00f1dc4ffca766e76 not found: ID does not exist"
Sep 08 10:03:56.987736 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:56.987710    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b6547b8f7-cgj6s"]
Sep 08 10:03:56.994915 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:56.994895    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b6547b8f7-cgj6s"]
Sep 08 10:03:58.836652 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:03:58.836576    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08c42055-abf4-434f-897a-847c71cf13d4" path="/var/lib/kubelet/pods/08c42055-abf4-434f-897a-847c71cf13d4/volumes"
Sep 08 10:04:10.411234 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:10.411200    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:04:10.515157 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:10.515121    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:04:13.494249 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:13.494208    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:04:14.081814 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:14.081765    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:04:18.593450 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:18.593404    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-54c568ff7-vjch4"]
Sep 08 10:04:18.593880 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:18.593780    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08c42055-abf4-434f-897a-847c71cf13d4" containerName="console"
Sep 08 10:04:18.593880 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:18.593793    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="08c42055-abf4-434f-897a-847c71cf13d4" containerName="console"
Sep 08 10:04:18.593880 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:18.593843    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="08c42055-abf4-434f-897a-847c71cf13d4" containerName="console"
Sep 08 10:04:18.596667 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:18.596644    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-54c568ff7-vjch4"
Sep 08 10:04:18.599970 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:18.599939    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-2hgtn\""
Sep 08 10:04:18.600109 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:18.600007    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 08 10:04:18.601220 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:18.601187    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 08 10:04:18.601220 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:18.601197    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 08 10:04:18.601220 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:18.601200    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 08 10:04:18.601431 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:18.601255    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 08 10:04:18.607078 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:18.607053    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 08 10:04:18.610778 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:18.610753    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-54c568ff7-vjch4"]
Sep 08 10:04:18.686206 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:18.686175    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/675b01df-1cbb-468a-8098-d5a0e32fd0c7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-54c568ff7-vjch4\" (UID: \"675b01df-1cbb-468a-8098-d5a0e32fd0c7\") " pod="openshift-monitoring/telemeter-client-54c568ff7-vjch4"
Sep 08 10:04:18.686206 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:18.686208    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/675b01df-1cbb-468a-8098-d5a0e32fd0c7-serving-certs-ca-bundle\") pod \"telemeter-client-54c568ff7-vjch4\" (UID: \"675b01df-1cbb-468a-8098-d5a0e32fd0c7\") " pod="openshift-monitoring/telemeter-client-54c568ff7-vjch4"
Sep 08 10:04:18.686421 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:18.686230    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/675b01df-1cbb-468a-8098-d5a0e32fd0c7-federate-client-tls\") pod \"telemeter-client-54c568ff7-vjch4\" (UID: \"675b01df-1cbb-468a-8098-d5a0e32fd0c7\") " pod="openshift-monitoring/telemeter-client-54c568ff7-vjch4"
Sep 08 10:04:18.686421 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:18.686247    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/675b01df-1cbb-468a-8098-d5a0e32fd0c7-metrics-client-ca\") pod \"telemeter-client-54c568ff7-vjch4\" (UID: \"675b01df-1cbb-468a-8098-d5a0e32fd0c7\") " pod="openshift-monitoring/telemeter-client-54c568ff7-vjch4"
Sep 08 10:04:18.686421 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:18.686311    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/675b01df-1cbb-468a-8098-d5a0e32fd0c7-secret-telemeter-client\") pod \"telemeter-client-54c568ff7-vjch4\" (UID: \"675b01df-1cbb-468a-8098-d5a0e32fd0c7\") " pod="openshift-monitoring/telemeter-client-54c568ff7-vjch4"
Sep 08 10:04:18.686421 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:18.686355    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/675b01df-1cbb-468a-8098-d5a0e32fd0c7-telemeter-client-tls\") pod \"telemeter-client-54c568ff7-vjch4\" (UID: \"675b01df-1cbb-468a-8098-d5a0e32fd0c7\") " pod="openshift-monitoring/telemeter-client-54c568ff7-vjch4"
Sep 08 10:04:18.686421 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:18.686377    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg7wf\" (UniqueName: \"kubernetes.io/projected/675b01df-1cbb-468a-8098-d5a0e32fd0c7-kube-api-access-sg7wf\") pod \"telemeter-client-54c568ff7-vjch4\" (UID: \"675b01df-1cbb-468a-8098-d5a0e32fd0c7\") " pod="openshift-monitoring/telemeter-client-54c568ff7-vjch4"
Sep 08 10:04:18.686421 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:18.686398    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/675b01df-1cbb-468a-8098-d5a0e32fd0c7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-54c568ff7-vjch4\" (UID: \"675b01df-1cbb-468a-8098-d5a0e32fd0c7\") " pod="openshift-monitoring/telemeter-client-54c568ff7-vjch4"
Sep 08 10:04:18.787636 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:18.787597    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/675b01df-1cbb-468a-8098-d5a0e32fd0c7-secret-telemeter-client\") pod \"telemeter-client-54c568ff7-vjch4\" (UID: \"675b01df-1cbb-468a-8098-d5a0e32fd0c7\") " pod="openshift-monitoring/telemeter-client-54c568ff7-vjch4"
Sep 08 10:04:18.787811 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:18.787649    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/675b01df-1cbb-468a-8098-d5a0e32fd0c7-telemeter-client-tls\") pod \"telemeter-client-54c568ff7-vjch4\" (UID: \"675b01df-1cbb-468a-8098-d5a0e32fd0c7\") " pod="openshift-monitoring/telemeter-client-54c568ff7-vjch4"
Sep 08 10:04:18.787811 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:18.787673    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg7wf\" (UniqueName: \"kubernetes.io/projected/675b01df-1cbb-468a-8098-d5a0e32fd0c7-kube-api-access-sg7wf\") pod \"telemeter-client-54c568ff7-vjch4\" (UID: \"675b01df-1cbb-468a-8098-d5a0e32fd0c7\") " pod="openshift-monitoring/telemeter-client-54c568ff7-vjch4"
Sep 08 10:04:18.787811 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:18.787705    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/675b01df-1cbb-468a-8098-d5a0e32fd0c7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-54c568ff7-vjch4\" (UID: \"675b01df-1cbb-468a-8098-d5a0e32fd0c7\") " pod="openshift-monitoring/telemeter-client-54c568ff7-vjch4"
Sep 08 10:04:18.787811 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:18.787789    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/675b01df-1cbb-468a-8098-d5a0e32fd0c7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-54c568ff7-vjch4\" (UID: \"675b01df-1cbb-468a-8098-d5a0e32fd0c7\") " pod="openshift-monitoring/telemeter-client-54c568ff7-vjch4"
Sep 08 10:04:18.788028 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:18.787821    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/675b01df-1cbb-468a-8098-d5a0e32fd0c7-serving-certs-ca-bundle\") pod \"telemeter-client-54c568ff7-vjch4\" (UID: \"675b01df-1cbb-468a-8098-d5a0e32fd0c7\") " pod="openshift-monitoring/telemeter-client-54c568ff7-vjch4"
Sep 08 10:04:18.788028 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:18.787849    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/675b01df-1cbb-468a-8098-d5a0e32fd0c7-federate-client-tls\") pod \"telemeter-client-54c568ff7-vjch4\" (UID: \"675b01df-1cbb-468a-8098-d5a0e32fd0c7\") " pod="openshift-monitoring/telemeter-client-54c568ff7-vjch4"
Sep 08 10:04:18.788028 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:18.787871    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/675b01df-1cbb-468a-8098-d5a0e32fd0c7-metrics-client-ca\") pod \"telemeter-client-54c568ff7-vjch4\" (UID: \"675b01df-1cbb-468a-8098-d5a0e32fd0c7\") " pod="openshift-monitoring/telemeter-client-54c568ff7-vjch4"
Sep 08 10:04:18.788626 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:18.788598    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/675b01df-1cbb-468a-8098-d5a0e32fd0c7-serving-certs-ca-bundle\") pod \"telemeter-client-54c568ff7-vjch4\" (UID: \"675b01df-1cbb-468a-8098-d5a0e32fd0c7\") " pod="openshift-monitoring/telemeter-client-54c568ff7-vjch4"
Sep 08 10:04:18.788833 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:18.788811    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/675b01df-1cbb-468a-8098-d5a0e32fd0c7-metrics-client-ca\") pod \"telemeter-client-54c568ff7-vjch4\" (UID: \"675b01df-1cbb-468a-8098-d5a0e32fd0c7\") " pod="openshift-monitoring/telemeter-client-54c568ff7-vjch4"
Sep 08 10:04:18.788997 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:18.788977    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/675b01df-1cbb-468a-8098-d5a0e32fd0c7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-54c568ff7-vjch4\" (UID: \"675b01df-1cbb-468a-8098-d5a0e32fd0c7\") " pod="openshift-monitoring/telemeter-client-54c568ff7-vjch4"
Sep 08 10:04:18.790398 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:18.790382    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/675b01df-1cbb-468a-8098-d5a0e32fd0c7-telemeter-client-tls\") pod \"telemeter-client-54c568ff7-vjch4\" (UID: \"675b01df-1cbb-468a-8098-d5a0e32fd0c7\") " pod="openshift-monitoring/telemeter-client-54c568ff7-vjch4"
Sep 08 10:04:18.790491 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:18.790441    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/675b01df-1cbb-468a-8098-d5a0e32fd0c7-secret-telemeter-client\") pod \"telemeter-client-54c568ff7-vjch4\" (UID: \"675b01df-1cbb-468a-8098-d5a0e32fd0c7\") " pod="openshift-monitoring/telemeter-client-54c568ff7-vjch4"
Sep 08 10:04:18.790778 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:18.790761    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/675b01df-1cbb-468a-8098-d5a0e32fd0c7-federate-client-tls\") pod \"telemeter-client-54c568ff7-vjch4\" (UID: \"675b01df-1cbb-468a-8098-d5a0e32fd0c7\") " pod="openshift-monitoring/telemeter-client-54c568ff7-vjch4"
Sep 08 10:04:18.790839 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:18.790777    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/675b01df-1cbb-468a-8098-d5a0e32fd0c7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-54c568ff7-vjch4\" (UID: \"675b01df-1cbb-468a-8098-d5a0e32fd0c7\") " pod="openshift-monitoring/telemeter-client-54c568ff7-vjch4"
Sep 08 10:04:18.807075 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:18.807055    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg7wf\" (UniqueName: \"kubernetes.io/projected/675b01df-1cbb-468a-8098-d5a0e32fd0c7-kube-api-access-sg7wf\") pod \"telemeter-client-54c568ff7-vjch4\" (UID: \"675b01df-1cbb-468a-8098-d5a0e32fd0c7\") " pod="openshift-monitoring/telemeter-client-54c568ff7-vjch4"
Sep 08 10:04:18.908858 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:18.908766    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-54c568ff7-vjch4"
Sep 08 10:04:19.201795 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:19.201697    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-54c568ff7-vjch4"]
Sep 08 10:04:19.206136 ip-10-0-132-96 kubenswrapper[2579]: W0908 10:04:19.206107    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod675b01df_1cbb_468a_8098_d5a0e32fd0c7.slice/crio-30c2a2335ddfb4d3f8e9cb4012eee088bbffa1fbd927f28ea95a56afbcb726c5 WatchSource:0}: Error finding container 30c2a2335ddfb4d3f8e9cb4012eee088bbffa1fbd927f28ea95a56afbcb726c5: Status 404 returned error can't find the container with id 30c2a2335ddfb4d3f8e9cb4012eee088bbffa1fbd927f28ea95a56afbcb726c5
Sep 08 10:04:20.057641 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:20.057602    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-54c568ff7-vjch4" event={"ID":"675b01df-1cbb-468a-8098-d5a0e32fd0c7","Type":"ContainerStarted","Data":"30c2a2335ddfb4d3f8e9cb4012eee088bbffa1fbd927f28ea95a56afbcb726c5"}
Sep 08 10:04:20.807333 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:20.807295    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3868a1c3-46c6-4940-92ed-e460b77d7cfc-metrics-certs\") pod \"network-metrics-daemon-b5m55\" (UID: \"3868a1c3-46c6-4940-92ed-e460b77d7cfc\") " pod="openshift-multus/network-metrics-daemon-b5m55"
Sep 08 10:04:20.809848 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:20.809819    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3868a1c3-46c6-4940-92ed-e460b77d7cfc-metrics-certs\") pod \"network-metrics-daemon-b5m55\" (UID: \"3868a1c3-46c6-4940-92ed-e460b77d7cfc\") " pod="openshift-multus/network-metrics-daemon-b5m55"
Sep 08 10:04:20.830194 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:20.830174    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-nwsv5\""
Sep 08 10:04:20.838055 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:20.838040    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-b5m55"
Sep 08 10:04:21.106276 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:21.106200    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-b5m55"]
Sep 08 10:04:21.108818 ip-10-0-132-96 kubenswrapper[2579]: W0908 10:04:21.108790    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3868a1c3_46c6_4940_92ed_e460b77d7cfc.slice/crio-dcd5541a0d26b890c8d38aa2ecdf1033dd65c73361d4d6b404b2d1acd258af33 WatchSource:0}: Error finding container dcd5541a0d26b890c8d38aa2ecdf1033dd65c73361d4d6b404b2d1acd258af33: Status 404 returned error can't find the container with id dcd5541a0d26b890c8d38aa2ecdf1033dd65c73361d4d6b404b2d1acd258af33
Sep 08 10:04:22.067875 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:22.067841    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b5m55" event={"ID":"3868a1c3-46c6-4940-92ed-e460b77d7cfc","Type":"ContainerStarted","Data":"dcd5541a0d26b890c8d38aa2ecdf1033dd65c73361d4d6b404b2d1acd258af33"}
Sep 08 10:04:23.073393 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:23.073358    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b5m55" event={"ID":"3868a1c3-46c6-4940-92ed-e460b77d7cfc","Type":"ContainerStarted","Data":"c6fb55ca7a25722622a396c8e0036429bb1dbdcb9fe82d48b3001a074a020966"}
Sep 08 10:04:23.073788 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:23.073409    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-b5m55" event={"ID":"3868a1c3-46c6-4940-92ed-e460b77d7cfc","Type":"ContainerStarted","Data":"3c2985ad5ebb89e75d039d08e7a33cdd3c8247335e907d35df723137b3e0b730"}
Sep 08 10:04:23.094089 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:23.094038    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-b5m55" podStartSLOduration=374.934315388 podStartE2EDuration="6m16.094023317s" totalImagesPullingTime="1.159707929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 09:58:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:04:23.093013832 +0000 UTC m=+376.788612733" watchObservedRunningTime="2026-09-08 10:04:23.094023317 +0000 UTC m=+376.789622218"
Sep 08 10:04:23.193900 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:23.193847    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:04:23.360230 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:23.360154    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:04:25.083437 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:25.083397    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-54c568ff7-vjch4" event={"ID":"675b01df-1cbb-468a-8098-d5a0e32fd0c7","Type":"ContainerStarted","Data":"9ad1f0b07f861f60ce8e324797527ce15c59293de2780de0904db41bb198efd5"}
Sep 08 10:04:26.089487 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:26.089458    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-54c568ff7-vjch4" event={"ID":"675b01df-1cbb-468a-8098-d5a0e32fd0c7","Type":"ContainerStarted","Data":"5d1da38660df341849c97f60a277e393b9a2b415025c20d57fd7812a72da0e14"}
Sep 08 10:04:26.089892 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:26.089515    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-54c568ff7-vjch4" event={"ID":"675b01df-1cbb-468a-8098-d5a0e32fd0c7","Type":"ContainerStarted","Data":"b0637889450258ec29ea55076ccde354f37aff0bb252c397016b444c69576632"}
Sep 08 10:04:26.114713 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:26.114223    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-54c568ff7-vjch4" podStartSLOduration=1.793374733 podStartE2EDuration="8.114204679s" totalImagesPullingTime="6.320829946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:04:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:04:26.112400089 +0000 UTC m=+379.807999019" watchObservedRunningTime="2026-09-08 10:04:26.114204679 +0000 UTC m=+379.809803580"
Sep 08 10:04:26.210955 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:26.210919    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59bc56774c-pdcvw"]
Sep 08 10:04:26.213174 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:26.213153    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59bc56774c-pdcvw"
Sep 08 10:04:26.240817 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:26.240795    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59bc56774c-pdcvw"]
Sep 08 10:04:26.253662 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:26.253636    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a90f51bb-7c0a-4c89-af46-bf10f87a7f7c-console-serving-cert\") pod \"console-59bc56774c-pdcvw\" (UID: \"a90f51bb-7c0a-4c89-af46-bf10f87a7f7c\") " pod="openshift-console/console-59bc56774c-pdcvw"
Sep 08 10:04:26.253758 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:26.253666    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a90f51bb-7c0a-4c89-af46-bf10f87a7f7c-console-config\") pod \"console-59bc56774c-pdcvw\" (UID: \"a90f51bb-7c0a-4c89-af46-bf10f87a7f7c\") " pod="openshift-console/console-59bc56774c-pdcvw"
Sep 08 10:04:26.253758 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:26.253685    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2zl5\" (UniqueName: \"kubernetes.io/projected/a90f51bb-7c0a-4c89-af46-bf10f87a7f7c-kube-api-access-w2zl5\") pod \"console-59bc56774c-pdcvw\" (UID: \"a90f51bb-7c0a-4c89-af46-bf10f87a7f7c\") " pod="openshift-console/console-59bc56774c-pdcvw"
Sep 08 10:04:26.253758 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:26.253705    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a90f51bb-7c0a-4c89-af46-bf10f87a7f7c-service-ca\") pod \"console-59bc56774c-pdcvw\" (UID: \"a90f51bb-7c0a-4c89-af46-bf10f87a7f7c\") " pod="openshift-console/console-59bc56774c-pdcvw"
Sep 08 10:04:26.253871 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:26.253798    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a90f51bb-7c0a-4c89-af46-bf10f87a7f7c-console-oauth-config\") pod \"console-59bc56774c-pdcvw\" (UID: \"a90f51bb-7c0a-4c89-af46-bf10f87a7f7c\") " pod="openshift-console/console-59bc56774c-pdcvw"
Sep 08 10:04:26.253871 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:26.253823    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a90f51bb-7c0a-4c89-af46-bf10f87a7f7c-oauth-serving-cert\") pod \"console-59bc56774c-pdcvw\" (UID: \"a90f51bb-7c0a-4c89-af46-bf10f87a7f7c\") " pod="openshift-console/console-59bc56774c-pdcvw"
Sep 08 10:04:26.253871 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:26.253839    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a90f51bb-7c0a-4c89-af46-bf10f87a7f7c-trusted-ca-bundle\") pod \"console-59bc56774c-pdcvw\" (UID: \"a90f51bb-7c0a-4c89-af46-bf10f87a7f7c\") " pod="openshift-console/console-59bc56774c-pdcvw"
Sep 08 10:04:26.293057 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:26.293017    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:04:26.355074 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:26.355023    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a90f51bb-7c0a-4c89-af46-bf10f87a7f7c-console-config\") pod \"console-59bc56774c-pdcvw\" (UID: \"a90f51bb-7c0a-4c89-af46-bf10f87a7f7c\") " pod="openshift-console/console-59bc56774c-pdcvw"
Sep 08 10:04:26.355074 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:26.355051    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2zl5\" (UniqueName: \"kubernetes.io/projected/a90f51bb-7c0a-4c89-af46-bf10f87a7f7c-kube-api-access-w2zl5\") pod \"console-59bc56774c-pdcvw\" (UID: \"a90f51bb-7c0a-4c89-af46-bf10f87a7f7c\") " pod="openshift-console/console-59bc56774c-pdcvw"
Sep 08 10:04:26.355074 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:26.355067    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a90f51bb-7c0a-4c89-af46-bf10f87a7f7c-service-ca\") pod \"console-59bc56774c-pdcvw\" (UID: \"a90f51bb-7c0a-4c89-af46-bf10f87a7f7c\") " pod="openshift-console/console-59bc56774c-pdcvw"
Sep 08 10:04:26.355239 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:26.355120    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a90f51bb-7c0a-4c89-af46-bf10f87a7f7c-console-oauth-config\") pod \"console-59bc56774c-pdcvw\" (UID: \"a90f51bb-7c0a-4c89-af46-bf10f87a7f7c\") " pod="openshift-console/console-59bc56774c-pdcvw"
Sep 08 10:04:26.355239 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:26.355136    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a90f51bb-7c0a-4c89-af46-bf10f87a7f7c-oauth-serving-cert\") pod \"console-59bc56774c-pdcvw\" (UID: \"a90f51bb-7c0a-4c89-af46-bf10f87a7f7c\") " pod="openshift-console/console-59bc56774c-pdcvw"
Sep 08 10:04:26.355239 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:26.355150    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a90f51bb-7c0a-4c89-af46-bf10f87a7f7c-trusted-ca-bundle\") pod \"console-59bc56774c-pdcvw\" (UID: \"a90f51bb-7c0a-4c89-af46-bf10f87a7f7c\") " pod="openshift-console/console-59bc56774c-pdcvw"
Sep 08 10:04:26.355239 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:26.355180    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a90f51bb-7c0a-4c89-af46-bf10f87a7f7c-console-serving-cert\") pod \"console-59bc56774c-pdcvw\" (UID: \"a90f51bb-7c0a-4c89-af46-bf10f87a7f7c\") " pod="openshift-console/console-59bc56774c-pdcvw"
Sep 08 10:04:26.355751 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:26.355731    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a90f51bb-7c0a-4c89-af46-bf10f87a7f7c-console-config\") pod \"console-59bc56774c-pdcvw\" (UID: \"a90f51bb-7c0a-4c89-af46-bf10f87a7f7c\") " pod="openshift-console/console-59bc56774c-pdcvw"
Sep 08 10:04:26.355894 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:26.355843    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a90f51bb-7c0a-4c89-af46-bf10f87a7f7c-oauth-serving-cert\") pod \"console-59bc56774c-pdcvw\" (UID: \"a90f51bb-7c0a-4c89-af46-bf10f87a7f7c\") " pod="openshift-console/console-59bc56774c-pdcvw"
Sep 08 10:04:26.355894 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:26.355853    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a90f51bb-7c0a-4c89-af46-bf10f87a7f7c-service-ca\") pod \"console-59bc56774c-pdcvw\" (UID: \"a90f51bb-7c0a-4c89-af46-bf10f87a7f7c\") " pod="openshift-console/console-59bc56774c-pdcvw"
Sep 08 10:04:26.356179 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:26.356031    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a90f51bb-7c0a-4c89-af46-bf10f87a7f7c-trusted-ca-bundle\") pod \"console-59bc56774c-pdcvw\" (UID: \"a90f51bb-7c0a-4c89-af46-bf10f87a7f7c\") " pod="openshift-console/console-59bc56774c-pdcvw"
Sep 08 10:04:26.357661 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:26.357624    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:04:26.358090 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:26.358045    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a90f51bb-7c0a-4c89-af46-bf10f87a7f7c-console-oauth-config\") pod \"console-59bc56774c-pdcvw\" (UID: \"a90f51bb-7c0a-4c89-af46-bf10f87a7f7c\") " pod="openshift-console/console-59bc56774c-pdcvw"
Sep 08 10:04:26.358090 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:26.358077    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a90f51bb-7c0a-4c89-af46-bf10f87a7f7c-console-serving-cert\") pod \"console-59bc56774c-pdcvw\" (UID: \"a90f51bb-7c0a-4c89-af46-bf10f87a7f7c\") " pod="openshift-console/console-59bc56774c-pdcvw"
Sep 08 10:04:26.363571 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:26.363528    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2zl5\" (UniqueName: \"kubernetes.io/projected/a90f51bb-7c0a-4c89-af46-bf10f87a7f7c-kube-api-access-w2zl5\") pod \"console-59bc56774c-pdcvw\" (UID: \"a90f51bb-7c0a-4c89-af46-bf10f87a7f7c\") " pod="openshift-console/console-59bc56774c-pdcvw"
Sep 08 10:04:26.522420 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:26.522383    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59bc56774c-pdcvw"
Sep 08 10:04:26.795555 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:26.795500    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59bc56774c-pdcvw"]
Sep 08 10:04:26.798935 ip-10-0-132-96 kubenswrapper[2579]: W0908 10:04:26.798898    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda90f51bb_7c0a_4c89_af46_bf10f87a7f7c.slice/crio-bad1e024cbc22dd6ee858621865e86ed76c945c3b114c39f42872422e551aa23 WatchSource:0}: Error finding container bad1e024cbc22dd6ee858621865e86ed76c945c3b114c39f42872422e551aa23: Status 404 returned error can't find the container with id bad1e024cbc22dd6ee858621865e86ed76c945c3b114c39f42872422e551aa23
Sep 08 10:04:27.095065 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:27.094953    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59bc56774c-pdcvw" event={"ID":"a90f51bb-7c0a-4c89-af46-bf10f87a7f7c","Type":"ContainerStarted","Data":"af0a4ee18e126485829a543a7e55bf6e403be83bcfffc0557c354de4dc7423a0"}
Sep 08 10:04:27.095065 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:27.095015    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59bc56774c-pdcvw" event={"ID":"a90f51bb-7c0a-4c89-af46-bf10f87a7f7c","Type":"ContainerStarted","Data":"bad1e024cbc22dd6ee858621865e86ed76c945c3b114c39f42872422e551aa23"}
Sep 08 10:04:27.122807 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:27.122756    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59bc56774c-pdcvw" podStartSLOduration=1.122740531 podStartE2EDuration="1.122740531s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:04:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:04:27.122342428 +0000 UTC m=+380.817941321" watchObservedRunningTime="2026-09-08 10:04:27.122740531 +0000 UTC m=+380.818339430"
Sep 08 10:04:27.890141 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:27.890100    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:04:27.959330 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:27.959286    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:04:36.522719 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:36.522688    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59bc56774c-pdcvw"
Sep 08 10:04:36.523098 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:36.522752    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59bc56774c-pdcvw"
Sep 08 10:04:36.527667 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:36.527644    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59bc56774c-pdcvw"
Sep 08 10:04:37.138215 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:37.138185    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59bc56774c-pdcvw"
Sep 08 10:04:37.194145 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:37.194114    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66497d8576-qkxrw"]
Sep 08 10:04:37.316959 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:37.316919    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:04:37.428689 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:37.428608    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:04:37.510792 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:04:37.510761    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:05:02.214032 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:02.213985    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-66497d8576-qkxrw" podUID="d37c3277-68b5-485a-a1d2-c75e5bdfbeb2" containerName="console" containerID="cri-o://ad113b7f8d5b8a34a277403d520755c1b223d1e5a067bf8a6b5b6426aab03dfb" gracePeriod=15
Sep 08 10:05:02.467095 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:02.467039    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66497d8576-qkxrw"
Sep 08 10:05:02.545163 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:02.545129    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d37c3277-68b5-485a-a1d2-c75e5bdfbeb2-console-config\") pod \"d37c3277-68b5-485a-a1d2-c75e5bdfbeb2\" (UID: \"d37c3277-68b5-485a-a1d2-c75e5bdfbeb2\") "
Sep 08 10:05:02.545333 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:02.545188    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d37c3277-68b5-485a-a1d2-c75e5bdfbeb2-console-serving-cert\") pod \"d37c3277-68b5-485a-a1d2-c75e5bdfbeb2\" (UID: \"d37c3277-68b5-485a-a1d2-c75e5bdfbeb2\") "
Sep 08 10:05:02.545333 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:02.545223    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d37c3277-68b5-485a-a1d2-c75e5bdfbeb2-service-ca\") pod \"d37c3277-68b5-485a-a1d2-c75e5bdfbeb2\" (UID: \"d37c3277-68b5-485a-a1d2-c75e5bdfbeb2\") "
Sep 08 10:05:02.545333 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:02.545253    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d37c3277-68b5-485a-a1d2-c75e5bdfbeb2-trusted-ca-bundle\") pod \"d37c3277-68b5-485a-a1d2-c75e5bdfbeb2\" (UID: \"d37c3277-68b5-485a-a1d2-c75e5bdfbeb2\") "
Sep 08 10:05:02.545333 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:02.545277    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d37c3277-68b5-485a-a1d2-c75e5bdfbeb2-oauth-serving-cert\") pod \"d37c3277-68b5-485a-a1d2-c75e5bdfbeb2\" (UID: \"d37c3277-68b5-485a-a1d2-c75e5bdfbeb2\") "
Sep 08 10:05:02.545578 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:02.545391    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tmh8d\" (UniqueName: \"kubernetes.io/projected/d37c3277-68b5-485a-a1d2-c75e5bdfbeb2-kube-api-access-tmh8d\") pod \"d37c3277-68b5-485a-a1d2-c75e5bdfbeb2\" (UID: \"d37c3277-68b5-485a-a1d2-c75e5bdfbeb2\") "
Sep 08 10:05:02.545578 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:02.545461    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d37c3277-68b5-485a-a1d2-c75e5bdfbeb2-console-oauth-config\") pod \"d37c3277-68b5-485a-a1d2-c75e5bdfbeb2\" (UID: \"d37c3277-68b5-485a-a1d2-c75e5bdfbeb2\") "
Sep 08 10:05:02.545769 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:02.545744    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d37c3277-68b5-485a-a1d2-c75e5bdfbeb2-service-ca" (OuterVolumeSpecName: "service-ca") pod "d37c3277-68b5-485a-a1d2-c75e5bdfbeb2" (UID: "d37c3277-68b5-485a-a1d2-c75e5bdfbeb2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:05:02.545769 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:02.545752    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d37c3277-68b5-485a-a1d2-c75e5bdfbeb2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d37c3277-68b5-485a-a1d2-c75e5bdfbeb2" (UID: "d37c3277-68b5-485a-a1d2-c75e5bdfbeb2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:05:02.545769 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:02.545757    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d37c3277-68b5-485a-a1d2-c75e5bdfbeb2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d37c3277-68b5-485a-a1d2-c75e5bdfbeb2" (UID: "d37c3277-68b5-485a-a1d2-c75e5bdfbeb2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:05:02.545941 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:02.545767    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d37c3277-68b5-485a-a1d2-c75e5bdfbeb2-console-config" (OuterVolumeSpecName: "console-config") pod "d37c3277-68b5-485a-a1d2-c75e5bdfbeb2" (UID: "d37c3277-68b5-485a-a1d2-c75e5bdfbeb2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:05:02.547634 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:02.547600    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d37c3277-68b5-485a-a1d2-c75e5bdfbeb2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d37c3277-68b5-485a-a1d2-c75e5bdfbeb2" (UID: "d37c3277-68b5-485a-a1d2-c75e5bdfbeb2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:05:02.547720 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:02.547681    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d37c3277-68b5-485a-a1d2-c75e5bdfbeb2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d37c3277-68b5-485a-a1d2-c75e5bdfbeb2" (UID: "d37c3277-68b5-485a-a1d2-c75e5bdfbeb2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:05:02.547773 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:02.547731    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d37c3277-68b5-485a-a1d2-c75e5bdfbeb2-kube-api-access-tmh8d" (OuterVolumeSpecName: "kube-api-access-tmh8d") pod "d37c3277-68b5-485a-a1d2-c75e5bdfbeb2" (UID: "d37c3277-68b5-485a-a1d2-c75e5bdfbeb2"). InnerVolumeSpecName "kube-api-access-tmh8d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:05:02.646930 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:02.646904    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d37c3277-68b5-485a-a1d2-c75e5bdfbeb2-trusted-ca-bundle\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:05:02.646930 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:02.646928    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d37c3277-68b5-485a-a1d2-c75e5bdfbeb2-oauth-serving-cert\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:05:02.646930 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:02.646937    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tmh8d\" (UniqueName: \"kubernetes.io/projected/d37c3277-68b5-485a-a1d2-c75e5bdfbeb2-kube-api-access-tmh8d\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:05:02.647135 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:02.646945    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d37c3277-68b5-485a-a1d2-c75e5bdfbeb2-console-oauth-config\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:05:02.647135 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:02.646954    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d37c3277-68b5-485a-a1d2-c75e5bdfbeb2-console-config\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:05:02.647135 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:02.646962    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d37c3277-68b5-485a-a1d2-c75e5bdfbeb2-console-serving-cert\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:05:02.647135 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:02.646970    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d37c3277-68b5-485a-a1d2-c75e5bdfbeb2-service-ca\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:05:03.242247 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:03.242164    2579 generic.go:356] "Generic (PLEG): container finished" podID="d37c3277-68b5-485a-a1d2-c75e5bdfbeb2" containerID="ad113b7f8d5b8a34a277403d520755c1b223d1e5a067bf8a6b5b6426aab03dfb" exitCode=0
Sep 08 10:05:03.242247 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:03.242222    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66497d8576-qkxrw"
Sep 08 10:05:03.242247 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:03.242231    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66497d8576-qkxrw" event={"ID":"d37c3277-68b5-485a-a1d2-c75e5bdfbeb2","Type":"ContainerDied","Data":"ad113b7f8d5b8a34a277403d520755c1b223d1e5a067bf8a6b5b6426aab03dfb"}
Sep 08 10:05:03.242807 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:03.242293    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66497d8576-qkxrw" event={"ID":"d37c3277-68b5-485a-a1d2-c75e5bdfbeb2","Type":"ContainerDied","Data":"0f851219c46a10a3fe2533eee5a143c61699a539c3664ae7a58580cce5d37195"}
Sep 08 10:05:03.242807 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:03.242313    2579 scope.go:117] "RemoveContainer" containerID="ad113b7f8d5b8a34a277403d520755c1b223d1e5a067bf8a6b5b6426aab03dfb"
Sep 08 10:05:03.251056 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:03.251036    2579 scope.go:117] "RemoveContainer" containerID="ad113b7f8d5b8a34a277403d520755c1b223d1e5a067bf8a6b5b6426aab03dfb"
Sep 08 10:05:03.251321 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:05:03.251302    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad113b7f8d5b8a34a277403d520755c1b223d1e5a067bf8a6b5b6426aab03dfb\": container with ID starting with ad113b7f8d5b8a34a277403d520755c1b223d1e5a067bf8a6b5b6426aab03dfb not found: ID does not exist" containerID="ad113b7f8d5b8a34a277403d520755c1b223d1e5a067bf8a6b5b6426aab03dfb"
Sep 08 10:05:03.251384 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:03.251328    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad113b7f8d5b8a34a277403d520755c1b223d1e5a067bf8a6b5b6426aab03dfb"} err="failed to get container status \"ad113b7f8d5b8a34a277403d520755c1b223d1e5a067bf8a6b5b6426aab03dfb\": rpc error: code = NotFound desc = could not find container \"ad113b7f8d5b8a34a277403d520755c1b223d1e5a067bf8a6b5b6426aab03dfb\": container with ID starting with ad113b7f8d5b8a34a277403d520755c1b223d1e5a067bf8a6b5b6426aab03dfb not found: ID does not exist"
Sep 08 10:05:03.259227 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:03.259202    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66497d8576-qkxrw"]
Sep 08 10:05:03.261232 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:03.261209    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66497d8576-qkxrw"]
Sep 08 10:05:04.831652 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:04.831620    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d37c3277-68b5-485a-a1d2-c75e5bdfbeb2" path="/var/lib/kubelet/pods/d37c3277-68b5-485a-a1d2-c75e5bdfbeb2/volumes"
Sep 08 10:05:12.437361 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:12.437317    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:05:12.505009 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:12.504972    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:05:28.816568 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:28.816464    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:05:28.902582 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:28.902528    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:05:30.529239 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:30.529204    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:05:32.190289 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:32.190255    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-84884fdfc9-q9qfv"]
Sep 08 10:05:32.190668 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:32.190574    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d37c3277-68b5-485a-a1d2-c75e5bdfbeb2" containerName="console"
Sep 08 10:05:32.190668 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:32.190586    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d37c3277-68b5-485a-a1d2-c75e5bdfbeb2" containerName="console"
Sep 08 10:05:32.190668 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:32.190648    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d37c3277-68b5-485a-a1d2-c75e5bdfbeb2" containerName="console"
Sep 08 10:05:32.193418 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:32.193403    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84884fdfc9-q9qfv"
Sep 08 10:05:32.208099 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:32.208070    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84884fdfc9-q9qfv"]
Sep 08 10:05:32.267788 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:32.267755    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ac6e545f-8c6c-428e-9d2d-aca431c7f9dd-console-serving-cert\") pod \"console-84884fdfc9-q9qfv\" (UID: \"ac6e545f-8c6c-428e-9d2d-aca431c7f9dd\") " pod="openshift-console/console-84884fdfc9-q9qfv"
Sep 08 10:05:32.267788 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:32.267785    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ac6e545f-8c6c-428e-9d2d-aca431c7f9dd-oauth-serving-cert\") pod \"console-84884fdfc9-q9qfv\" (UID: \"ac6e545f-8c6c-428e-9d2d-aca431c7f9dd\") " pod="openshift-console/console-84884fdfc9-q9qfv"
Sep 08 10:05:32.268008 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:32.267816    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9qvg\" (UniqueName: \"kubernetes.io/projected/ac6e545f-8c6c-428e-9d2d-aca431c7f9dd-kube-api-access-v9qvg\") pod \"console-84884fdfc9-q9qfv\" (UID: \"ac6e545f-8c6c-428e-9d2d-aca431c7f9dd\") " pod="openshift-console/console-84884fdfc9-q9qfv"
Sep 08 10:05:32.268008 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:32.267867    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ac6e545f-8c6c-428e-9d2d-aca431c7f9dd-console-oauth-config\") pod \"console-84884fdfc9-q9qfv\" (UID: \"ac6e545f-8c6c-428e-9d2d-aca431c7f9dd\") " pod="openshift-console/console-84884fdfc9-q9qfv"
Sep 08 10:05:32.268008 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:32.267912    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ac6e545f-8c6c-428e-9d2d-aca431c7f9dd-service-ca\") pod \"console-84884fdfc9-q9qfv\" (UID: \"ac6e545f-8c6c-428e-9d2d-aca431c7f9dd\") " pod="openshift-console/console-84884fdfc9-q9qfv"
Sep 08 10:05:32.268008 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:32.267932    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac6e545f-8c6c-428e-9d2d-aca431c7f9dd-trusted-ca-bundle\") pod \"console-84884fdfc9-q9qfv\" (UID: \"ac6e545f-8c6c-428e-9d2d-aca431c7f9dd\") " pod="openshift-console/console-84884fdfc9-q9qfv"
Sep 08 10:05:32.268008 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:32.267953    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ac6e545f-8c6c-428e-9d2d-aca431c7f9dd-console-config\") pod \"console-84884fdfc9-q9qfv\" (UID: \"ac6e545f-8c6c-428e-9d2d-aca431c7f9dd\") " pod="openshift-console/console-84884fdfc9-q9qfv"
Sep 08 10:05:32.273778 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:32.273746    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:05:32.337111 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:32.337078    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:05:32.368922 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:32.368890    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ac6e545f-8c6c-428e-9d2d-aca431c7f9dd-oauth-serving-cert\") pod \"console-84884fdfc9-q9qfv\" (UID: \"ac6e545f-8c6c-428e-9d2d-aca431c7f9dd\") " pod="openshift-console/console-84884fdfc9-q9qfv"
Sep 08 10:05:32.369053 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:32.368935    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9qvg\" (UniqueName: \"kubernetes.io/projected/ac6e545f-8c6c-428e-9d2d-aca431c7f9dd-kube-api-access-v9qvg\") pod \"console-84884fdfc9-q9qfv\" (UID: \"ac6e545f-8c6c-428e-9d2d-aca431c7f9dd\") " pod="openshift-console/console-84884fdfc9-q9qfv"
Sep 08 10:05:32.369053 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:32.368958    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ac6e545f-8c6c-428e-9d2d-aca431c7f9dd-console-oauth-config\") pod \"console-84884fdfc9-q9qfv\" (UID: \"ac6e545f-8c6c-428e-9d2d-aca431c7f9dd\") " pod="openshift-console/console-84884fdfc9-q9qfv"
Sep 08 10:05:32.369053 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:32.368977    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ac6e545f-8c6c-428e-9d2d-aca431c7f9dd-service-ca\") pod \"console-84884fdfc9-q9qfv\" (UID: \"ac6e545f-8c6c-428e-9d2d-aca431c7f9dd\") " pod="openshift-console/console-84884fdfc9-q9qfv"
Sep 08 10:05:32.369053 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:32.368993    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac6e545f-8c6c-428e-9d2d-aca431c7f9dd-trusted-ca-bundle\") pod \"console-84884fdfc9-q9qfv\" (UID: \"ac6e545f-8c6c-428e-9d2d-aca431c7f9dd\") " pod="openshift-console/console-84884fdfc9-q9qfv"
Sep 08 10:05:32.369053 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:32.369020    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ac6e545f-8c6c-428e-9d2d-aca431c7f9dd-console-config\") pod \"console-84884fdfc9-q9qfv\" (UID: \"ac6e545f-8c6c-428e-9d2d-aca431c7f9dd\") " pod="openshift-console/console-84884fdfc9-q9qfv"
Sep 08 10:05:32.369338 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:32.369067    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ac6e545f-8c6c-428e-9d2d-aca431c7f9dd-console-serving-cert\") pod \"console-84884fdfc9-q9qfv\" (UID: \"ac6e545f-8c6c-428e-9d2d-aca431c7f9dd\") " pod="openshift-console/console-84884fdfc9-q9qfv"
Sep 08 10:05:32.369734 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:32.369708    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ac6e545f-8c6c-428e-9d2d-aca431c7f9dd-service-ca\") pod \"console-84884fdfc9-q9qfv\" (UID: \"ac6e545f-8c6c-428e-9d2d-aca431c7f9dd\") " pod="openshift-console/console-84884fdfc9-q9qfv"
Sep 08 10:05:32.369846 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:32.369750    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ac6e545f-8c6c-428e-9d2d-aca431c7f9dd-oauth-serving-cert\") pod \"console-84884fdfc9-q9qfv\" (UID: \"ac6e545f-8c6c-428e-9d2d-aca431c7f9dd\") " pod="openshift-console/console-84884fdfc9-q9qfv"
Sep 08 10:05:32.369909 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:32.369856    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac6e545f-8c6c-428e-9d2d-aca431c7f9dd-trusted-ca-bundle\") pod \"console-84884fdfc9-q9qfv\" (UID: \"ac6e545f-8c6c-428e-9d2d-aca431c7f9dd\") " pod="openshift-console/console-84884fdfc9-q9qfv"
Sep 08 10:05:32.370059 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:32.370037    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ac6e545f-8c6c-428e-9d2d-aca431c7f9dd-console-config\") pod \"console-84884fdfc9-q9qfv\" (UID: \"ac6e545f-8c6c-428e-9d2d-aca431c7f9dd\") " pod="openshift-console/console-84884fdfc9-q9qfv"
Sep 08 10:05:32.371666 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:32.371643    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ac6e545f-8c6c-428e-9d2d-aca431c7f9dd-console-oauth-config\") pod \"console-84884fdfc9-q9qfv\" (UID: \"ac6e545f-8c6c-428e-9d2d-aca431c7f9dd\") " pod="openshift-console/console-84884fdfc9-q9qfv"
Sep 08 10:05:32.371753 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:32.371728    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ac6e545f-8c6c-428e-9d2d-aca431c7f9dd-console-serving-cert\") pod \"console-84884fdfc9-q9qfv\" (UID: \"ac6e545f-8c6c-428e-9d2d-aca431c7f9dd\") " pod="openshift-console/console-84884fdfc9-q9qfv"
Sep 08 10:05:32.378075 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:32.378056    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9qvg\" (UniqueName: \"kubernetes.io/projected/ac6e545f-8c6c-428e-9d2d-aca431c7f9dd-kube-api-access-v9qvg\") pod \"console-84884fdfc9-q9qfv\" (UID: \"ac6e545f-8c6c-428e-9d2d-aca431c7f9dd\") " pod="openshift-console/console-84884fdfc9-q9qfv"
Sep 08 10:05:32.502172 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:32.502109    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84884fdfc9-q9qfv"
Sep 08 10:05:32.779694 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:32.779670    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84884fdfc9-q9qfv"]
Sep 08 10:05:32.782258 ip-10-0-132-96 kubenswrapper[2579]: W0908 10:05:32.782233    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac6e545f_8c6c_428e_9d2d_aca431c7f9dd.slice/crio-bc9a145d7dbcb90d92fc59b510b9785e29479525d657d74b30bd526e734ffede WatchSource:0}: Error finding container bc9a145d7dbcb90d92fc59b510b9785e29479525d657d74b30bd526e734ffede: Status 404 returned error can't find the container with id bc9a145d7dbcb90d92fc59b510b9785e29479525d657d74b30bd526e734ffede
Sep 08 10:05:33.361464 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:33.361431    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84884fdfc9-q9qfv" event={"ID":"ac6e545f-8c6c-428e-9d2d-aca431c7f9dd","Type":"ContainerStarted","Data":"19ff04cc104c74c576e285c71132e69ce3d48ffbb4476902cb822f7ac6286496"}
Sep 08 10:05:33.361866 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:33.361477    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84884fdfc9-q9qfv" event={"ID":"ac6e545f-8c6c-428e-9d2d-aca431c7f9dd","Type":"ContainerStarted","Data":"bc9a145d7dbcb90d92fc59b510b9785e29479525d657d74b30bd526e734ffede"}
Sep 08 10:05:33.383219 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:33.383170    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-84884fdfc9-q9qfv" podStartSLOduration=1.383156644 podStartE2EDuration="1.383156644s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:05:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:05:33.381472161 +0000 UTC m=+447.077071061" watchObservedRunningTime="2026-09-08 10:05:33.383156644 +0000 UTC m=+447.078755543"
Sep 08 10:05:40.758273 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:40.758231    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:05:40.823471 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:40.823436    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:05:42.503246 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:42.503204    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84884fdfc9-q9qfv"
Sep 08 10:05:42.503687 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:42.503289    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-84884fdfc9-q9qfv"
Sep 08 10:05:42.507576 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:42.507557    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-84884fdfc9-q9qfv"
Sep 08 10:05:43.405142 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:43.405114    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-84884fdfc9-q9qfv"
Sep 08 10:05:43.451558 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:43.451506    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59bc56774c-pdcvw"]
Sep 08 10:05:43.571242 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:43.571204    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:05:43.630509 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:43.630481    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:05:44.143529 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:44.143488    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:05:56.114307 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:56.114276    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:05:56.212305 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:56.212262    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:05:56.270970 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:56.270942    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:05:57.180200 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:57.180165    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:05:57.249110 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:05:57.249077    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:06:08.478163 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:06:08.478120    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-59bc56774c-pdcvw" podUID="a90f51bb-7c0a-4c89-af46-bf10f87a7f7c" containerName="console" containerID="cri-o://af0a4ee18e126485829a543a7e55bf6e403be83bcfffc0557c354de4dc7423a0" gracePeriod=15
Sep 08 10:06:08.713016 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:06:08.712993    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59bc56774c-pdcvw"
Sep 08 10:06:08.863681 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:06:08.863655    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w2zl5\" (UniqueName: \"kubernetes.io/projected/a90f51bb-7c0a-4c89-af46-bf10f87a7f7c-kube-api-access-w2zl5\") pod \"a90f51bb-7c0a-4c89-af46-bf10f87a7f7c\" (UID: \"a90f51bb-7c0a-4c89-af46-bf10f87a7f7c\") "
Sep 08 10:06:08.863817 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:06:08.863701    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a90f51bb-7c0a-4c89-af46-bf10f87a7f7c-service-ca\") pod \"a90f51bb-7c0a-4c89-af46-bf10f87a7f7c\" (UID: \"a90f51bb-7c0a-4c89-af46-bf10f87a7f7c\") "
Sep 08 10:06:08.863817 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:06:08.863724    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a90f51bb-7c0a-4c89-af46-bf10f87a7f7c-oauth-serving-cert\") pod \"a90f51bb-7c0a-4c89-af46-bf10f87a7f7c\" (UID: \"a90f51bb-7c0a-4c89-af46-bf10f87a7f7c\") "
Sep 08 10:06:08.863817 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:06:08.863769    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a90f51bb-7c0a-4c89-af46-bf10f87a7f7c-console-config\") pod \"a90f51bb-7c0a-4c89-af46-bf10f87a7f7c\" (UID: \"a90f51bb-7c0a-4c89-af46-bf10f87a7f7c\") "
Sep 08 10:06:08.863817 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:06:08.863810    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a90f51bb-7c0a-4c89-af46-bf10f87a7f7c-trusted-ca-bundle\") pod \"a90f51bb-7c0a-4c89-af46-bf10f87a7f7c\" (UID: \"a90f51bb-7c0a-4c89-af46-bf10f87a7f7c\") "
Sep 08 10:06:08.863996 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:06:08.863844    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a90f51bb-7c0a-4c89-af46-bf10f87a7f7c-console-serving-cert\") pod \"a90f51bb-7c0a-4c89-af46-bf10f87a7f7c\" (UID: \"a90f51bb-7c0a-4c89-af46-bf10f87a7f7c\") "
Sep 08 10:06:08.863996 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:06:08.863900    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a90f51bb-7c0a-4c89-af46-bf10f87a7f7c-console-oauth-config\") pod \"a90f51bb-7c0a-4c89-af46-bf10f87a7f7c\" (UID: \"a90f51bb-7c0a-4c89-af46-bf10f87a7f7c\") "
Sep 08 10:06:08.864159 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:06:08.864136    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a90f51bb-7c0a-4c89-af46-bf10f87a7f7c-service-ca" (OuterVolumeSpecName: "service-ca") pod "a90f51bb-7c0a-4c89-af46-bf10f87a7f7c" (UID: "a90f51bb-7c0a-4c89-af46-bf10f87a7f7c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:06:08.864220 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:06:08.864189    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a90f51bb-7c0a-4c89-af46-bf10f87a7f7c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a90f51bb-7c0a-4c89-af46-bf10f87a7f7c" (UID: "a90f51bb-7c0a-4c89-af46-bf10f87a7f7c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:06:08.864220 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:06:08.864201    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a90f51bb-7c0a-4c89-af46-bf10f87a7f7c-console-config" (OuterVolumeSpecName: "console-config") pod "a90f51bb-7c0a-4c89-af46-bf10f87a7f7c" (UID: "a90f51bb-7c0a-4c89-af46-bf10f87a7f7c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:06:08.864318 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:06:08.864250    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a90f51bb-7c0a-4c89-af46-bf10f87a7f7c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a90f51bb-7c0a-4c89-af46-bf10f87a7f7c" (UID: "a90f51bb-7c0a-4c89-af46-bf10f87a7f7c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:06:08.866010 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:06:08.865983    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a90f51bb-7c0a-4c89-af46-bf10f87a7f7c-kube-api-access-w2zl5" (OuterVolumeSpecName: "kube-api-access-w2zl5") pod "a90f51bb-7c0a-4c89-af46-bf10f87a7f7c" (UID: "a90f51bb-7c0a-4c89-af46-bf10f87a7f7c"). InnerVolumeSpecName "kube-api-access-w2zl5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:06:08.866121 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:06:08.866038    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a90f51bb-7c0a-4c89-af46-bf10f87a7f7c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a90f51bb-7c0a-4c89-af46-bf10f87a7f7c" (UID: "a90f51bb-7c0a-4c89-af46-bf10f87a7f7c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:06:08.866247 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:06:08.866228    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a90f51bb-7c0a-4c89-af46-bf10f87a7f7c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a90f51bb-7c0a-4c89-af46-bf10f87a7f7c" (UID: "a90f51bb-7c0a-4c89-af46-bf10f87a7f7c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:06:08.965147 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:06:08.965121    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a90f51bb-7c0a-4c89-af46-bf10f87a7f7c-console-oauth-config\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:06:08.965147 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:06:08.965153    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w2zl5\" (UniqueName: \"kubernetes.io/projected/a90f51bb-7c0a-4c89-af46-bf10f87a7f7c-kube-api-access-w2zl5\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:06:08.965281 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:06:08.965170    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a90f51bb-7c0a-4c89-af46-bf10f87a7f7c-service-ca\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:06:08.965281 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:06:08.965186    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a90f51bb-7c0a-4c89-af46-bf10f87a7f7c-oauth-serving-cert\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:06:08.965281 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:06:08.965201    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a90f51bb-7c0a-4c89-af46-bf10f87a7f7c-console-config\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:06:08.965281 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:06:08.965214    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a90f51bb-7c0a-4c89-af46-bf10f87a7f7c-trusted-ca-bundle\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:06:08.965281 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:06:08.965226    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a90f51bb-7c0a-4c89-af46-bf10f87a7f7c-console-serving-cert\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:06:09.501856 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:06:09.501825    2579 generic.go:356] "Generic (PLEG): container finished" podID="a90f51bb-7c0a-4c89-af46-bf10f87a7f7c" containerID="af0a4ee18e126485829a543a7e55bf6e403be83bcfffc0557c354de4dc7423a0" exitCode=0
Sep 08 10:06:09.502246 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:06:09.501873    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59bc56774c-pdcvw"
Sep 08 10:06:09.502246 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:06:09.501881    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59bc56774c-pdcvw" event={"ID":"a90f51bb-7c0a-4c89-af46-bf10f87a7f7c","Type":"ContainerDied","Data":"af0a4ee18e126485829a543a7e55bf6e403be83bcfffc0557c354de4dc7423a0"}
Sep 08 10:06:09.502246 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:06:09.501920    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59bc56774c-pdcvw" event={"ID":"a90f51bb-7c0a-4c89-af46-bf10f87a7f7c","Type":"ContainerDied","Data":"bad1e024cbc22dd6ee858621865e86ed76c945c3b114c39f42872422e551aa23"}
Sep 08 10:06:09.502246 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:06:09.501937    2579 scope.go:117] "RemoveContainer" containerID="af0a4ee18e126485829a543a7e55bf6e403be83bcfffc0557c354de4dc7423a0"
Sep 08 10:06:09.510658 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:06:09.510642    2579 scope.go:117] "RemoveContainer" containerID="af0a4ee18e126485829a543a7e55bf6e403be83bcfffc0557c354de4dc7423a0"
Sep 08 10:06:09.510904 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:06:09.510888    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af0a4ee18e126485829a543a7e55bf6e403be83bcfffc0557c354de4dc7423a0\": container with ID starting with af0a4ee18e126485829a543a7e55bf6e403be83bcfffc0557c354de4dc7423a0 not found: ID does not exist" containerID="af0a4ee18e126485829a543a7e55bf6e403be83bcfffc0557c354de4dc7423a0"
Sep 08 10:06:09.510950 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:06:09.510911    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af0a4ee18e126485829a543a7e55bf6e403be83bcfffc0557c354de4dc7423a0"} err="failed to get container status \"af0a4ee18e126485829a543a7e55bf6e403be83bcfffc0557c354de4dc7423a0\": rpc error: code = NotFound desc = could not find container \"af0a4ee18e126485829a543a7e55bf6e403be83bcfffc0557c354de4dc7423a0\": container with ID starting with af0a4ee18e126485829a543a7e55bf6e403be83bcfffc0557c354de4dc7423a0 not found: ID does not exist"
Sep 08 10:06:09.521897 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:06:09.521874    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-59bc56774c-pdcvw"]
Sep 08 10:06:09.525705 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:06:09.525686    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-59bc56774c-pdcvw"]
Sep 08 10:06:10.837976 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:06:10.837937    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a90f51bb-7c0a-4c89-af46-bf10f87a7f7c" path="/var/lib/kubelet/pods/a90f51bb-7c0a-4c89-af46-bf10f87a7f7c/volumes"
Sep 08 10:07:18.223001 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:07:18.222962    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:07:57.457953 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:07:57.457907    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:07:57.554629 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:07:57.554594    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:07:58.359723 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:07:58.359691    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:07:58.376206 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:07:58.376180    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-77944b5d44-d55x7"]
Sep 08 10:07:58.376493 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:07:58.376482    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a90f51bb-7c0a-4c89-af46-bf10f87a7f7c" containerName="console"
Sep 08 10:07:58.376555 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:07:58.376495    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a90f51bb-7c0a-4c89-af46-bf10f87a7f7c" containerName="console"
Sep 08 10:07:58.376596 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:07:58.376573    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a90f51bb-7c0a-4c89-af46-bf10f87a7f7c" containerName="console"
Sep 08 10:07:58.379437 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:07:58.379423    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-77944b5d44-d55x7"
Sep 08 10:07:58.382657 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:07:58.382639    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
Sep 08 10:07:58.382763 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:07:58.382643    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
Sep 08 10:07:58.383817 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:07:58.383800    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-z46h7\""
Sep 08 10:07:58.401216 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:07:58.401197    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-77944b5d44-d55x7"]
Sep 08 10:07:58.476492 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:07:58.476465    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdbr7\" (UniqueName: \"kubernetes.io/projected/07dd8d17-18da-433c-99b8-b1009040f13d-kube-api-access-hdbr7\") pod \"feast-operator-controller-manager-77944b5d44-d55x7\" (UID: \"07dd8d17-18da-433c-99b8-b1009040f13d\") " pod="feast-operator-system/feast-operator-controller-manager-77944b5d44-d55x7"
Sep 08 10:07:58.577355 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:07:58.577330    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdbr7\" (UniqueName: \"kubernetes.io/projected/07dd8d17-18da-433c-99b8-b1009040f13d-kube-api-access-hdbr7\") pod \"feast-operator-controller-manager-77944b5d44-d55x7\" (UID: \"07dd8d17-18da-433c-99b8-b1009040f13d\") " pod="feast-operator-system/feast-operator-controller-manager-77944b5d44-d55x7"
Sep 08 10:07:58.587929 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:07:58.587910    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdbr7\" (UniqueName: \"kubernetes.io/projected/07dd8d17-18da-433c-99b8-b1009040f13d-kube-api-access-hdbr7\") pod \"feast-operator-controller-manager-77944b5d44-d55x7\" (UID: \"07dd8d17-18da-433c-99b8-b1009040f13d\") " pod="feast-operator-system/feast-operator-controller-manager-77944b5d44-d55x7"
Sep 08 10:07:58.689333 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:07:58.689269    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-77944b5d44-d55x7"
Sep 08 10:07:58.969212 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:07:58.969131    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-77944b5d44-d55x7"]
Sep 08 10:07:58.972348 ip-10-0-132-96 kubenswrapper[2579]: W0908 10:07:58.972318    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07dd8d17_18da_433c_99b8_b1009040f13d.slice/crio-8f329ee9e193e03ecceec5452dcc7148ac1813d4d497e78fdc71346622881352 WatchSource:0}: Error finding container 8f329ee9e193e03ecceec5452dcc7148ac1813d4d497e78fdc71346622881352: Status 404 returned error can't find the container with id 8f329ee9e193e03ecceec5452dcc7148ac1813d4d497e78fdc71346622881352
Sep 08 10:07:59.942382 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:07:59.942345    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-77944b5d44-d55x7" event={"ID":"07dd8d17-18da-433c-99b8-b1009040f13d","Type":"ContainerStarted","Data":"8f329ee9e193e03ecceec5452dcc7148ac1813d4d497e78fdc71346622881352"}
Sep 08 10:08:04.972436 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:04.972394    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-77944b5d44-d55x7" event={"ID":"07dd8d17-18da-433c-99b8-b1009040f13d","Type":"ContainerStarted","Data":"f4ec3e0b42ad60ffd0776d8eccc670caddfef6b6fa50333cf9acf73db208ffa5"}
Sep 08 10:08:04.972839 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:04.972511    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-77944b5d44-d55x7"
Sep 08 10:08:04.990630 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:04.990581    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-77944b5d44-d55x7" podStartSLOduration=1.694680071 podStartE2EDuration="6.990567057s" totalImagesPullingTime="5.295886986s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:07:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:08:04.98859714 +0000 UTC m=+598.684196041" watchObservedRunningTime="2026-09-08 10:08:04.990567057 +0000 UTC m=+598.686165957"
Sep 08 10:08:15.978999 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:15.978960    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-77944b5d44-d55x7"
Sep 08 10:08:22.388910 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:22.388876    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c68549f78-wqvn9"]
Sep 08 10:08:22.392097 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:22.392079    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c68549f78-wqvn9"
Sep 08 10:08:22.408614 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:22.408589    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c68549f78-wqvn9"]
Sep 08 10:08:22.456248 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:22.456219    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:08:22.469197 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:22.469171    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98cfcd3d-a887-4e3f-9b6f-fc6bd1bcd1ee-trusted-ca-bundle\") pod \"console-6c68549f78-wqvn9\" (UID: \"98cfcd3d-a887-4e3f-9b6f-fc6bd1bcd1ee\") " pod="openshift-console/console-6c68549f78-wqvn9"
Sep 08 10:08:22.469263 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:22.469213    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/98cfcd3d-a887-4e3f-9b6f-fc6bd1bcd1ee-console-serving-cert\") pod \"console-6c68549f78-wqvn9\" (UID: \"98cfcd3d-a887-4e3f-9b6f-fc6bd1bcd1ee\") " pod="openshift-console/console-6c68549f78-wqvn9"
Sep 08 10:08:22.469263 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:22.469234    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/98cfcd3d-a887-4e3f-9b6f-fc6bd1bcd1ee-console-config\") pod \"console-6c68549f78-wqvn9\" (UID: \"98cfcd3d-a887-4e3f-9b6f-fc6bd1bcd1ee\") " pod="openshift-console/console-6c68549f78-wqvn9"
Sep 08 10:08:22.469347 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:22.469324    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/98cfcd3d-a887-4e3f-9b6f-fc6bd1bcd1ee-console-oauth-config\") pod \"console-6c68549f78-wqvn9\" (UID: \"98cfcd3d-a887-4e3f-9b6f-fc6bd1bcd1ee\") " pod="openshift-console/console-6c68549f78-wqvn9"
Sep 08 10:08:22.469382 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:22.469359    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/98cfcd3d-a887-4e3f-9b6f-fc6bd1bcd1ee-oauth-serving-cert\") pod \"console-6c68549f78-wqvn9\" (UID: \"98cfcd3d-a887-4e3f-9b6f-fc6bd1bcd1ee\") " pod="openshift-console/console-6c68549f78-wqvn9"
Sep 08 10:08:22.469412 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:22.469383    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/98cfcd3d-a887-4e3f-9b6f-fc6bd1bcd1ee-service-ca\") pod \"console-6c68549f78-wqvn9\" (UID: \"98cfcd3d-a887-4e3f-9b6f-fc6bd1bcd1ee\") " pod="openshift-console/console-6c68549f78-wqvn9"
Sep 08 10:08:22.469444 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:22.469417    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpgrj\" (UniqueName: \"kubernetes.io/projected/98cfcd3d-a887-4e3f-9b6f-fc6bd1bcd1ee-kube-api-access-tpgrj\") pod \"console-6c68549f78-wqvn9\" (UID: \"98cfcd3d-a887-4e3f-9b6f-fc6bd1bcd1ee\") " pod="openshift-console/console-6c68549f78-wqvn9"
Sep 08 10:08:22.570530 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:22.570505    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/98cfcd3d-a887-4e3f-9b6f-fc6bd1bcd1ee-console-oauth-config\") pod \"console-6c68549f78-wqvn9\" (UID: \"98cfcd3d-a887-4e3f-9b6f-fc6bd1bcd1ee\") " pod="openshift-console/console-6c68549f78-wqvn9"
Sep 08 10:08:22.570657 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:22.570553    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/98cfcd3d-a887-4e3f-9b6f-fc6bd1bcd1ee-oauth-serving-cert\") pod \"console-6c68549f78-wqvn9\" (UID: \"98cfcd3d-a887-4e3f-9b6f-fc6bd1bcd1ee\") " pod="openshift-console/console-6c68549f78-wqvn9"
Sep 08 10:08:22.570657 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:22.570573    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/98cfcd3d-a887-4e3f-9b6f-fc6bd1bcd1ee-service-ca\") pod \"console-6c68549f78-wqvn9\" (UID: \"98cfcd3d-a887-4e3f-9b6f-fc6bd1bcd1ee\") " pod="openshift-console/console-6c68549f78-wqvn9"
Sep 08 10:08:22.570657 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:22.570590    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpgrj\" (UniqueName: \"kubernetes.io/projected/98cfcd3d-a887-4e3f-9b6f-fc6bd1bcd1ee-kube-api-access-tpgrj\") pod \"console-6c68549f78-wqvn9\" (UID: \"98cfcd3d-a887-4e3f-9b6f-fc6bd1bcd1ee\") " pod="openshift-console/console-6c68549f78-wqvn9"
Sep 08 10:08:22.570657 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:22.570616    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98cfcd3d-a887-4e3f-9b6f-fc6bd1bcd1ee-trusted-ca-bundle\") pod \"console-6c68549f78-wqvn9\" (UID: \"98cfcd3d-a887-4e3f-9b6f-fc6bd1bcd1ee\") " pod="openshift-console/console-6c68549f78-wqvn9"
Sep 08 10:08:22.570657 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:22.570643    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/98cfcd3d-a887-4e3f-9b6f-fc6bd1bcd1ee-console-serving-cert\") pod \"console-6c68549f78-wqvn9\" (UID: \"98cfcd3d-a887-4e3f-9b6f-fc6bd1bcd1ee\") " pod="openshift-console/console-6c68549f78-wqvn9"
Sep 08 10:08:22.570876 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:22.570662    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/98cfcd3d-a887-4e3f-9b6f-fc6bd1bcd1ee-console-config\") pod \"console-6c68549f78-wqvn9\" (UID: \"98cfcd3d-a887-4e3f-9b6f-fc6bd1bcd1ee\") " pod="openshift-console/console-6c68549f78-wqvn9"
Sep 08 10:08:22.571327 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:22.571306    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/98cfcd3d-a887-4e3f-9b6f-fc6bd1bcd1ee-oauth-serving-cert\") pod \"console-6c68549f78-wqvn9\" (UID: \"98cfcd3d-a887-4e3f-9b6f-fc6bd1bcd1ee\") " pod="openshift-console/console-6c68549f78-wqvn9"
Sep 08 10:08:22.571410 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:22.571332    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/98cfcd3d-a887-4e3f-9b6f-fc6bd1bcd1ee-console-config\") pod \"console-6c68549f78-wqvn9\" (UID: \"98cfcd3d-a887-4e3f-9b6f-fc6bd1bcd1ee\") " pod="openshift-console/console-6c68549f78-wqvn9"
Sep 08 10:08:22.571663 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:22.571643    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/98cfcd3d-a887-4e3f-9b6f-fc6bd1bcd1ee-service-ca\") pod \"console-6c68549f78-wqvn9\" (UID: \"98cfcd3d-a887-4e3f-9b6f-fc6bd1bcd1ee\") " pod="openshift-console/console-6c68549f78-wqvn9"
Sep 08 10:08:22.571851 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:22.571828    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/98cfcd3d-a887-4e3f-9b6f-fc6bd1bcd1ee-trusted-ca-bundle\") pod \"console-6c68549f78-wqvn9\" (UID: \"98cfcd3d-a887-4e3f-9b6f-fc6bd1bcd1ee\") " pod="openshift-console/console-6c68549f78-wqvn9"
Sep 08 10:08:22.573144 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:22.573115    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/98cfcd3d-a887-4e3f-9b6f-fc6bd1bcd1ee-console-oauth-config\") pod \"console-6c68549f78-wqvn9\" (UID: \"98cfcd3d-a887-4e3f-9b6f-fc6bd1bcd1ee\") " pod="openshift-console/console-6c68549f78-wqvn9"
Sep 08 10:08:22.573302 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:22.573282    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/98cfcd3d-a887-4e3f-9b6f-fc6bd1bcd1ee-console-serving-cert\") pod \"console-6c68549f78-wqvn9\" (UID: \"98cfcd3d-a887-4e3f-9b6f-fc6bd1bcd1ee\") " pod="openshift-console/console-6c68549f78-wqvn9"
Sep 08 10:08:22.583775 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:22.583756    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpgrj\" (UniqueName: \"kubernetes.io/projected/98cfcd3d-a887-4e3f-9b6f-fc6bd1bcd1ee-kube-api-access-tpgrj\") pod \"console-6c68549f78-wqvn9\" (UID: \"98cfcd3d-a887-4e3f-9b6f-fc6bd1bcd1ee\") " pod="openshift-console/console-6c68549f78-wqvn9"
Sep 08 10:08:22.701136 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:22.701076    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c68549f78-wqvn9"
Sep 08 10:08:22.995616 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:22.995526    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c68549f78-wqvn9"]
Sep 08 10:08:22.998792 ip-10-0-132-96 kubenswrapper[2579]: W0908 10:08:22.998758    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98cfcd3d_a887_4e3f_9b6f_fc6bd1bcd1ee.slice/crio-b8cb2bcb194684a983bc2b7f5fb4d09b40e0117525ce39fc33a97d584f01d7e7 WatchSource:0}: Error finding container b8cb2bcb194684a983bc2b7f5fb4d09b40e0117525ce39fc33a97d584f01d7e7: Status 404 returned error can't find the container with id b8cb2bcb194684a983bc2b7f5fb4d09b40e0117525ce39fc33a97d584f01d7e7
Sep 08 10:08:23.043715 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:23.043687    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c68549f78-wqvn9" event={"ID":"98cfcd3d-a887-4e3f-9b6f-fc6bd1bcd1ee","Type":"ContainerStarted","Data":"b8cb2bcb194684a983bc2b7f5fb4d09b40e0117525ce39fc33a97d584f01d7e7"}
Sep 08 10:08:24.049321 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:24.049286    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c68549f78-wqvn9" event={"ID":"98cfcd3d-a887-4e3f-9b6f-fc6bd1bcd1ee","Type":"ContainerStarted","Data":"dcd9611dc4720f3a64ea9d25432e1ede60653b93e70ad2c2e4ef5873eccf9d55"}
Sep 08 10:08:24.072148 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:24.072095    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c68549f78-wqvn9" podStartSLOduration=2.072075149 podStartE2EDuration="2.072075149s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:08:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:08:24.070634381 +0000 UTC m=+617.766233294" watchObservedRunningTime="2026-09-08 10:08:24.072075149 +0000 UTC m=+617.767674052"
Sep 08 10:08:27.454051 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:27.454016    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:08:32.701874 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:32.701789    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c68549f78-wqvn9"
Sep 08 10:08:32.702316 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:32.701886    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c68549f78-wqvn9"
Sep 08 10:08:32.706677 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:32.706654    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c68549f78-wqvn9"
Sep 08 10:08:33.089117 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:33.089090    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c68549f78-wqvn9"
Sep 08 10:08:33.194335 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:33.194308    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84884fdfc9-q9qfv"]
Sep 08 10:08:33.396556 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:33.396445    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:08:33.512066 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:33.512032    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:08:37.719308 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:37.719263    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:08:37.822065 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:37.822033    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:08:38.309168 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:38.309132    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:08:38.419979 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:38.419948    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:08:38.497720 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:38.497684    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw"]
Sep 08 10:08:38.504681 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:38.504652    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw"
Sep 08 10:08:38.507760 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:38.507734    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Sep 08 10:08:38.507986 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:38.507971    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-k5hck\""
Sep 08 10:08:38.508973 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:38.508938    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Sep 08 10:08:38.509096 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:38.508984    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Sep 08 10:08:38.509096 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:38.508985    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Sep 08 10:08:38.509096 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:38.509035    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
Sep 08 10:08:38.509096 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:38.509065    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Sep 08 10:08:38.509096 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:38.508990    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Sep 08 10:08:38.520397 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:38.520376    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw"]
Sep 08 10:08:38.540440 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:38.540412    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:08:38.603234 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:38.603169    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7bbbcbc1-3268-4a81-8f11-37b15de30f34-feast-data\") pod \"feast-simple-feast-setup-cf54dbbd5-gq2tw\" (UID: \"7bbbcbc1-3268-4a81-8f11-37b15de30f34\") " pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw"
Sep 08 10:08:38.603234 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:38.603206    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7bbbcbc1-3268-4a81-8f11-37b15de30f34-online-tls\") pod \"feast-simple-feast-setup-cf54dbbd5-gq2tw\" (UID: \"7bbbcbc1-3268-4a81-8f11-37b15de30f34\") " pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw"
Sep 08 10:08:38.603234 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:38.603224    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7bbbcbc1-3268-4a81-8f11-37b15de30f34-registry-tls\") pod \"feast-simple-feast-setup-cf54dbbd5-gq2tw\" (UID: \"7bbbcbc1-3268-4a81-8f11-37b15de30f34\") " pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw"
Sep 08 10:08:38.603466 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:38.603302    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7bbbcbc1-3268-4a81-8f11-37b15de30f34-ui-tls\") pod \"feast-simple-feast-setup-cf54dbbd5-gq2tw\" (UID: \"7bbbcbc1-3268-4a81-8f11-37b15de30f34\") " pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw"
Sep 08 10:08:38.603466 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:38.603360    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mb4s\" (UniqueName: \"kubernetes.io/projected/7bbbcbc1-3268-4a81-8f11-37b15de30f34-kube-api-access-2mb4s\") pod \"feast-simple-feast-setup-cf54dbbd5-gq2tw\" (UID: \"7bbbcbc1-3268-4a81-8f11-37b15de30f34\") " pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw"
Sep 08 10:08:38.603466 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:38.603450    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7bbbcbc1-3268-4a81-8f11-37b15de30f34-offline-tls\") pod \"feast-simple-feast-setup-cf54dbbd5-gq2tw\" (UID: \"7bbbcbc1-3268-4a81-8f11-37b15de30f34\") " pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw"
Sep 08 10:08:38.628723 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:38.628695    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:08:38.704320 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:38.704297    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7bbbcbc1-3268-4a81-8f11-37b15de30f34-online-tls\") pod \"feast-simple-feast-setup-cf54dbbd5-gq2tw\" (UID: \"7bbbcbc1-3268-4a81-8f11-37b15de30f34\") " pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw"
Sep 08 10:08:38.704432 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:38.704323    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7bbbcbc1-3268-4a81-8f11-37b15de30f34-registry-tls\") pod \"feast-simple-feast-setup-cf54dbbd5-gq2tw\" (UID: \"7bbbcbc1-3268-4a81-8f11-37b15de30f34\") " pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw"
Sep 08 10:08:38.704432 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:38.704351    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7bbbcbc1-3268-4a81-8f11-37b15de30f34-ui-tls\") pod \"feast-simple-feast-setup-cf54dbbd5-gq2tw\" (UID: \"7bbbcbc1-3268-4a81-8f11-37b15de30f34\") " pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw"
Sep 08 10:08:38.704432 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:38.704376    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mb4s\" (UniqueName: \"kubernetes.io/projected/7bbbcbc1-3268-4a81-8f11-37b15de30f34-kube-api-access-2mb4s\") pod \"feast-simple-feast-setup-cf54dbbd5-gq2tw\" (UID: \"7bbbcbc1-3268-4a81-8f11-37b15de30f34\") " pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw"
Sep 08 10:08:38.704432 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:38.704413    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7bbbcbc1-3268-4a81-8f11-37b15de30f34-offline-tls\") pod \"feast-simple-feast-setup-cf54dbbd5-gq2tw\" (UID: \"7bbbcbc1-3268-4a81-8f11-37b15de30f34\") " pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw"
Sep 08 10:08:38.704432 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:38.704431    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7bbbcbc1-3268-4a81-8f11-37b15de30f34-feast-data\") pod \"feast-simple-feast-setup-cf54dbbd5-gq2tw\" (UID: \"7bbbcbc1-3268-4a81-8f11-37b15de30f34\") " pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw"
Sep 08 10:08:38.704704 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:08:38.704460    2579 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
Sep 08 10:08:38.704704 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:08:38.704521    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7bbbcbc1-3268-4a81-8f11-37b15de30f34-registry-tls podName:7bbbcbc1-3268-4a81-8f11-37b15de30f34 nodeName:}" failed. No retries permitted until 2026-09-08 10:08:39.204502276 +0000 UTC m=+632.900101167 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/7bbbcbc1-3268-4a81-8f11-37b15de30f34-registry-tls") pod "feast-simple-feast-setup-cf54dbbd5-gq2tw" (UID: "7bbbcbc1-3268-4a81-8f11-37b15de30f34") : secret "feast-simple-feast-setup-registry-tls" not found
Sep 08 10:08:38.704865 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:38.704841    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7bbbcbc1-3268-4a81-8f11-37b15de30f34-feast-data\") pod \"feast-simple-feast-setup-cf54dbbd5-gq2tw\" (UID: \"7bbbcbc1-3268-4a81-8f11-37b15de30f34\") " pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw"
Sep 08 10:08:38.706960 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:38.706932    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7bbbcbc1-3268-4a81-8f11-37b15de30f34-ui-tls\") pod \"feast-simple-feast-setup-cf54dbbd5-gq2tw\" (UID: \"7bbbcbc1-3268-4a81-8f11-37b15de30f34\") " pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw"
Sep 08 10:08:38.707104 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:38.707081    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7bbbcbc1-3268-4a81-8f11-37b15de30f34-offline-tls\") pod \"feast-simple-feast-setup-cf54dbbd5-gq2tw\" (UID: \"7bbbcbc1-3268-4a81-8f11-37b15de30f34\") " pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw"
Sep 08 10:08:38.707165 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:38.707125    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7bbbcbc1-3268-4a81-8f11-37b15de30f34-online-tls\") pod \"feast-simple-feast-setup-cf54dbbd5-gq2tw\" (UID: \"7bbbcbc1-3268-4a81-8f11-37b15de30f34\") " pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw"
Sep 08 10:08:38.717835 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:38.717817    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mb4s\" (UniqueName: \"kubernetes.io/projected/7bbbcbc1-3268-4a81-8f11-37b15de30f34-kube-api-access-2mb4s\") pod \"feast-simple-feast-setup-cf54dbbd5-gq2tw\" (UID: \"7bbbcbc1-3268-4a81-8f11-37b15de30f34\") " pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw"
Sep 08 10:08:38.781279 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:38.781253    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:08:39.208840 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:39.208802    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7bbbcbc1-3268-4a81-8f11-37b15de30f34-registry-tls\") pod \"feast-simple-feast-setup-cf54dbbd5-gq2tw\" (UID: \"7bbbcbc1-3268-4a81-8f11-37b15de30f34\") " pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw"
Sep 08 10:08:39.211656 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:39.211631    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7bbbcbc1-3268-4a81-8f11-37b15de30f34-registry-tls\") pod \"feast-simple-feast-setup-cf54dbbd5-gq2tw\" (UID: \"7bbbcbc1-3268-4a81-8f11-37b15de30f34\") " pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw"
Sep 08 10:08:39.433008 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:39.432975    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw"
Sep 08 10:08:39.718924 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:39.718890    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw"]
Sep 08 10:08:39.722142 ip-10-0-132-96 kubenswrapper[2579]: W0908 10:08:39.722107    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7bbbcbc1_3268_4a81_8f11_37b15de30f34.slice/crio-17f7705166d168536811094650c86a05650b5bb2a18dce96907cc57c57e10187 WatchSource:0}: Error finding container 17f7705166d168536811094650c86a05650b5bb2a18dce96907cc57c57e10187: Status 404 returned error can't find the container with id 17f7705166d168536811094650c86a05650b5bb2a18dce96907cc57c57e10187
Sep 08 10:08:39.724475 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:39.724456    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 10:08:40.114936 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:40.114898    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw" event={"ID":"7bbbcbc1-3268-4a81-8f11-37b15de30f34","Type":"ContainerStarted","Data":"17f7705166d168536811094650c86a05650b5bb2a18dce96907cc57c57e10187"}
Sep 08 10:08:58.214314 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:08:58.214261    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-84884fdfc9-q9qfv" podUID="ac6e545f-8c6c-428e-9d2d-aca431c7f9dd" containerName="console" containerID="cri-o://19ff04cc104c74c576e285c71132e69ce3d48ffbb4476902cb822f7ac6286496" gracePeriod=15
Sep 08 10:09:03.402571 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:03.402514    2579 patch_prober.go:28] interesting pod/console-84884fdfc9-q9qfv container/console namespace/openshift-console: Readiness probe status=failure output="Get \"https://10.133.0.25:8443/health\": dial tcp 10.133.0.25:8443: connect: connection refused" start-of-body=
Sep 08 10:09:03.403008 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:03.402593    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/console-84884fdfc9-q9qfv" podUID="ac6e545f-8c6c-428e-9d2d-aca431c7f9dd" containerName="console" probeResult="failure" output="Get \"https://10.133.0.25:8443/health\": dial tcp 10.133.0.25:8443: connect: connection refused"
Sep 08 10:09:06.247161 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:06.247135    2579 generic.go:356] "Generic (PLEG): container finished" podID="ac6e545f-8c6c-428e-9d2d-aca431c7f9dd" containerID="19ff04cc104c74c576e285c71132e69ce3d48ffbb4476902cb822f7ac6286496" exitCode=0
Sep 08 10:09:06.247518 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:06.247203    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84884fdfc9-q9qfv" event={"ID":"ac6e545f-8c6c-428e-9d2d-aca431c7f9dd","Type":"ContainerDied","Data":"19ff04cc104c74c576e285c71132e69ce3d48ffbb4476902cb822f7ac6286496"}
Sep 08 10:09:06.333941 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:06.333908    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84884fdfc9-q9qfv"
Sep 08 10:09:06.446759 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:06.446669    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ac6e545f-8c6c-428e-9d2d-aca431c7f9dd-console-serving-cert\") pod \"ac6e545f-8c6c-428e-9d2d-aca431c7f9dd\" (UID: \"ac6e545f-8c6c-428e-9d2d-aca431c7f9dd\") "
Sep 08 10:09:06.446759 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:06.446710    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ac6e545f-8c6c-428e-9d2d-aca431c7f9dd-service-ca\") pod \"ac6e545f-8c6c-428e-9d2d-aca431c7f9dd\" (UID: \"ac6e545f-8c6c-428e-9d2d-aca431c7f9dd\") "
Sep 08 10:09:06.446759 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:06.446743    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ac6e545f-8c6c-428e-9d2d-aca431c7f9dd-oauth-serving-cert\") pod \"ac6e545f-8c6c-428e-9d2d-aca431c7f9dd\" (UID: \"ac6e545f-8c6c-428e-9d2d-aca431c7f9dd\") "
Sep 08 10:09:06.447021 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:06.446797    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v9qvg\" (UniqueName: \"kubernetes.io/projected/ac6e545f-8c6c-428e-9d2d-aca431c7f9dd-kube-api-access-v9qvg\") pod \"ac6e545f-8c6c-428e-9d2d-aca431c7f9dd\" (UID: \"ac6e545f-8c6c-428e-9d2d-aca431c7f9dd\") "
Sep 08 10:09:06.447021 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:06.446848    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ac6e545f-8c6c-428e-9d2d-aca431c7f9dd-console-oauth-config\") pod \"ac6e545f-8c6c-428e-9d2d-aca431c7f9dd\" (UID: \"ac6e545f-8c6c-428e-9d2d-aca431c7f9dd\") "
Sep 08 10:09:06.447140 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:06.447013    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac6e545f-8c6c-428e-9d2d-aca431c7f9dd-trusted-ca-bundle\") pod \"ac6e545f-8c6c-428e-9d2d-aca431c7f9dd\" (UID: \"ac6e545f-8c6c-428e-9d2d-aca431c7f9dd\") "
Sep 08 10:09:06.447140 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:06.447073    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ac6e545f-8c6c-428e-9d2d-aca431c7f9dd-console-config\") pod \"ac6e545f-8c6c-428e-9d2d-aca431c7f9dd\" (UID: \"ac6e545f-8c6c-428e-9d2d-aca431c7f9dd\") "
Sep 08 10:09:06.447257 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:06.447188    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac6e545f-8c6c-428e-9d2d-aca431c7f9dd-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ac6e545f-8c6c-428e-9d2d-aca431c7f9dd" (UID: "ac6e545f-8c6c-428e-9d2d-aca431c7f9dd"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:09:06.447257 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:06.447234    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac6e545f-8c6c-428e-9d2d-aca431c7f9dd-service-ca" (OuterVolumeSpecName: "service-ca") pod "ac6e545f-8c6c-428e-9d2d-aca431c7f9dd" (UID: "ac6e545f-8c6c-428e-9d2d-aca431c7f9dd"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:09:06.447361 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:06.447343    2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ac6e545f-8c6c-428e-9d2d-aca431c7f9dd-oauth-serving-cert\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:09:06.447361 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:06.447344    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac6e545f-8c6c-428e-9d2d-aca431c7f9dd-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ac6e545f-8c6c-428e-9d2d-aca431c7f9dd" (UID: "ac6e545f-8c6c-428e-9d2d-aca431c7f9dd"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:09:06.447466 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:06.447361    2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ac6e545f-8c6c-428e-9d2d-aca431c7f9dd-service-ca\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:09:06.447466 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:06.447411    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac6e545f-8c6c-428e-9d2d-aca431c7f9dd-console-config" (OuterVolumeSpecName: "console-config") pod "ac6e545f-8c6c-428e-9d2d-aca431c7f9dd" (UID: "ac6e545f-8c6c-428e-9d2d-aca431c7f9dd"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:09:06.449110 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:06.449079    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac6e545f-8c6c-428e-9d2d-aca431c7f9dd-kube-api-access-v9qvg" (OuterVolumeSpecName: "kube-api-access-v9qvg") pod "ac6e545f-8c6c-428e-9d2d-aca431c7f9dd" (UID: "ac6e545f-8c6c-428e-9d2d-aca431c7f9dd"). InnerVolumeSpecName "kube-api-access-v9qvg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:09:06.449214 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:06.449154    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac6e545f-8c6c-428e-9d2d-aca431c7f9dd-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ac6e545f-8c6c-428e-9d2d-aca431c7f9dd" (UID: "ac6e545f-8c6c-428e-9d2d-aca431c7f9dd"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:09:06.449397 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:06.449375    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac6e545f-8c6c-428e-9d2d-aca431c7f9dd-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ac6e545f-8c6c-428e-9d2d-aca431c7f9dd" (UID: "ac6e545f-8c6c-428e-9d2d-aca431c7f9dd"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:09:06.548101 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:06.548073    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac6e545f-8c6c-428e-9d2d-aca431c7f9dd-trusted-ca-bundle\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:09:06.548287 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:06.548275    2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ac6e545f-8c6c-428e-9d2d-aca431c7f9dd-console-config\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:09:06.548371 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:06.548361    2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ac6e545f-8c6c-428e-9d2d-aca431c7f9dd-console-serving-cert\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:09:06.548453 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:06.548441    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v9qvg\" (UniqueName: \"kubernetes.io/projected/ac6e545f-8c6c-428e-9d2d-aca431c7f9dd-kube-api-access-v9qvg\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:09:06.548522 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:06.548512    2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ac6e545f-8c6c-428e-9d2d-aca431c7f9dd-console-oauth-config\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:09:06.622157 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:06.622128    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:09:06.941946 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:06.941904    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:09:07.253487 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:07.253395    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84884fdfc9-q9qfv"
Sep 08 10:09:07.253487 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:07.253396    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84884fdfc9-q9qfv" event={"ID":"ac6e545f-8c6c-428e-9d2d-aca431c7f9dd","Type":"ContainerDied","Data":"bc9a145d7dbcb90d92fc59b510b9785e29479525d657d74b30bd526e734ffede"}
Sep 08 10:09:07.254005 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:07.253552    2579 scope.go:117] "RemoveContainer" containerID="19ff04cc104c74c576e285c71132e69ce3d48ffbb4476902cb822f7ac6286496"
Sep 08 10:09:07.255199 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:07.255174    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw" event={"ID":"7bbbcbc1-3268-4a81-8f11-37b15de30f34","Type":"ContainerStarted","Data":"796d831fbbc65c23dab100a67b95df728709e6ea24fb5f899ada006f45f34474"}
Sep 08 10:09:07.273861 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:07.273836    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84884fdfc9-q9qfv"]
Sep 08 10:09:07.280141 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:07.280122    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-84884fdfc9-q9qfv"]
Sep 08 10:09:08.497084 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:08.497051    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:09:08.578486 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:08.578455    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:09:08.833017 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:08.832983    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac6e545f-8c6c-428e-9d2d-aca431c7f9dd" path="/var/lib/kubelet/pods/ac6e545f-8c6c-428e-9d2d-aca431c7f9dd/volumes"
Sep 08 10:09:11.274932 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:11.274896    2579 generic.go:356] "Generic (PLEG): container finished" podID="7bbbcbc1-3268-4a81-8f11-37b15de30f34" containerID="796d831fbbc65c23dab100a67b95df728709e6ea24fb5f899ada006f45f34474" exitCode=0
Sep 08 10:09:11.275333 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:11.274940    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw" event={"ID":"7bbbcbc1-3268-4a81-8f11-37b15de30f34","Type":"ContainerDied","Data":"796d831fbbc65c23dab100a67b95df728709e6ea24fb5f899ada006f45f34474"}
Sep 08 10:09:12.281517 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:12.281482    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw" event={"ID":"7bbbcbc1-3268-4a81-8f11-37b15de30f34","Type":"ContainerStarted","Data":"eb4a77c22b80eff1a24ae673e4de22cbfe9d5449e470939064f4b3a9931d5701"}
Sep 08 10:09:15.346954 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:15.346922    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:09:15.445025 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:15.444982    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:09:18.309384 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:18.309351    2579 generic.go:356] "Generic (PLEG): container finished" podID="7bbbcbc1-3268-4a81-8f11-37b15de30f34" containerID="eb4a77c22b80eff1a24ae673e4de22cbfe9d5449e470939064f4b3a9931d5701" exitCode=0
Sep 08 10:09:18.309885 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:18.309437    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw" event={"ID":"7bbbcbc1-3268-4a81-8f11-37b15de30f34","Type":"ContainerDied","Data":"eb4a77c22b80eff1a24ae673e4de22cbfe9d5449e470939064f4b3a9931d5701"}
Sep 08 10:09:18.318801 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:18.318779    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
Sep 08 10:09:19.321469 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:19.321429    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw" event={"ID":"7bbbcbc1-3268-4a81-8f11-37b15de30f34","Type":"ContainerStarted","Data":"cfee9906fbc525be19ac553ab54921fd52354f9125a8c27bfca96a8a9ce94f80"}
Sep 08 10:09:19.321996 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:19.321494    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw" event={"ID":"7bbbcbc1-3268-4a81-8f11-37b15de30f34","Type":"ContainerStarted","Data":"5800bba2ff4f20ecc88190603e8b37fe7bc2cad58089a02dab5a0ab9f52cbf1d"}
Sep 08 10:09:19.321996 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:19.321515    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw" event={"ID":"7bbbcbc1-3268-4a81-8f11-37b15de30f34","Type":"ContainerStarted","Data":"3bbeb57c7675bbbd6e5f8d6ce1a7e944df626b39d088f6f04cdcabb379a594e3"}
Sep 08 10:09:19.321996 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:19.321550    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw" event={"ID":"7bbbcbc1-3268-4a81-8f11-37b15de30f34","Type":"ContainerStarted","Data":"ae073a387fd4e3b171a948ab3116556a9b1302533ae073fed1f3c500e829c0ea"}
Sep 08 10:09:19.352162 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:19.352080    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw" podStartSLOduration=14.84525734 podStartE2EDuration="41.35205914s" totalImagesPullingTime="26.5068018s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:08:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:09:19.350956411 +0000 UTC m=+673.046555331" watchObservedRunningTime="2026-09-08 10:09:19.35205914 +0000 UTC m=+673.047658041"
Sep 08 10:09:19.433339 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:19.433292    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw"
Sep 08 10:09:19.433571 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:19.433363    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw"
Sep 08 10:09:19.433571 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:19.433390    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw"
Sep 08 10:09:19.433571 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:19.433407    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw"
Sep 08 10:09:21.433897 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:21.433862    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw"
Sep 08 10:09:21.434439 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:21.433924    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw"
Sep 08 10:09:21.434439 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:21.433943    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw"
Sep 08 10:09:21.434439 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:21.433962    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw"
Sep 08 10:09:21.435710 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:21.435668    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw" podUID="7bbbcbc1-3268-4a81-8f11-37b15de30f34" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.28:8443: connect: connection refused"
Sep 08 10:09:21.435822 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:21.435747    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw" podUID="7bbbcbc1-3268-4a81-8f11-37b15de30f34" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.28:6571: connect: connection refused"
Sep 08 10:09:21.435822 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:21.435791    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw" podUID="7bbbcbc1-3268-4a81-8f11-37b15de30f34" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.28:8816: connect: connection refused"
Sep 08 10:09:21.435822 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:21.435750    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw" podUID="7bbbcbc1-3268-4a81-8f11-37b15de30f34" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused"
Sep 08 10:09:23.628507 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:23.628454    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:09:24.434019 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:24.433974    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw" podUID="7bbbcbc1-3268-4a81-8f11-37b15de30f34" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.28:6571: connect: connection refused"
Sep 08 10:09:24.434217 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:24.433974    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw" podUID="7bbbcbc1-3268-4a81-8f11-37b15de30f34" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.28:8816: connect: connection refused"
Sep 08 10:09:24.434217 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:24.433989    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw" podUID="7bbbcbc1-3268-4a81-8f11-37b15de30f34" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.28:8443: connect: connection refused"
Sep 08 10:09:24.434217 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:24.434123    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw" podUID="7bbbcbc1-3268-4a81-8f11-37b15de30f34" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused"
Sep 08 10:09:27.434379 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:27.434349    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw"
Sep 08 10:09:27.434864 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:27.434489    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw"
Sep 08 10:09:27.434864 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:27.434798    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw"
Sep 08 10:09:27.435372 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:27.435351    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw"
Sep 08 10:09:27.435478 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:27.435406    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw"
Sep 08 10:09:27.435478 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:27.435438    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw"
Sep 08 10:09:27.439882 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:27.439863    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw"
Sep 08 10:09:28.377425 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:28.377391    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw"
Sep 08 10:09:29.013026 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:09:29.012994    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:10:30.666380 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:30.666341    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:10:30.684495 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:30.684466    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw"]
Sep 08 10:10:30.684772 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:30.684741    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw" podUID="7bbbcbc1-3268-4a81-8f11-37b15de30f34" containerName="registry" containerID="cri-o://ae073a387fd4e3b171a948ab3116556a9b1302533ae073fed1f3c500e829c0ea" gracePeriod=30
Sep 08 10:10:30.684916 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:30.684864    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw" podUID="7bbbcbc1-3268-4a81-8f11-37b15de30f34" containerName="online" containerID="cri-o://3bbeb57c7675bbbd6e5f8d6ce1a7e944df626b39d088f6f04cdcabb379a594e3" gracePeriod=30
Sep 08 10:10:30.684985 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:30.684810    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw" podUID="7bbbcbc1-3268-4a81-8f11-37b15de30f34" containerName="ui" containerID="cri-o://cfee9906fbc525be19ac553ab54921fd52354f9125a8c27bfca96a8a9ce94f80" gracePeriod=30
Sep 08 10:10:30.685043 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:30.684818    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw" podUID="7bbbcbc1-3268-4a81-8f11-37b15de30f34" containerName="offline" containerID="cri-o://5800bba2ff4f20ecc88190603e8b37fe7bc2cad58089a02dab5a0ab9f52cbf1d" gracePeriod=30
Sep 08 10:10:30.765980 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:30.765941    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:10:30.973468 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:30.973383    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:10:31.070678 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:31.070632    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:10:31.125591 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:31.125551    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl"]
Sep 08 10:10:31.125903 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:31.125889    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac6e545f-8c6c-428e-9d2d-aca431c7f9dd" containerName="console"
Sep 08 10:10:31.125903 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:31.125903    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac6e545f-8c6c-428e-9d2d-aca431c7f9dd" containerName="console"
Sep 08 10:10:31.126043 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:31.125974    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac6e545f-8c6c-428e-9d2d-aca431c7f9dd" containerName="console"
Sep 08 10:10:31.128754 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:31.128730    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl"
Sep 08 10:10:31.131784 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:31.131762    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-6nd9v\""
Sep 08 10:10:31.143142 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:31.143115    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl"]
Sep 08 10:10:31.204246 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:31.204206    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:10:31.235171 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:31.235083    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgzww\" (UniqueName: \"kubernetes.io/projected/307bb263-d593-4a17-b298-0d50a21da11b-kube-api-access-xgzww\") pod \"feast-simple-feast-setup-cf54dbbd5-2zndl\" (UID: \"307bb263-d593-4a17-b298-0d50a21da11b\") " pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl"
Sep 08 10:10:31.235314 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:31.235223    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/307bb263-d593-4a17-b298-0d50a21da11b-feast-data\") pod \"feast-simple-feast-setup-cf54dbbd5-2zndl\" (UID: \"307bb263-d593-4a17-b298-0d50a21da11b\") " pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl"
Sep 08 10:10:31.235314 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:31.235251    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/307bb263-d593-4a17-b298-0d50a21da11b-registry-tls\") pod \"feast-simple-feast-setup-cf54dbbd5-2zndl\" (UID: \"307bb263-d593-4a17-b298-0d50a21da11b\") " pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl"
Sep 08 10:10:31.235314 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:31.235271    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/307bb263-d593-4a17-b298-0d50a21da11b-ui-tls\") pod \"feast-simple-feast-setup-cf54dbbd5-2zndl\" (UID: \"307bb263-d593-4a17-b298-0d50a21da11b\") " pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl"
Sep 08 10:10:31.235314 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:31.235296    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/307bb263-d593-4a17-b298-0d50a21da11b-offline-tls\") pod \"feast-simple-feast-setup-cf54dbbd5-2zndl\" (UID: \"307bb263-d593-4a17-b298-0d50a21da11b\") " pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl"
Sep 08 10:10:31.235460 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:31.235336    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/307bb263-d593-4a17-b298-0d50a21da11b-online-tls\") pod \"feast-simple-feast-setup-cf54dbbd5-2zndl\" (UID: \"307bb263-d593-4a17-b298-0d50a21da11b\") " pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl"
Sep 08 10:10:31.336793 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:31.336758    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgzww\" (UniqueName: \"kubernetes.io/projected/307bb263-d593-4a17-b298-0d50a21da11b-kube-api-access-xgzww\") pod \"feast-simple-feast-setup-cf54dbbd5-2zndl\" (UID: \"307bb263-d593-4a17-b298-0d50a21da11b\") " pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl"
Sep 08 10:10:31.336992 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:31.336825    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/307bb263-d593-4a17-b298-0d50a21da11b-feast-data\") pod \"feast-simple-feast-setup-cf54dbbd5-2zndl\" (UID: \"307bb263-d593-4a17-b298-0d50a21da11b\") " pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl"
Sep 08 10:10:31.336992 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:31.336843    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/307bb263-d593-4a17-b298-0d50a21da11b-registry-tls\") pod \"feast-simple-feast-setup-cf54dbbd5-2zndl\" (UID: \"307bb263-d593-4a17-b298-0d50a21da11b\") " pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl"
Sep 08 10:10:31.336992 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:31.336858    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/307bb263-d593-4a17-b298-0d50a21da11b-ui-tls\") pod \"feast-simple-feast-setup-cf54dbbd5-2zndl\" (UID: \"307bb263-d593-4a17-b298-0d50a21da11b\") " pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl"
Sep 08 10:10:31.336992 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:31.336879    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/307bb263-d593-4a17-b298-0d50a21da11b-offline-tls\") pod \"feast-simple-feast-setup-cf54dbbd5-2zndl\" (UID: \"307bb263-d593-4a17-b298-0d50a21da11b\") " pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl"
Sep 08 10:10:31.336992 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:31.336896    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/307bb263-d593-4a17-b298-0d50a21da11b-online-tls\") pod \"feast-simple-feast-setup-cf54dbbd5-2zndl\" (UID: \"307bb263-d593-4a17-b298-0d50a21da11b\") " pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl"
Sep 08 10:10:31.337256 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:10:31.336995    2579 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
Sep 08 10:10:31.337256 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:10:31.337063    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/307bb263-d593-4a17-b298-0d50a21da11b-online-tls podName:307bb263-d593-4a17-b298-0d50a21da11b nodeName:}" failed. No retries permitted until 2026-09-08 10:10:31.837045131 +0000 UTC m=+745.532644010 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/307bb263-d593-4a17-b298-0d50a21da11b-online-tls") pod "feast-simple-feast-setup-cf54dbbd5-2zndl" (UID: "307bb263-d593-4a17-b298-0d50a21da11b") : secret "feast-simple-feast-setup-online-tls" not found
Sep 08 10:10:31.337256 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:10:31.337120    2579 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
Sep 08 10:10:31.337256 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:10:31.337192    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/307bb263-d593-4a17-b298-0d50a21da11b-registry-tls podName:307bb263-d593-4a17-b298-0d50a21da11b nodeName:}" failed. No retries permitted until 2026-09-08 10:10:31.837172635 +0000 UTC m=+745.532771530 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/307bb263-d593-4a17-b298-0d50a21da11b-registry-tls") pod "feast-simple-feast-setup-cf54dbbd5-2zndl" (UID: "307bb263-d593-4a17-b298-0d50a21da11b") : secret "feast-simple-feast-setup-registry-tls" not found
Sep 08 10:10:31.337462 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:31.337287    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/307bb263-d593-4a17-b298-0d50a21da11b-feast-data\") pod \"feast-simple-feast-setup-cf54dbbd5-2zndl\" (UID: \"307bb263-d593-4a17-b298-0d50a21da11b\") " pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl"
Sep 08 10:10:31.339604 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:31.339583    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/307bb263-d593-4a17-b298-0d50a21da11b-ui-tls\") pod \"feast-simple-feast-setup-cf54dbbd5-2zndl\" (UID: \"307bb263-d593-4a17-b298-0d50a21da11b\") " pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl"
Sep 08 10:10:31.339738 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:31.339601    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/307bb263-d593-4a17-b298-0d50a21da11b-offline-tls\") pod \"feast-simple-feast-setup-cf54dbbd5-2zndl\" (UID: \"307bb263-d593-4a17-b298-0d50a21da11b\") " pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl"
Sep 08 10:10:31.348927 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:31.348904    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgzww\" (UniqueName: \"kubernetes.io/projected/307bb263-d593-4a17-b298-0d50a21da11b-kube-api-access-xgzww\") pod \"feast-simple-feast-setup-cf54dbbd5-2zndl\" (UID: \"307bb263-d593-4a17-b298-0d50a21da11b\") " pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl"
Sep 08 10:10:31.571704 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:31.571676    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:10:31.633502 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:31.633474    2579 generic.go:356] "Generic (PLEG): container finished" podID="7bbbcbc1-3268-4a81-8f11-37b15de30f34" containerID="cfee9906fbc525be19ac553ab54921fd52354f9125a8c27bfca96a8a9ce94f80" exitCode=0
Sep 08 10:10:31.633502 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:31.633494    2579 generic.go:356] "Generic (PLEG): container finished" podID="7bbbcbc1-3268-4a81-8f11-37b15de30f34" containerID="3bbeb57c7675bbbd6e5f8d6ce1a7e944df626b39d088f6f04cdcabb379a594e3" exitCode=0
Sep 08 10:10:31.633678 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:31.633555    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw" event={"ID":"7bbbcbc1-3268-4a81-8f11-37b15de30f34","Type":"ContainerDied","Data":"cfee9906fbc525be19ac553ab54921fd52354f9125a8c27bfca96a8a9ce94f80"}
Sep 08 10:10:31.633678 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:31.633600    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw" event={"ID":"7bbbcbc1-3268-4a81-8f11-37b15de30f34","Type":"ContainerDied","Data":"3bbeb57c7675bbbd6e5f8d6ce1a7e944df626b39d088f6f04cdcabb379a594e3"}
Sep 08 10:10:31.678018 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:31.677988    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:10:31.842137 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:31.842112    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/307bb263-d593-4a17-b298-0d50a21da11b-online-tls\") pod \"feast-simple-feast-setup-cf54dbbd5-2zndl\" (UID: \"307bb263-d593-4a17-b298-0d50a21da11b\") " pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl"
Sep 08 10:10:31.842290 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:31.842190    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/307bb263-d593-4a17-b298-0d50a21da11b-registry-tls\") pod \"feast-simple-feast-setup-cf54dbbd5-2zndl\" (UID: \"307bb263-d593-4a17-b298-0d50a21da11b\") " pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl"
Sep 08 10:10:31.844728 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:31.844698    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/307bb263-d593-4a17-b298-0d50a21da11b-registry-tls\") pod \"feast-simple-feast-setup-cf54dbbd5-2zndl\" (UID: \"307bb263-d593-4a17-b298-0d50a21da11b\") " pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl"
Sep 08 10:10:31.844824 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:31.844736    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/307bb263-d593-4a17-b298-0d50a21da11b-online-tls\") pod \"feast-simple-feast-setup-cf54dbbd5-2zndl\" (UID: \"307bb263-d593-4a17-b298-0d50a21da11b\") " pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl"
Sep 08 10:10:32.038470 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:32.038424    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl"
Sep 08 10:10:32.320522 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:32.320492    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl"]
Sep 08 10:10:32.321728 ip-10-0-132-96 kubenswrapper[2579]: W0908 10:10:32.321700    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod307bb263_d593_4a17_b298_0d50a21da11b.slice/crio-26f683a4ce7dd673525b1c00c7740b7a7281298bfdf5713fa1c754b65d405db3 WatchSource:0}: Error finding container 26f683a4ce7dd673525b1c00c7740b7a7281298bfdf5713fa1c754b65d405db3: Status 404 returned error can't find the container with id 26f683a4ce7dd673525b1c00c7740b7a7281298bfdf5713fa1c754b65d405db3
Sep 08 10:10:32.642022 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:32.641932    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl" event={"ID":"307bb263-d593-4a17-b298-0d50a21da11b","Type":"ContainerStarted","Data":"361723de372370b97cee3141bb7bd71e8634bcf1aa6373c1977e76a205677c35"}
Sep 08 10:10:32.642022 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:32.641990    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl" event={"ID":"307bb263-d593-4a17-b298-0d50a21da11b","Type":"ContainerStarted","Data":"26f683a4ce7dd673525b1c00c7740b7a7281298bfdf5713fa1c754b65d405db3"}
Sep 08 10:10:37.436042 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:37.435947    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw" podUID="7bbbcbc1-3268-4a81-8f11-37b15de30f34" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.28:8443: connect: connection refused"
Sep 08 10:10:37.665399 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:37.665365    2579 generic.go:356] "Generic (PLEG): container finished" podID="307bb263-d593-4a17-b298-0d50a21da11b" containerID="361723de372370b97cee3141bb7bd71e8634bcf1aa6373c1977e76a205677c35" exitCode=0
Sep 08 10:10:37.665569 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:37.665444    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl" event={"ID":"307bb263-d593-4a17-b298-0d50a21da11b","Type":"ContainerDied","Data":"361723de372370b97cee3141bb7bd71e8634bcf1aa6373c1977e76a205677c35"}
Sep 08 10:10:38.374646 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:38.374596    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw" podUID="7bbbcbc1-3268-4a81-8f11-37b15de30f34" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused"
Sep 08 10:10:38.672996 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:38.672907    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl" event={"ID":"307bb263-d593-4a17-b298-0d50a21da11b","Type":"ContainerStarted","Data":"d34561bfa0ac55c8c06f6e4b0783b9b599b2c4405497d0e09df9d9102295e43a"}
Sep 08 10:10:43.696685 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:43.696600    2579 generic.go:356] "Generic (PLEG): container finished" podID="307bb263-d593-4a17-b298-0d50a21da11b" containerID="d34561bfa0ac55c8c06f6e4b0783b9b599b2c4405497d0e09df9d9102295e43a" exitCode=0
Sep 08 10:10:43.697015 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:43.696674    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl" event={"ID":"307bb263-d593-4a17-b298-0d50a21da11b","Type":"ContainerDied","Data":"d34561bfa0ac55c8c06f6e4b0783b9b599b2c4405497d0e09df9d9102295e43a"}
Sep 08 10:10:44.707011 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:44.706971    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl" event={"ID":"307bb263-d593-4a17-b298-0d50a21da11b","Type":"ContainerStarted","Data":"f825f926c5ddd408edd562a18527313c3870a7c4f97f5eb5984be8d4077c0f1f"}
Sep 08 10:10:44.707494 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:44.707031    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl" event={"ID":"307bb263-d593-4a17-b298-0d50a21da11b","Type":"ContainerStarted","Data":"ffdc30429bd581a489e3c3dc434d1ff248d1dc1ac4787ab4f4b6e82e83438a4e"}
Sep 08 10:10:44.707494 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:44.707050    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl" event={"ID":"307bb263-d593-4a17-b298-0d50a21da11b","Type":"ContainerStarted","Data":"1fa733334c8f2398df6910bbd5cbe62979c16fa25112cfa3a01caaffb04713e9"}
Sep 08 10:10:44.707494 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:44.707067    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl" event={"ID":"307bb263-d593-4a17-b298-0d50a21da11b","Type":"ContainerStarted","Data":"35aedaba1b1d8877ef5a6c306cc04373e2c09b2e42c8b147f83a494caa074325"}
Sep 08 10:10:44.742558 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:44.742485    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl" podStartSLOduration=13.742465193 podStartE2EDuration="13.742465193s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:10:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:10:44.741909338 +0000 UTC m=+758.437508264" watchObservedRunningTime="2026-09-08 10:10:44.742465193 +0000 UTC m=+758.438064094"
Sep 08 10:10:47.038999 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:47.038954    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl"
Sep 08 10:10:47.039480 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:47.039025    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl"
Sep 08 10:10:47.039480 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:47.039046    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl"
Sep 08 10:10:47.039480 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:47.039062    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl"
Sep 08 10:10:47.041162 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:47.041121    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl" podUID="307bb263-d593-4a17-b298-0d50a21da11b" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.29:8816: connect: connection refused"
Sep 08 10:10:47.041298 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:47.041151    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl" podUID="307bb263-d593-4a17-b298-0d50a21da11b" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.29:8443: connect: connection refused"
Sep 08 10:10:47.041298 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:47.041161    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl" podUID="307bb263-d593-4a17-b298-0d50a21da11b" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused"
Sep 08 10:10:47.041298 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:47.041227    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl" podUID="307bb263-d593-4a17-b298-0d50a21da11b" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.29:6571: connect: connection refused"
Sep 08 10:10:47.435167 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:47.435058    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw" podUID="7bbbcbc1-3268-4a81-8f11-37b15de30f34" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.28:8443: connect: connection refused"
Sep 08 10:10:48.374854 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:48.374806    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw" podUID="7bbbcbc1-3268-4a81-8f11-37b15de30f34" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused"
Sep 08 10:10:50.039643 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:50.039592    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl" podUID="307bb263-d593-4a17-b298-0d50a21da11b" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.29:6571: connect: connection refused"
Sep 08 10:10:50.039643 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:50.039622    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl" podUID="307bb263-d593-4a17-b298-0d50a21da11b" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused"
Sep 08 10:10:50.040183 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:50.039608    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl" podUID="307bb263-d593-4a17-b298-0d50a21da11b" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.29:8816: connect: connection refused"
Sep 08 10:10:50.040183 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:50.039664    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl" podUID="307bb263-d593-4a17-b298-0d50a21da11b" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.29:8443: connect: connection refused"
Sep 08 10:10:52.038910 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:52.038873    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl"
Sep 08 10:10:52.038910 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:52.038919    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl"
Sep 08 10:10:52.039309 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:52.038931    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl"
Sep 08 10:10:52.039309 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:52.038945    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl"
Sep 08 10:10:53.039870 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:53.039841    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl"
Sep 08 10:10:53.040340 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:53.039955    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl"
Sep 08 10:10:53.040340 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:53.040094    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl"
Sep 08 10:10:53.040731 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:53.040694    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl"
Sep 08 10:10:53.040842 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:53.040772    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl"
Sep 08 10:10:53.041027 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:53.041008    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl"
Sep 08 10:10:53.045019 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:53.045000    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl"
Sep 08 10:10:53.760868 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:53.760831    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl"
Sep 08 10:10:54.210156 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:54.210108    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:10:57.435828 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:57.435780    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw" podUID="7bbbcbc1-3268-4a81-8f11-37b15de30f34" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.28:8443: connect: connection refused"
Sep 08 10:10:57.436269 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:57.435915    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw"
Sep 08 10:10:58.374973 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:58.374929    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw" podUID="7bbbcbc1-3268-4a81-8f11-37b15de30f34" containerName="online" probeResult="failure" output="Get \"https://10.133.0.28:6567/health\": dial tcp 10.133.0.28:6567: connect: connection refused"
Sep 08 10:10:58.375155 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:10:58.375056    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw"
Sep 08 10:11:00.788282 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:00.788253    2579 generic.go:356] "Generic (PLEG): container finished" podID="7bbbcbc1-3268-4a81-8f11-37b15de30f34" containerID="5800bba2ff4f20ecc88190603e8b37fe7bc2cad58089a02dab5a0ab9f52cbf1d" exitCode=137
Sep 08 10:11:00.788282 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:00.788278    2579 generic.go:356] "Generic (PLEG): container finished" podID="7bbbcbc1-3268-4a81-8f11-37b15de30f34" containerID="ae073a387fd4e3b171a948ab3116556a9b1302533ae073fed1f3c500e829c0ea" exitCode=137
Sep 08 10:11:00.788611 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:00.788312    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw" event={"ID":"7bbbcbc1-3268-4a81-8f11-37b15de30f34","Type":"ContainerDied","Data":"5800bba2ff4f20ecc88190603e8b37fe7bc2cad58089a02dab5a0ab9f52cbf1d"}
Sep 08 10:11:00.788611 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:00.788343    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw" event={"ID":"7bbbcbc1-3268-4a81-8f11-37b15de30f34","Type":"ContainerDied","Data":"ae073a387fd4e3b171a948ab3116556a9b1302533ae073fed1f3c500e829c0ea"}
Sep 08 10:11:01.327552 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:01.327504    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw"
Sep 08 10:11:01.406203 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:01.406177    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2mb4s\" (UniqueName: \"kubernetes.io/projected/7bbbcbc1-3268-4a81-8f11-37b15de30f34-kube-api-access-2mb4s\") pod \"7bbbcbc1-3268-4a81-8f11-37b15de30f34\" (UID: \"7bbbcbc1-3268-4a81-8f11-37b15de30f34\") "
Sep 08 10:11:01.406368 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:01.406216    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7bbbcbc1-3268-4a81-8f11-37b15de30f34-ui-tls\") pod \"7bbbcbc1-3268-4a81-8f11-37b15de30f34\" (UID: \"7bbbcbc1-3268-4a81-8f11-37b15de30f34\") "
Sep 08 10:11:01.406368 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:01.406234    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7bbbcbc1-3268-4a81-8f11-37b15de30f34-offline-tls\") pod \"7bbbcbc1-3268-4a81-8f11-37b15de30f34\" (UID: \"7bbbcbc1-3268-4a81-8f11-37b15de30f34\") "
Sep 08 10:11:01.406368 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:01.406280    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7bbbcbc1-3268-4a81-8f11-37b15de30f34-online-tls\") pod \"7bbbcbc1-3268-4a81-8f11-37b15de30f34\" (UID: \"7bbbcbc1-3268-4a81-8f11-37b15de30f34\") "
Sep 08 10:11:01.406368 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:01.406339    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7bbbcbc1-3268-4a81-8f11-37b15de30f34-feast-data\") pod \"7bbbcbc1-3268-4a81-8f11-37b15de30f34\" (UID: \"7bbbcbc1-3268-4a81-8f11-37b15de30f34\") "
Sep 08 10:11:01.406613 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:01.406392    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7bbbcbc1-3268-4a81-8f11-37b15de30f34-registry-tls\") pod \"7bbbcbc1-3268-4a81-8f11-37b15de30f34\" (UID: \"7bbbcbc1-3268-4a81-8f11-37b15de30f34\") "
Sep 08 10:11:01.407171 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:01.407134    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bbbcbc1-3268-4a81-8f11-37b15de30f34-feast-data" (OuterVolumeSpecName: "feast-data") pod "7bbbcbc1-3268-4a81-8f11-37b15de30f34" (UID: "7bbbcbc1-3268-4a81-8f11-37b15de30f34"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:11:01.408799 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:01.408770    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bbbcbc1-3268-4a81-8f11-37b15de30f34-kube-api-access-2mb4s" (OuterVolumeSpecName: "kube-api-access-2mb4s") pod "7bbbcbc1-3268-4a81-8f11-37b15de30f34" (UID: "7bbbcbc1-3268-4a81-8f11-37b15de30f34"). InnerVolumeSpecName "kube-api-access-2mb4s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:11:01.408903 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:01.408795    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bbbcbc1-3268-4a81-8f11-37b15de30f34-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "7bbbcbc1-3268-4a81-8f11-37b15de30f34" (UID: "7bbbcbc1-3268-4a81-8f11-37b15de30f34"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:11:01.408903 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:01.408812    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bbbcbc1-3268-4a81-8f11-37b15de30f34-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "7bbbcbc1-3268-4a81-8f11-37b15de30f34" (UID: "7bbbcbc1-3268-4a81-8f11-37b15de30f34"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:11:01.409007 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:01.408988    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bbbcbc1-3268-4a81-8f11-37b15de30f34-online-tls" (OuterVolumeSpecName: "online-tls") pod "7bbbcbc1-3268-4a81-8f11-37b15de30f34" (UID: "7bbbcbc1-3268-4a81-8f11-37b15de30f34"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:11:01.409043 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:01.409027    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bbbcbc1-3268-4a81-8f11-37b15de30f34-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "7bbbcbc1-3268-4a81-8f11-37b15de30f34" (UID: "7bbbcbc1-3268-4a81-8f11-37b15de30f34"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:11:01.507301 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:01.507240    2579 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/7bbbcbc1-3268-4a81-8f11-37b15de30f34-ui-tls\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:11:01.507301 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:01.507262    2579 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/7bbbcbc1-3268-4a81-8f11-37b15de30f34-offline-tls\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:11:01.507301 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:01.507272    2579 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/7bbbcbc1-3268-4a81-8f11-37b15de30f34-online-tls\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:11:01.507301 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:01.507280    2579 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/7bbbcbc1-3268-4a81-8f11-37b15de30f34-feast-data\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:11:01.507301 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:01.507287    2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/7bbbcbc1-3268-4a81-8f11-37b15de30f34-registry-tls\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:11:01.507301 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:01.507294    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2mb4s\" (UniqueName: \"kubernetes.io/projected/7bbbcbc1-3268-4a81-8f11-37b15de30f34-kube-api-access-2mb4s\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:11:01.795547 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:01.795516    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw"
Sep 08 10:11:01.795892 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:01.795522    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw" event={"ID":"7bbbcbc1-3268-4a81-8f11-37b15de30f34","Type":"ContainerDied","Data":"17f7705166d168536811094650c86a05650b5bb2a18dce96907cc57c57e10187"}
Sep 08 10:11:01.795892 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:01.795603    2579 scope.go:117] "RemoveContainer" containerID="cfee9906fbc525be19ac553ab54921fd52354f9125a8c27bfca96a8a9ce94f80"
Sep 08 10:11:01.804195 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:01.804177    2579 scope.go:117] "RemoveContainer" containerID="5800bba2ff4f20ecc88190603e8b37fe7bc2cad58089a02dab5a0ab9f52cbf1d"
Sep 08 10:11:01.811878 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:01.811859    2579 scope.go:117] "RemoveContainer" containerID="3bbeb57c7675bbbd6e5f8d6ce1a7e944df626b39d088f6f04cdcabb379a594e3"
Sep 08 10:11:01.819098 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:01.819079    2579 scope.go:117] "RemoveContainer" containerID="ae073a387fd4e3b171a948ab3116556a9b1302533ae073fed1f3c500e829c0ea"
Sep 08 10:11:01.825876 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:01.825854    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw"]
Sep 08 10:11:01.827090 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:01.827073    2579 scope.go:117] "RemoveContainer" containerID="eb4a77c22b80eff1a24ae673e4de22cbfe9d5449e470939064f4b3a9931d5701"
Sep 08 10:11:01.831854 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:01.831835    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-cf54dbbd5-gq2tw"]
Sep 08 10:11:01.835104 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:01.835089    2579 scope.go:117] "RemoveContainer" containerID="796d831fbbc65c23dab100a67b95df728709e6ea24fb5f899ada006f45f34474"
Sep 08 10:11:02.832116 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:02.832083    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7bbbcbc1-3268-4a81-8f11-37b15de30f34" path="/var/lib/kubelet/pods/7bbbcbc1-3268-4a81-8f11-37b15de30f34/volumes"
Sep 08 10:11:55.612929 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:55.612846    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:11:55.760760 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:55.760730    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:11:56.183470 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:56.183436    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:11:56.287658 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:56.287621    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:11:56.301964 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:56.301933    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57"]
Sep 08 10:11:56.302266 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:56.302253    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bbbcbc1-3268-4a81-8f11-37b15de30f34" containerName="offline"
Sep 08 10:11:56.302311 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:56.302268    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bbbcbc1-3268-4a81-8f11-37b15de30f34" containerName="offline"
Sep 08 10:11:56.302311 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:56.302278    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bbbcbc1-3268-4a81-8f11-37b15de30f34" containerName="ui"
Sep 08 10:11:56.302311 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:56.302283    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bbbcbc1-3268-4a81-8f11-37b15de30f34" containerName="ui"
Sep 08 10:11:56.302311 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:56.302295    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bbbcbc1-3268-4a81-8f11-37b15de30f34" containerName="online"
Sep 08 10:11:56.302311 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:56.302300    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bbbcbc1-3268-4a81-8f11-37b15de30f34" containerName="online"
Sep 08 10:11:56.302311 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:56.302310    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bbbcbc1-3268-4a81-8f11-37b15de30f34" containerName="feast-init"
Sep 08 10:11:56.302488 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:56.302315    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bbbcbc1-3268-4a81-8f11-37b15de30f34" containerName="feast-init"
Sep 08 10:11:56.302488 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:56.302325    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bbbcbc1-3268-4a81-8f11-37b15de30f34" containerName="feast-apply"
Sep 08 10:11:56.302488 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:56.302331    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bbbcbc1-3268-4a81-8f11-37b15de30f34" containerName="feast-apply"
Sep 08 10:11:56.302488 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:56.302336    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7bbbcbc1-3268-4a81-8f11-37b15de30f34" containerName="registry"
Sep 08 10:11:56.302488 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:56.302341    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7bbbcbc1-3268-4a81-8f11-37b15de30f34" containerName="registry"
Sep 08 10:11:56.302488 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:56.302405    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bbbcbc1-3268-4a81-8f11-37b15de30f34" containerName="registry"
Sep 08 10:11:56.302488 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:56.302416    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bbbcbc1-3268-4a81-8f11-37b15de30f34" containerName="online"
Sep 08 10:11:56.302488 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:56.302421    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bbbcbc1-3268-4a81-8f11-37b15de30f34" containerName="offline"
Sep 08 10:11:56.302488 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:56.302427    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7bbbcbc1-3268-4a81-8f11-37b15de30f34" containerName="ui"
Sep 08 10:11:56.304749 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:56.304732    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57"
Sep 08 10:11:56.310870 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:56.310850    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Sep 08 10:11:56.311103 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:56.311086    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Sep 08 10:11:56.311103 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:56.311094    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Sep 08 10:11:56.311219 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:56.311183    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Sep 08 10:11:56.311219 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:56.311183    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Sep 08 10:11:56.311669 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:56.311587    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Sep 08 10:11:56.312435 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:56.312417    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\""
Sep 08 10:11:56.312567 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:56.312438    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-t2ptb\""
Sep 08 10:11:56.328459 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:56.328438    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57"]
Sep 08 10:11:56.365441 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:56.365418    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97qh6\" (UniqueName: \"kubernetes.io/projected/f895b9e3-15ae-4166-8aab-bd09e6ffe5f3-kube-api-access-97qh6\") pod \"feast-simple-feast-remote-setup-69f44999d4-f2t57\" (UID: \"f895b9e3-15ae-4166-8aab-bd09e6ffe5f3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57"
Sep 08 10:11:56.365576 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:56.365460    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/f895b9e3-15ae-4166-8aab-bd09e6ffe5f3-registry-tls\") pod \"feast-simple-feast-remote-setup-69f44999d4-f2t57\" (UID: \"f895b9e3-15ae-4166-8aab-bd09e6ffe5f3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57"
Sep 08 10:11:56.365576 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:56.365477    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f895b9e3-15ae-4166-8aab-bd09e6ffe5f3-online-tls\") pod \"feast-simple-feast-remote-setup-69f44999d4-f2t57\" (UID: \"f895b9e3-15ae-4166-8aab-bd09e6ffe5f3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57"
Sep 08 10:11:56.365576 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:56.365505    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f895b9e3-15ae-4166-8aab-bd09e6ffe5f3-ui-tls\") pod \"feast-simple-feast-remote-setup-69f44999d4-f2t57\" (UID: \"f895b9e3-15ae-4166-8aab-bd09e6ffe5f3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57"
Sep 08 10:11:56.365576 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:56.365568    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f895b9e3-15ae-4166-8aab-bd09e6ffe5f3-feast-data\") pod \"feast-simple-feast-remote-setup-69f44999d4-f2t57\" (UID: \"f895b9e3-15ae-4166-8aab-bd09e6ffe5f3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57"
Sep 08 10:11:56.365817 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:56.365638    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f895b9e3-15ae-4166-8aab-bd09e6ffe5f3-offline-tls\") pod \"feast-simple-feast-remote-setup-69f44999d4-f2t57\" (UID: \"f895b9e3-15ae-4166-8aab-bd09e6ffe5f3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57"
Sep 08 10:11:56.384079 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:56.384041    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:11:56.467115 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:56.467054    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/f895b9e3-15ae-4166-8aab-bd09e6ffe5f3-registry-tls\") pod \"feast-simple-feast-remote-setup-69f44999d4-f2t57\" (UID: \"f895b9e3-15ae-4166-8aab-bd09e6ffe5f3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57"
Sep 08 10:11:56.467115 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:56.467089    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f895b9e3-15ae-4166-8aab-bd09e6ffe5f3-online-tls\") pod \"feast-simple-feast-remote-setup-69f44999d4-f2t57\" (UID: \"f895b9e3-15ae-4166-8aab-bd09e6ffe5f3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57"
Sep 08 10:11:56.467115 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:56.467112    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f895b9e3-15ae-4166-8aab-bd09e6ffe5f3-ui-tls\") pod \"feast-simple-feast-remote-setup-69f44999d4-f2t57\" (UID: \"f895b9e3-15ae-4166-8aab-bd09e6ffe5f3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57"
Sep 08 10:11:56.467271 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:56.467134    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f895b9e3-15ae-4166-8aab-bd09e6ffe5f3-feast-data\") pod \"feast-simple-feast-remote-setup-69f44999d4-f2t57\" (UID: \"f895b9e3-15ae-4166-8aab-bd09e6ffe5f3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57"
Sep 08 10:11:56.467271 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:56.467173    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f895b9e3-15ae-4166-8aab-bd09e6ffe5f3-offline-tls\") pod \"feast-simple-feast-remote-setup-69f44999d4-f2t57\" (UID: \"f895b9e3-15ae-4166-8aab-bd09e6ffe5f3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57"
Sep 08 10:11:56.467271 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:11:56.467213    2579 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found
Sep 08 10:11:56.467271 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:56.467237    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97qh6\" (UniqueName: \"kubernetes.io/projected/f895b9e3-15ae-4166-8aab-bd09e6ffe5f3-kube-api-access-97qh6\") pod \"feast-simple-feast-remote-setup-69f44999d4-f2t57\" (UID: \"f895b9e3-15ae-4166-8aab-bd09e6ffe5f3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57"
Sep 08 10:11:56.467416 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:11:56.467291    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f895b9e3-15ae-4166-8aab-bd09e6ffe5f3-ui-tls podName:f895b9e3-15ae-4166-8aab-bd09e6ffe5f3 nodeName:}" failed. No retries permitted until 2026-09-08 10:11:56.967270851 +0000 UTC m=+830.662869758 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/f895b9e3-15ae-4166-8aab-bd09e6ffe5f3-ui-tls") pod "feast-simple-feast-remote-setup-69f44999d4-f2t57" (UID: "f895b9e3-15ae-4166-8aab-bd09e6ffe5f3") : secret "feast-simple-feast-remote-setup-ui-tls" not found
Sep 08 10:11:56.467580 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:56.467531    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f895b9e3-15ae-4166-8aab-bd09e6ffe5f3-feast-data\") pod \"feast-simple-feast-remote-setup-69f44999d4-f2t57\" (UID: \"f895b9e3-15ae-4166-8aab-bd09e6ffe5f3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57"
Sep 08 10:11:56.467847 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:56.467822    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/f895b9e3-15ae-4166-8aab-bd09e6ffe5f3-registry-tls\") pod \"feast-simple-feast-remote-setup-69f44999d4-f2t57\" (UID: \"f895b9e3-15ae-4166-8aab-bd09e6ffe5f3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57"
Sep 08 10:11:56.469876 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:56.469848    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f895b9e3-15ae-4166-8aab-bd09e6ffe5f3-online-tls\") pod \"feast-simple-feast-remote-setup-69f44999d4-f2t57\" (UID: \"f895b9e3-15ae-4166-8aab-bd09e6ffe5f3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57"
Sep 08 10:11:56.469954 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:56.469852    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f895b9e3-15ae-4166-8aab-bd09e6ffe5f3-offline-tls\") pod \"feast-simple-feast-remote-setup-69f44999d4-f2t57\" (UID: \"f895b9e3-15ae-4166-8aab-bd09e6ffe5f3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57"
Sep 08 10:11:56.478979 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:56.478958    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97qh6\" (UniqueName: \"kubernetes.io/projected/f895b9e3-15ae-4166-8aab-bd09e6ffe5f3-kube-api-access-97qh6\") pod \"feast-simple-feast-remote-setup-69f44999d4-f2t57\" (UID: \"f895b9e3-15ae-4166-8aab-bd09e6ffe5f3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57"
Sep 08 10:11:56.665832 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:56.665798    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:11:56.971072 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:56.971045    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f895b9e3-15ae-4166-8aab-bd09e6ffe5f3-ui-tls\") pod \"feast-simple-feast-remote-setup-69f44999d4-f2t57\" (UID: \"f895b9e3-15ae-4166-8aab-bd09e6ffe5f3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57"
Sep 08 10:11:56.973594 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:56.973569    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f895b9e3-15ae-4166-8aab-bd09e6ffe5f3-ui-tls\") pod \"feast-simple-feast-remote-setup-69f44999d4-f2t57\" (UID: \"f895b9e3-15ae-4166-8aab-bd09e6ffe5f3\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57"
Sep 08 10:11:57.214093 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:57.214056    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57"
Sep 08 10:11:57.497220 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:57.497189    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57"]
Sep 08 10:11:57.497487 ip-10-0-132-96 kubenswrapper[2579]: W0908 10:11:57.497449    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf895b9e3_15ae_4166_8aab_bd09e6ffe5f3.slice/crio-42dabfbc47acc8cac9c0e85ddeb4e3f13ab7c705a825a64996a23e852f06c9e6 WatchSource:0}: Error finding container 42dabfbc47acc8cac9c0e85ddeb4e3f13ab7c705a825a64996a23e852f06c9e6: Status 404 returned error can't find the container with id 42dabfbc47acc8cac9c0e85ddeb4e3f13ab7c705a825a64996a23e852f06c9e6
Sep 08 10:11:58.019620 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:58.019577    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57" event={"ID":"f895b9e3-15ae-4166-8aab-bd09e6ffe5f3","Type":"ContainerStarted","Data":"723e07afaf71dd28d57535682fba54244b9fa306c8ce2778cdf282559fce0699"}
Sep 08 10:11:58.020034 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:11:58.019630    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57" event={"ID":"f895b9e3-15ae-4166-8aab-bd09e6ffe5f3","Type":"ContainerStarted","Data":"42dabfbc47acc8cac9c0e85ddeb4e3f13ab7c705a825a64996a23e852f06c9e6"}
Sep 08 10:12:03.041909 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:12:03.041878    2579 generic.go:356] "Generic (PLEG): container finished" podID="f895b9e3-15ae-4166-8aab-bd09e6ffe5f3" containerID="723e07afaf71dd28d57535682fba54244b9fa306c8ce2778cdf282559fce0699" exitCode=0
Sep 08 10:12:03.042291 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:12:03.041949    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57" event={"ID":"f895b9e3-15ae-4166-8aab-bd09e6ffe5f3","Type":"ContainerDied","Data":"723e07afaf71dd28d57535682fba54244b9fa306c8ce2778cdf282559fce0699"}
Sep 08 10:12:04.048783 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:12:04.048746    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57" event={"ID":"f895b9e3-15ae-4166-8aab-bd09e6ffe5f3","Type":"ContainerStarted","Data":"f1178a447b848172214569dd34dc0b23ba61f19100347c6932daa32590e72658"}
Sep 08 10:12:30.167591 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:12:30.167555    2579 generic.go:356] "Generic (PLEG): container finished" podID="f895b9e3-15ae-4166-8aab-bd09e6ffe5f3" containerID="f1178a447b848172214569dd34dc0b23ba61f19100347c6932daa32590e72658" exitCode=0
Sep 08 10:12:30.168006 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:12:30.167603    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57" event={"ID":"f895b9e3-15ae-4166-8aab-bd09e6ffe5f3","Type":"ContainerDied","Data":"f1178a447b848172214569dd34dc0b23ba61f19100347c6932daa32590e72658"}
Sep 08 10:12:30.173404 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:12:30.173386    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\""
Sep 08 10:12:31.176263 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:12:31.176222    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57" event={"ID":"f895b9e3-15ae-4166-8aab-bd09e6ffe5f3","Type":"ContainerStarted","Data":"c0269d3326374e796ef7282b7df168f113a0a34a08cb6d2d1691f062efdf54eb"}
Sep 08 10:12:31.176667 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:12:31.176285    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57" event={"ID":"f895b9e3-15ae-4166-8aab-bd09e6ffe5f3","Type":"ContainerStarted","Data":"d1e781733ab2a9885280a2a2c51b4de3ce80d546cb0dad5ccc59a0c765a8af50"}
Sep 08 10:12:31.176667 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:12:31.176307    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57" event={"ID":"f895b9e3-15ae-4166-8aab-bd09e6ffe5f3","Type":"ContainerStarted","Data":"993b276e0a5960d30c4ffc5fd4c1ba43c4288f4768e42fcd5b8b6907a2924e20"}
Sep 08 10:12:31.204951 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:12:31.204899    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57" podStartSLOduration=35.204877777 podStartE2EDuration="35.204877777s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:11:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:12:31.201981663 +0000 UTC m=+864.897580564" watchObservedRunningTime="2026-09-08 10:12:31.204877777 +0000 UTC m=+864.900476678"
Sep 08 10:12:33.215171 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:12:33.215137    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57"
Sep 08 10:12:33.215584 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:12:33.215203    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57"
Sep 08 10:12:33.215584 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:12:33.215223    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57"
Sep 08 10:12:33.217003 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:12:33.216972    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57" podUID="f895b9e3-15ae-4166-8aab-bd09e6ffe5f3" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.30:8816: connect: connection refused"
Sep 08 10:12:33.217119 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:12:33.217004    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57" podUID="f895b9e3-15ae-4166-8aab-bd09e6ffe5f3" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.30:8443: connect: connection refused"
Sep 08 10:12:33.217119 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:12:33.217044    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57" podUID="f895b9e3-15ae-4166-8aab-bd09e6ffe5f3" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused"
Sep 08 10:12:36.215003 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:12:36.214940    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57" podUID="f895b9e3-15ae-4166-8aab-bd09e6ffe5f3" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.30:8443: connect: connection refused"
Sep 08 10:12:36.215470 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:12:36.214954    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57" podUID="f895b9e3-15ae-4166-8aab-bd09e6ffe5f3" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused"
Sep 08 10:12:36.215470 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:12:36.214954    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57" podUID="f895b9e3-15ae-4166-8aab-bd09e6ffe5f3" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.30:8816: connect: connection refused"
Sep 08 10:12:37.214718 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:12:37.214684    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57"
Sep 08 10:12:37.214915 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:12:37.214735    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57"
Sep 08 10:12:37.214915 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:12:37.214748    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57"
Sep 08 10:12:39.215680 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:12:39.215647    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57"
Sep 08 10:12:39.216104 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:12:39.215809    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57"
Sep 08 10:12:39.216636 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:12:39.216616    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57"
Sep 08 10:12:39.216741 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:12:39.216666    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57"
Sep 08 10:12:39.238425 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:12:39.238400    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57"
Sep 08 10:12:40.252590 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:12:40.252560    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57"
Sep 08 10:12:40.576880 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:12:40.576847    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:13:42.556478 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:13:42.556440    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:13:42.560217 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:13:42.560190    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57"]
Sep 08 10:13:42.560850 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:13:42.560579    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57" podUID="f895b9e3-15ae-4166-8aab-bd09e6ffe5f3" containerName="online" containerID="cri-o://993b276e0a5960d30c4ffc5fd4c1ba43c4288f4768e42fcd5b8b6907a2924e20" gracePeriod=30
Sep 08 10:13:42.560850 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:13:42.560658    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57" podUID="f895b9e3-15ae-4166-8aab-bd09e6ffe5f3" containerName="ui" containerID="cri-o://c0269d3326374e796ef7282b7df168f113a0a34a08cb6d2d1691f062efdf54eb" gracePeriod=30
Sep 08 10:13:42.560850 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:13:42.560745    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57" podUID="f895b9e3-15ae-4166-8aab-bd09e6ffe5f3" containerName="offline" containerID="cri-o://d1e781733ab2a9885280a2a2c51b4de3ce80d546cb0dad5ccc59a0c765a8af50" gracePeriod=30
Sep 08 10:13:42.676168 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:13:42.676136    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl"]
Sep 08 10:13:42.676393 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:13:42.676367    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl" podUID="307bb263-d593-4a17-b298-0d50a21da11b" containerName="registry" containerID="cri-o://35aedaba1b1d8877ef5a6c306cc04373e2c09b2e42c8b147f83a494caa074325" gracePeriod=30
Sep 08 10:13:42.676469 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:13:42.676425    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl" podUID="307bb263-d593-4a17-b298-0d50a21da11b" containerName="offline" containerID="cri-o://ffdc30429bd581a489e3c3dc434d1ff248d1dc1ac4787ab4f4b6e82e83438a4e" gracePeriod=30
Sep 08 10:13:42.676524 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:13:42.676452    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl" podUID="307bb263-d593-4a17-b298-0d50a21da11b" containerName="online" containerID="cri-o://1fa733334c8f2398df6910bbd5cbe62979c16fa25112cfa3a01caaffb04713e9" gracePeriod=30
Sep 08 10:13:42.676628 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:13:42.676593    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl" podUID="307bb263-d593-4a17-b298-0d50a21da11b" containerName="ui" containerID="cri-o://f825f926c5ddd408edd562a18527313c3870a7c4f97f5eb5984be8d4077c0f1f" gracePeriod=30
Sep 08 10:13:43.041377 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:13:43.041321    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl" podUID="307bb263-d593-4a17-b298-0d50a21da11b" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.29:8443: connect: connection refused"
Sep 08 10:13:43.503465 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:13:43.503432    2579 generic.go:356] "Generic (PLEG): container finished" podID="307bb263-d593-4a17-b298-0d50a21da11b" containerID="f825f926c5ddd408edd562a18527313c3870a7c4f97f5eb5984be8d4077c0f1f" exitCode=0
Sep 08 10:13:43.503465 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:13:43.503464    2579 generic.go:356] "Generic (PLEG): container finished" podID="307bb263-d593-4a17-b298-0d50a21da11b" containerID="1fa733334c8f2398df6910bbd5cbe62979c16fa25112cfa3a01caaffb04713e9" exitCode=0
Sep 08 10:13:43.503633 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:13:43.503515    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl" event={"ID":"307bb263-d593-4a17-b298-0d50a21da11b","Type":"ContainerDied","Data":"f825f926c5ddd408edd562a18527313c3870a7c4f97f5eb5984be8d4077c0f1f"}
Sep 08 10:13:43.503633 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:13:43.503580    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl" event={"ID":"307bb263-d593-4a17-b298-0d50a21da11b","Type":"ContainerDied","Data":"1fa733334c8f2398df6910bbd5cbe62979c16fa25112cfa3a01caaffb04713e9"}
Sep 08 10:13:43.506028 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:13:43.506009    2579 generic.go:356] "Generic (PLEG): container finished" podID="f895b9e3-15ae-4166-8aab-bd09e6ffe5f3" containerID="c0269d3326374e796ef7282b7df168f113a0a34a08cb6d2d1691f062efdf54eb" exitCode=0
Sep 08 10:13:43.506128 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:13:43.506030    2579 generic.go:356] "Generic (PLEG): container finished" podID="f895b9e3-15ae-4166-8aab-bd09e6ffe5f3" containerID="993b276e0a5960d30c4ffc5fd4c1ba43c4288f4768e42fcd5b8b6907a2924e20" exitCode=0
Sep 08 10:13:43.506128 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:13:43.506052    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57" event={"ID":"f895b9e3-15ae-4166-8aab-bd09e6ffe5f3","Type":"ContainerDied","Data":"c0269d3326374e796ef7282b7df168f113a0a34a08cb6d2d1691f062efdf54eb"}
Sep 08 10:13:43.506128 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:13:43.506084    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57" event={"ID":"f895b9e3-15ae-4166-8aab-bd09e6ffe5f3","Type":"ContainerDied","Data":"993b276e0a5960d30c4ffc5fd4c1ba43c4288f4768e42fcd5b8b6907a2924e20"}
Sep 08 10:13:43.758516 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:13:43.758416    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl" podUID="307bb263-d593-4a17-b298-0d50a21da11b" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused"
Sep 08 10:13:44.487747 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:13:44.487704    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:13:47.835592 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:13:47.835560    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:13:49.217094 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:13:49.217053    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57" podUID="f895b9e3-15ae-4166-8aab-bd09e6ffe5f3" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.30:8443: connect: connection refused"
Sep 08 10:13:50.235701 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:13:50.235658    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57" podUID="f895b9e3-15ae-4166-8aab-bd09e6ffe5f3" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused"
Sep 08 10:13:53.040643 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:13:53.040597    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl" podUID="307bb263-d593-4a17-b298-0d50a21da11b" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.29:8443: connect: connection refused"
Sep 08 10:13:53.758359 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:13:53.758317    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl" podUID="307bb263-d593-4a17-b298-0d50a21da11b" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused"
Sep 08 10:13:59.216424 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:13:59.216377    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57" podUID="f895b9e3-15ae-4166-8aab-bd09e6ffe5f3" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.30:8443: connect: connection refused"
Sep 08 10:14:00.230960 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:00.230918    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57" podUID="f895b9e3-15ae-4166-8aab-bd09e6ffe5f3" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused"
Sep 08 10:14:03.040957 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:03.040909    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl" podUID="307bb263-d593-4a17-b298-0d50a21da11b" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.29:8443: connect: connection refused"
Sep 08 10:14:03.041414 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:03.041067    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl"
Sep 08 10:14:03.758165 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:03.758120    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl" podUID="307bb263-d593-4a17-b298-0d50a21da11b" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused"
Sep 08 10:14:03.758365 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:03.758258    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl"
Sep 08 10:14:09.217047 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:09.217002    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57" podUID="f895b9e3-15ae-4166-8aab-bd09e6ffe5f3" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.30:8443: connect: connection refused"
Sep 08 10:14:09.217499 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:09.217131    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57"
Sep 08 10:14:10.230761 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:10.230720    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57" podUID="f895b9e3-15ae-4166-8aab-bd09e6ffe5f3" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused"
Sep 08 10:14:10.231148 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:10.230834    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57"
Sep 08 10:14:12.623719 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:12.623691    2579 generic.go:356] "Generic (PLEG): container finished" podID="f895b9e3-15ae-4166-8aab-bd09e6ffe5f3" containerID="d1e781733ab2a9885280a2a2c51b4de3ce80d546cb0dad5ccc59a0c765a8af50" exitCode=137
Sep 08 10:14:12.624014 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:12.623775    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57" event={"ID":"f895b9e3-15ae-4166-8aab-bd09e6ffe5f3","Type":"ContainerDied","Data":"d1e781733ab2a9885280a2a2c51b4de3ce80d546cb0dad5ccc59a0c765a8af50"}
Sep 08 10:14:13.041303 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.041268    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl" podUID="307bb263-d593-4a17-b298-0d50a21da11b" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.29:8443: connect: connection refused"
Sep 08 10:14:13.041476 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.041268    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl" podUID="307bb263-d593-4a17-b298-0d50a21da11b" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.29:6571: connect: connection refused"
Sep 08 10:14:13.041476 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.041269    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl" podUID="307bb263-d593-4a17-b298-0d50a21da11b" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.29:8816: connect: connection refused"
Sep 08 10:14:13.207486 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.207460    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57"
Sep 08 10:14:13.322994 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.322966    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/f895b9e3-15ae-4166-8aab-bd09e6ffe5f3-registry-tls\") pod \"f895b9e3-15ae-4166-8aab-bd09e6ffe5f3\" (UID: \"f895b9e3-15ae-4166-8aab-bd09e6ffe5f3\") "
Sep 08 10:14:13.323120 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.323010    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f895b9e3-15ae-4166-8aab-bd09e6ffe5f3-online-tls\") pod \"f895b9e3-15ae-4166-8aab-bd09e6ffe5f3\" (UID: \"f895b9e3-15ae-4166-8aab-bd09e6ffe5f3\") "
Sep 08 10:14:13.323120 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.323042    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f895b9e3-15ae-4166-8aab-bd09e6ffe5f3-offline-tls\") pod \"f895b9e3-15ae-4166-8aab-bd09e6ffe5f3\" (UID: \"f895b9e3-15ae-4166-8aab-bd09e6ffe5f3\") "
Sep 08 10:14:13.323120 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.323075    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f895b9e3-15ae-4166-8aab-bd09e6ffe5f3-ui-tls\") pod \"f895b9e3-15ae-4166-8aab-bd09e6ffe5f3\" (UID: \"f895b9e3-15ae-4166-8aab-bd09e6ffe5f3\") "
Sep 08 10:14:13.323120 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.323099    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-97qh6\" (UniqueName: \"kubernetes.io/projected/f895b9e3-15ae-4166-8aab-bd09e6ffe5f3-kube-api-access-97qh6\") pod \"f895b9e3-15ae-4166-8aab-bd09e6ffe5f3\" (UID: \"f895b9e3-15ae-4166-8aab-bd09e6ffe5f3\") "
Sep 08 10:14:13.323294 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.323152    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f895b9e3-15ae-4166-8aab-bd09e6ffe5f3-feast-data\") pod \"f895b9e3-15ae-4166-8aab-bd09e6ffe5f3\" (UID: \"f895b9e3-15ae-4166-8aab-bd09e6ffe5f3\") "
Sep 08 10:14:13.323349 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.323323    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f895b9e3-15ae-4166-8aab-bd09e6ffe5f3-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "f895b9e3-15ae-4166-8aab-bd09e6ffe5f3" (UID: "f895b9e3-15ae-4166-8aab-bd09e6ffe5f3"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:14:13.323429 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.323411    2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/f895b9e3-15ae-4166-8aab-bd09e6ffe5f3-registry-tls\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:14:13.323980 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.323892    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f895b9e3-15ae-4166-8aab-bd09e6ffe5f3-feast-data" (OuterVolumeSpecName: "feast-data") pod "f895b9e3-15ae-4166-8aab-bd09e6ffe5f3" (UID: "f895b9e3-15ae-4166-8aab-bd09e6ffe5f3"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:14:13.324087 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.324032    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl"
Sep 08 10:14:13.325460 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.325439    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f895b9e3-15ae-4166-8aab-bd09e6ffe5f3-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "f895b9e3-15ae-4166-8aab-bd09e6ffe5f3" (UID: "f895b9e3-15ae-4166-8aab-bd09e6ffe5f3"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:14:13.325631 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.325459    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f895b9e3-15ae-4166-8aab-bd09e6ffe5f3-online-tls" (OuterVolumeSpecName: "online-tls") pod "f895b9e3-15ae-4166-8aab-bd09e6ffe5f3" (UID: "f895b9e3-15ae-4166-8aab-bd09e6ffe5f3"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:14:13.325631 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.325483    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f895b9e3-15ae-4166-8aab-bd09e6ffe5f3-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "f895b9e3-15ae-4166-8aab-bd09e6ffe5f3" (UID: "f895b9e3-15ae-4166-8aab-bd09e6ffe5f3"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:14:13.325631 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.325460    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f895b9e3-15ae-4166-8aab-bd09e6ffe5f3-kube-api-access-97qh6" (OuterVolumeSpecName: "kube-api-access-97qh6") pod "f895b9e3-15ae-4166-8aab-bd09e6ffe5f3" (UID: "f895b9e3-15ae-4166-8aab-bd09e6ffe5f3"). InnerVolumeSpecName "kube-api-access-97qh6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:14:13.424406 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.424370    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/307bb263-d593-4a17-b298-0d50a21da11b-registry-tls\") pod \"307bb263-d593-4a17-b298-0d50a21da11b\" (UID: \"307bb263-d593-4a17-b298-0d50a21da11b\") "
Sep 08 10:14:13.424406 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.424407    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/307bb263-d593-4a17-b298-0d50a21da11b-offline-tls\") pod \"307bb263-d593-4a17-b298-0d50a21da11b\" (UID: \"307bb263-d593-4a17-b298-0d50a21da11b\") "
Sep 08 10:14:13.424661 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.424432    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/307bb263-d593-4a17-b298-0d50a21da11b-ui-tls\") pod \"307bb263-d593-4a17-b298-0d50a21da11b\" (UID: \"307bb263-d593-4a17-b298-0d50a21da11b\") "
Sep 08 10:14:13.424661 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.424475    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xgzww\" (UniqueName: \"kubernetes.io/projected/307bb263-d593-4a17-b298-0d50a21da11b-kube-api-access-xgzww\") pod \"307bb263-d593-4a17-b298-0d50a21da11b\" (UID: \"307bb263-d593-4a17-b298-0d50a21da11b\") "
Sep 08 10:14:13.424661 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.424509    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/307bb263-d593-4a17-b298-0d50a21da11b-feast-data\") pod \"307bb263-d593-4a17-b298-0d50a21da11b\" (UID: \"307bb263-d593-4a17-b298-0d50a21da11b\") "
Sep 08 10:14:13.424661 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.424568    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/307bb263-d593-4a17-b298-0d50a21da11b-online-tls\") pod \"307bb263-d593-4a17-b298-0d50a21da11b\" (UID: \"307bb263-d593-4a17-b298-0d50a21da11b\") "
Sep 08 10:14:13.424870 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.424833    2579 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/f895b9e3-15ae-4166-8aab-bd09e6ffe5f3-offline-tls\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:14:13.424870 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.424858    2579 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/f895b9e3-15ae-4166-8aab-bd09e6ffe5f3-ui-tls\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:14:13.424978 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.424876    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97qh6\" (UniqueName: \"kubernetes.io/projected/f895b9e3-15ae-4166-8aab-bd09e6ffe5f3-kube-api-access-97qh6\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:14:13.424978 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.424891    2579 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/f895b9e3-15ae-4166-8aab-bd09e6ffe5f3-feast-data\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:14:13.424978 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.424902    2579 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/f895b9e3-15ae-4166-8aab-bd09e6ffe5f3-online-tls\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:14:13.425162 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.425019    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/307bb263-d593-4a17-b298-0d50a21da11b-feast-data" (OuterVolumeSpecName: "feast-data") pod "307bb263-d593-4a17-b298-0d50a21da11b" (UID: "307bb263-d593-4a17-b298-0d50a21da11b"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:14:13.426835 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.426804    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/307bb263-d593-4a17-b298-0d50a21da11b-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "307bb263-d593-4a17-b298-0d50a21da11b" (UID: "307bb263-d593-4a17-b298-0d50a21da11b"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:14:13.426948 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.426851    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/307bb263-d593-4a17-b298-0d50a21da11b-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "307bb263-d593-4a17-b298-0d50a21da11b" (UID: "307bb263-d593-4a17-b298-0d50a21da11b"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:14:13.426948 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.426876    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/307bb263-d593-4a17-b298-0d50a21da11b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "307bb263-d593-4a17-b298-0d50a21da11b" (UID: "307bb263-d593-4a17-b298-0d50a21da11b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:14:13.427198 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.427179    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/307bb263-d593-4a17-b298-0d50a21da11b-kube-api-access-xgzww" (OuterVolumeSpecName: "kube-api-access-xgzww") pod "307bb263-d593-4a17-b298-0d50a21da11b" (UID: "307bb263-d593-4a17-b298-0d50a21da11b"). InnerVolumeSpecName "kube-api-access-xgzww". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:14:13.427235 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.427224    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/307bb263-d593-4a17-b298-0d50a21da11b-online-tls" (OuterVolumeSpecName: "online-tls") pod "307bb263-d593-4a17-b298-0d50a21da11b" (UID: "307bb263-d593-4a17-b298-0d50a21da11b"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:14:13.525867 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.525832    2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/307bb263-d593-4a17-b298-0d50a21da11b-registry-tls\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:14:13.525867 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.525859    2579 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/307bb263-d593-4a17-b298-0d50a21da11b-offline-tls\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:14:13.525867 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.525868    2579 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/307bb263-d593-4a17-b298-0d50a21da11b-ui-tls\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:14:13.525867 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.525877    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xgzww\" (UniqueName: \"kubernetes.io/projected/307bb263-d593-4a17-b298-0d50a21da11b-kube-api-access-xgzww\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:14:13.526197 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.525886    2579 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/307bb263-d593-4a17-b298-0d50a21da11b-feast-data\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:14:13.526197 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.525896    2579 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/307bb263-d593-4a17-b298-0d50a21da11b-online-tls\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:14:13.631431 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.631398    2579 generic.go:356] "Generic (PLEG): container finished" podID="307bb263-d593-4a17-b298-0d50a21da11b" containerID="ffdc30429bd581a489e3c3dc434d1ff248d1dc1ac4787ab4f4b6e82e83438a4e" exitCode=137
Sep 08 10:14:13.631431 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.631425    2579 generic.go:356] "Generic (PLEG): container finished" podID="307bb263-d593-4a17-b298-0d50a21da11b" containerID="35aedaba1b1d8877ef5a6c306cc04373e2c09b2e42c8b147f83a494caa074325" exitCode=137
Sep 08 10:14:13.631947 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.631458    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl"
Sep 08 10:14:13.631947 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.631465    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl" event={"ID":"307bb263-d593-4a17-b298-0d50a21da11b","Type":"ContainerDied","Data":"ffdc30429bd581a489e3c3dc434d1ff248d1dc1ac4787ab4f4b6e82e83438a4e"}
Sep 08 10:14:13.631947 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.631508    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl" event={"ID":"307bb263-d593-4a17-b298-0d50a21da11b","Type":"ContainerDied","Data":"35aedaba1b1d8877ef5a6c306cc04373e2c09b2e42c8b147f83a494caa074325"}
Sep 08 10:14:13.631947 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.631526    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl" event={"ID":"307bb263-d593-4a17-b298-0d50a21da11b","Type":"ContainerDied","Data":"26f683a4ce7dd673525b1c00c7740b7a7281298bfdf5713fa1c754b65d405db3"}
Sep 08 10:14:13.631947 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.631565    2579 scope.go:117] "RemoveContainer" containerID="f825f926c5ddd408edd562a18527313c3870a7c4f97f5eb5984be8d4077c0f1f"
Sep 08 10:14:13.634581 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.634554    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57" event={"ID":"f895b9e3-15ae-4166-8aab-bd09e6ffe5f3","Type":"ContainerDied","Data":"42dabfbc47acc8cac9c0e85ddeb4e3f13ab7c705a825a64996a23e852f06c9e6"}
Sep 08 10:14:13.634669 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.634564    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57"
Sep 08 10:14:13.640465 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.640441    2579 scope.go:117] "RemoveContainer" containerID="ffdc30429bd581a489e3c3dc434d1ff248d1dc1ac4787ab4f4b6e82e83438a4e"
Sep 08 10:14:13.650305 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.650287    2579 scope.go:117] "RemoveContainer" containerID="1fa733334c8f2398df6910bbd5cbe62979c16fa25112cfa3a01caaffb04713e9"
Sep 08 10:14:13.657199 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.657176    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl"]
Sep 08 10:14:13.658827 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.658795    2579 scope.go:117] "RemoveContainer" containerID="35aedaba1b1d8877ef5a6c306cc04373e2c09b2e42c8b147f83a494caa074325"
Sep 08 10:14:13.661007 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.660989    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-cf54dbbd5-2zndl"]
Sep 08 10:14:13.666963 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.666948    2579 scope.go:117] "RemoveContainer" containerID="d34561bfa0ac55c8c06f6e4b0783b9b599b2c4405497d0e09df9d9102295e43a"
Sep 08 10:14:13.674410 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.674387    2579 scope.go:117] "RemoveContainer" containerID="361723de372370b97cee3141bb7bd71e8634bcf1aa6373c1977e76a205677c35"
Sep 08 10:14:13.675475 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.675458    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57"]
Sep 08 10:14:13.680372 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.680350    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-69f44999d4-f2t57"]
Sep 08 10:14:13.682443 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.682423    2579 scope.go:117] "RemoveContainer" containerID="f825f926c5ddd408edd562a18527313c3870a7c4f97f5eb5984be8d4077c0f1f"
Sep 08 10:14:13.682737 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:14:13.682719    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f825f926c5ddd408edd562a18527313c3870a7c4f97f5eb5984be8d4077c0f1f\": container with ID starting with f825f926c5ddd408edd562a18527313c3870a7c4f97f5eb5984be8d4077c0f1f not found: ID does not exist" containerID="f825f926c5ddd408edd562a18527313c3870a7c4f97f5eb5984be8d4077c0f1f"
Sep 08 10:14:13.682802 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.682746    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f825f926c5ddd408edd562a18527313c3870a7c4f97f5eb5984be8d4077c0f1f"} err="failed to get container status \"f825f926c5ddd408edd562a18527313c3870a7c4f97f5eb5984be8d4077c0f1f\": rpc error: code = NotFound desc = could not find container \"f825f926c5ddd408edd562a18527313c3870a7c4f97f5eb5984be8d4077c0f1f\": container with ID starting with f825f926c5ddd408edd562a18527313c3870a7c4f97f5eb5984be8d4077c0f1f not found: ID does not exist"
Sep 08 10:14:13.682802 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.682765    2579 scope.go:117] "RemoveContainer" containerID="ffdc30429bd581a489e3c3dc434d1ff248d1dc1ac4787ab4f4b6e82e83438a4e"
Sep 08 10:14:13.683011 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:14:13.682995    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffdc30429bd581a489e3c3dc434d1ff248d1dc1ac4787ab4f4b6e82e83438a4e\": container with ID starting with ffdc30429bd581a489e3c3dc434d1ff248d1dc1ac4787ab4f4b6e82e83438a4e not found: ID does not exist" containerID="ffdc30429bd581a489e3c3dc434d1ff248d1dc1ac4787ab4f4b6e82e83438a4e"
Sep 08 10:14:13.683052 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.683020    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffdc30429bd581a489e3c3dc434d1ff248d1dc1ac4787ab4f4b6e82e83438a4e"} err="failed to get container status \"ffdc30429bd581a489e3c3dc434d1ff248d1dc1ac4787ab4f4b6e82e83438a4e\": rpc error: code = NotFound desc = could not find container \"ffdc30429bd581a489e3c3dc434d1ff248d1dc1ac4787ab4f4b6e82e83438a4e\": container with ID starting with ffdc30429bd581a489e3c3dc434d1ff248d1dc1ac4787ab4f4b6e82e83438a4e not found: ID does not exist"
Sep 08 10:14:13.683052 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.683036    2579 scope.go:117] "RemoveContainer" containerID="1fa733334c8f2398df6910bbd5cbe62979c16fa25112cfa3a01caaffb04713e9"
Sep 08 10:14:13.683269 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:14:13.683252    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fa733334c8f2398df6910bbd5cbe62979c16fa25112cfa3a01caaffb04713e9\": container with ID starting with 1fa733334c8f2398df6910bbd5cbe62979c16fa25112cfa3a01caaffb04713e9 not found: ID does not exist" containerID="1fa733334c8f2398df6910bbd5cbe62979c16fa25112cfa3a01caaffb04713e9"
Sep 08 10:14:13.683308 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.683274    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fa733334c8f2398df6910bbd5cbe62979c16fa25112cfa3a01caaffb04713e9"} err="failed to get container status \"1fa733334c8f2398df6910bbd5cbe62979c16fa25112cfa3a01caaffb04713e9\": rpc error: code = NotFound desc = could not find container \"1fa733334c8f2398df6910bbd5cbe62979c16fa25112cfa3a01caaffb04713e9\": container with ID starting with 1fa733334c8f2398df6910bbd5cbe62979c16fa25112cfa3a01caaffb04713e9 not found: ID does not exist"
Sep 08 10:14:13.683308 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.683289    2579 scope.go:117] "RemoveContainer" containerID="35aedaba1b1d8877ef5a6c306cc04373e2c09b2e42c8b147f83a494caa074325"
Sep 08 10:14:13.683649 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:14:13.683529    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35aedaba1b1d8877ef5a6c306cc04373e2c09b2e42c8b147f83a494caa074325\": container with ID starting with 35aedaba1b1d8877ef5a6c306cc04373e2c09b2e42c8b147f83a494caa074325 not found: ID does not exist" containerID="35aedaba1b1d8877ef5a6c306cc04373e2c09b2e42c8b147f83a494caa074325"
Sep 08 10:14:13.683742 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.683658    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35aedaba1b1d8877ef5a6c306cc04373e2c09b2e42c8b147f83a494caa074325"} err="failed to get container status \"35aedaba1b1d8877ef5a6c306cc04373e2c09b2e42c8b147f83a494caa074325\": rpc error: code = NotFound desc = could not find container \"35aedaba1b1d8877ef5a6c306cc04373e2c09b2e42c8b147f83a494caa074325\": container with ID starting with 35aedaba1b1d8877ef5a6c306cc04373e2c09b2e42c8b147f83a494caa074325 not found: ID does not exist"
Sep 08 10:14:13.683742 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.683675    2579 scope.go:117] "RemoveContainer" containerID="d34561bfa0ac55c8c06f6e4b0783b9b599b2c4405497d0e09df9d9102295e43a"
Sep 08 10:14:13.683887 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:14:13.683868    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d34561bfa0ac55c8c06f6e4b0783b9b599b2c4405497d0e09df9d9102295e43a\": container with ID starting with d34561bfa0ac55c8c06f6e4b0783b9b599b2c4405497d0e09df9d9102295e43a not found: ID does not exist" containerID="d34561bfa0ac55c8c06f6e4b0783b9b599b2c4405497d0e09df9d9102295e43a"
Sep 08 10:14:13.683926 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.683891    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d34561bfa0ac55c8c06f6e4b0783b9b599b2c4405497d0e09df9d9102295e43a"} err="failed to get container status \"d34561bfa0ac55c8c06f6e4b0783b9b599b2c4405497d0e09df9d9102295e43a\": rpc error: code = NotFound desc = could not find container \"d34561bfa0ac55c8c06f6e4b0783b9b599b2c4405497d0e09df9d9102295e43a\": container with ID starting with d34561bfa0ac55c8c06f6e4b0783b9b599b2c4405497d0e09df9d9102295e43a not found: ID does not exist"
Sep 08 10:14:13.683926 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.683903    2579 scope.go:117] "RemoveContainer" containerID="361723de372370b97cee3141bb7bd71e8634bcf1aa6373c1977e76a205677c35"
Sep 08 10:14:13.684108 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:14:13.684092    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"361723de372370b97cee3141bb7bd71e8634bcf1aa6373c1977e76a205677c35\": container with ID starting with 361723de372370b97cee3141bb7bd71e8634bcf1aa6373c1977e76a205677c35 not found: ID does not exist" containerID="361723de372370b97cee3141bb7bd71e8634bcf1aa6373c1977e76a205677c35"
Sep 08 10:14:13.684151 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.684115    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"361723de372370b97cee3141bb7bd71e8634bcf1aa6373c1977e76a205677c35"} err="failed to get container status \"361723de372370b97cee3141bb7bd71e8634bcf1aa6373c1977e76a205677c35\": rpc error: code = NotFound desc = could not find container \"361723de372370b97cee3141bb7bd71e8634bcf1aa6373c1977e76a205677c35\": container with ID starting with 361723de372370b97cee3141bb7bd71e8634bcf1aa6373c1977e76a205677c35 not found: ID does not exist"
Sep 08 10:14:13.684151 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.684128    2579 scope.go:117] "RemoveContainer" containerID="f825f926c5ddd408edd562a18527313c3870a7c4f97f5eb5984be8d4077c0f1f"
Sep 08 10:14:13.684322 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.684304    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f825f926c5ddd408edd562a18527313c3870a7c4f97f5eb5984be8d4077c0f1f"} err="failed to get container status \"f825f926c5ddd408edd562a18527313c3870a7c4f97f5eb5984be8d4077c0f1f\": rpc error: code = NotFound desc = could not find container \"f825f926c5ddd408edd562a18527313c3870a7c4f97f5eb5984be8d4077c0f1f\": container with ID starting with f825f926c5ddd408edd562a18527313c3870a7c4f97f5eb5984be8d4077c0f1f not found: ID does not exist"
Sep 08 10:14:13.684389 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.684324    2579 scope.go:117] "RemoveContainer" containerID="ffdc30429bd581a489e3c3dc434d1ff248d1dc1ac4787ab4f4b6e82e83438a4e"
Sep 08 10:14:13.684582 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.684566    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffdc30429bd581a489e3c3dc434d1ff248d1dc1ac4787ab4f4b6e82e83438a4e"} err="failed to get container status \"ffdc30429bd581a489e3c3dc434d1ff248d1dc1ac4787ab4f4b6e82e83438a4e\": rpc error: code = NotFound desc = could not find container \"ffdc30429bd581a489e3c3dc434d1ff248d1dc1ac4787ab4f4b6e82e83438a4e\": container with ID starting with ffdc30429bd581a489e3c3dc434d1ff248d1dc1ac4787ab4f4b6e82e83438a4e not found: ID does not exist"
Sep 08 10:14:13.684635 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.684582    2579 scope.go:117] "RemoveContainer" containerID="1fa733334c8f2398df6910bbd5cbe62979c16fa25112cfa3a01caaffb04713e9"
Sep 08 10:14:13.684794 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.684776    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fa733334c8f2398df6910bbd5cbe62979c16fa25112cfa3a01caaffb04713e9"} err="failed to get container status \"1fa733334c8f2398df6910bbd5cbe62979c16fa25112cfa3a01caaffb04713e9\": rpc error: code = NotFound desc = could not find container \"1fa733334c8f2398df6910bbd5cbe62979c16fa25112cfa3a01caaffb04713e9\": container with ID starting with 1fa733334c8f2398df6910bbd5cbe62979c16fa25112cfa3a01caaffb04713e9 not found: ID does not exist"
Sep 08 10:14:13.684862 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.684796    2579 scope.go:117] "RemoveContainer" containerID="35aedaba1b1d8877ef5a6c306cc04373e2c09b2e42c8b147f83a494caa074325"
Sep 08 10:14:13.685011 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.684997    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35aedaba1b1d8877ef5a6c306cc04373e2c09b2e42c8b147f83a494caa074325"} err="failed to get container status \"35aedaba1b1d8877ef5a6c306cc04373e2c09b2e42c8b147f83a494caa074325\": rpc error: code = NotFound desc = could not find container \"35aedaba1b1d8877ef5a6c306cc04373e2c09b2e42c8b147f83a494caa074325\": container with ID starting with 35aedaba1b1d8877ef5a6c306cc04373e2c09b2e42c8b147f83a494caa074325 not found: ID does not exist"
Sep 08 10:14:13.685056 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.685011    2579 scope.go:117] "RemoveContainer" containerID="d34561bfa0ac55c8c06f6e4b0783b9b599b2c4405497d0e09df9d9102295e43a"
Sep 08 10:14:13.685211 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.685194    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d34561bfa0ac55c8c06f6e4b0783b9b599b2c4405497d0e09df9d9102295e43a"} err="failed to get container status \"d34561bfa0ac55c8c06f6e4b0783b9b599b2c4405497d0e09df9d9102295e43a\": rpc error: code = NotFound desc = could not find container \"d34561bfa0ac55c8c06f6e4b0783b9b599b2c4405497d0e09df9d9102295e43a\": container with ID starting with d34561bfa0ac55c8c06f6e4b0783b9b599b2c4405497d0e09df9d9102295e43a not found: ID does not exist"
Sep 08 10:14:13.685278 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.685212    2579 scope.go:117] "RemoveContainer" containerID="361723de372370b97cee3141bb7bd71e8634bcf1aa6373c1977e76a205677c35"
Sep 08 10:14:13.685421 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.685407    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"361723de372370b97cee3141bb7bd71e8634bcf1aa6373c1977e76a205677c35"} err="failed to get container status \"361723de372370b97cee3141bb7bd71e8634bcf1aa6373c1977e76a205677c35\": rpc error: code = NotFound desc = could not find container \"361723de372370b97cee3141bb7bd71e8634bcf1aa6373c1977e76a205677c35\": container with ID starting with 361723de372370b97cee3141bb7bd71e8634bcf1aa6373c1977e76a205677c35 not found: ID does not exist"
Sep 08 10:14:13.685475 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.685420    2579 scope.go:117] "RemoveContainer" containerID="c0269d3326374e796ef7282b7df168f113a0a34a08cb6d2d1691f062efdf54eb"
Sep 08 10:14:13.692735 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.692706    2579 scope.go:117] "RemoveContainer" containerID="d1e781733ab2a9885280a2a2c51b4de3ce80d546cb0dad5ccc59a0c765a8af50"
Sep 08 10:14:13.700298 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.700278    2579 scope.go:117] "RemoveContainer" containerID="993b276e0a5960d30c4ffc5fd4c1ba43c4288f4768e42fcd5b8b6907a2924e20"
Sep 08 10:14:13.707867 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.707847    2579 scope.go:117] "RemoveContainer" containerID="f1178a447b848172214569dd34dc0b23ba61f19100347c6932daa32590e72658"
Sep 08 10:14:13.714868 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:13.714853    2579 scope.go:117] "RemoveContainer" containerID="723e07afaf71dd28d57535682fba54244b9fa306c8ce2778cdf282559fce0699"
Sep 08 10:14:14.832010 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:14.831978    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="307bb263-d593-4a17-b298-0d50a21da11b" path="/var/lib/kubelet/pods/307bb263-d593-4a17-b298-0d50a21da11b/volumes"
Sep 08 10:14:14.832587 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:14.832572    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f895b9e3-15ae-4166-8aab-bd09e6ffe5f3" path="/var/lib/kubelet/pods/f895b9e3-15ae-4166-8aab-bd09e6ffe5f3/volumes"
Sep 08 10:14:25.461245 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:25.461196    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:14:25.658621 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:25.658568    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/postgres-864846d4f5-446m4"]
Sep 08 10:14:25.658933 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:25.658920    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f895b9e3-15ae-4166-8aab-bd09e6ffe5f3" containerName="feast-apply"
Sep 08 10:14:25.658979 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:25.658941    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f895b9e3-15ae-4166-8aab-bd09e6ffe5f3" containerName="feast-apply"
Sep 08 10:14:25.658979 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:25.658954    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="307bb263-d593-4a17-b298-0d50a21da11b" containerName="registry"
Sep 08 10:14:25.658979 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:25.658959    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="307bb263-d593-4a17-b298-0d50a21da11b" containerName="registry"
Sep 08 10:14:25.658979 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:25.658967    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="307bb263-d593-4a17-b298-0d50a21da11b" containerName="online"
Sep 08 10:14:25.658979 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:25.658972    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="307bb263-d593-4a17-b298-0d50a21da11b" containerName="online"
Sep 08 10:14:25.658979 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:25.658979    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f895b9e3-15ae-4166-8aab-bd09e6ffe5f3" containerName="feast-init"
Sep 08 10:14:25.659153 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:25.658984    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f895b9e3-15ae-4166-8aab-bd09e6ffe5f3" containerName="feast-init"
Sep 08 10:14:25.659153 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:25.658991    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="307bb263-d593-4a17-b298-0d50a21da11b" containerName="ui"
Sep 08 10:14:25.659153 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:25.658998    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="307bb263-d593-4a17-b298-0d50a21da11b" containerName="ui"
Sep 08 10:14:25.659153 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:25.659005    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="307bb263-d593-4a17-b298-0d50a21da11b" containerName="feast-init"
Sep 08 10:14:25.659153 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:25.659013    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="307bb263-d593-4a17-b298-0d50a21da11b" containerName="feast-init"
Sep 08 10:14:25.659153 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:25.659024    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="307bb263-d593-4a17-b298-0d50a21da11b" containerName="feast-apply"
Sep 08 10:14:25.659153 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:25.659029    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="307bb263-d593-4a17-b298-0d50a21da11b" containerName="feast-apply"
Sep 08 10:14:25.659153 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:25.659039    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="307bb263-d593-4a17-b298-0d50a21da11b" containerName="offline"
Sep 08 10:14:25.659153 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:25.659043    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="307bb263-d593-4a17-b298-0d50a21da11b" containerName="offline"
Sep 08 10:14:25.659153 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:25.659048    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f895b9e3-15ae-4166-8aab-bd09e6ffe5f3" containerName="online"
Sep 08 10:14:25.659153 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:25.659052    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f895b9e3-15ae-4166-8aab-bd09e6ffe5f3" containerName="online"
Sep 08 10:14:25.659153 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:25.659058    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f895b9e3-15ae-4166-8aab-bd09e6ffe5f3" containerName="ui"
Sep 08 10:14:25.659153 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:25.659064    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f895b9e3-15ae-4166-8aab-bd09e6ffe5f3" containerName="ui"
Sep 08 10:14:25.659153 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:25.659073    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f895b9e3-15ae-4166-8aab-bd09e6ffe5f3" containerName="offline"
Sep 08 10:14:25.659153 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:25.659078    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f895b9e3-15ae-4166-8aab-bd09e6ffe5f3" containerName="offline"
Sep 08 10:14:25.659153 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:25.659130    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="307bb263-d593-4a17-b298-0d50a21da11b" containerName="offline"
Sep 08 10:14:25.659153 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:25.659139    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f895b9e3-15ae-4166-8aab-bd09e6ffe5f3" containerName="ui"
Sep 08 10:14:25.659153 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:25.659145    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="307bb263-d593-4a17-b298-0d50a21da11b" containerName="registry"
Sep 08 10:14:25.659153 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:25.659150    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="307bb263-d593-4a17-b298-0d50a21da11b" containerName="ui"
Sep 08 10:14:25.659153 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:25.659155    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f895b9e3-15ae-4166-8aab-bd09e6ffe5f3" containerName="online"
Sep 08 10:14:25.659153 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:25.659160    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f895b9e3-15ae-4166-8aab-bd09e6ffe5f3" containerName="offline"
Sep 08 10:14:25.659919 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:25.659171    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="307bb263-d593-4a17-b298-0d50a21da11b" containerName="online"
Sep 08 10:14:25.665152 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:25.665133    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-446m4"
Sep 08 10:14:25.668080 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:25.668058    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-446m4"]
Sep 08 10:14:25.668648 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:25.668618    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Sep 08 10:14:25.668753 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:25.668688    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\""
Sep 08 10:14:25.669865 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:25.669846    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-4ksh4\""
Sep 08 10:14:25.669969 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:25.669894    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Sep 08 10:14:25.693775 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:25.693749    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/redis-69bbd798b6-vmfmm"]
Sep 08 10:14:25.697029 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:25.697010    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-vmfmm"
Sep 08 10:14:25.702469 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:25.702447    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-vmfmm"]
Sep 08 10:14:25.706631 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:25.706606    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:14:25.721775 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:25.721702    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wrhw\" (UniqueName: \"kubernetes.io/projected/4e37a702-ddbc-4c91-8b17-62c90f2bd6ad-kube-api-access-5wrhw\") pod \"redis-69bbd798b6-vmfmm\" (UID: \"4e37a702-ddbc-4c91-8b17-62c90f2bd6ad\") " pod="test-ns-feast/redis-69bbd798b6-vmfmm"
Sep 08 10:14:25.721888 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:25.721776    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnd56\" (UniqueName: \"kubernetes.io/projected/141d630f-4a2c-45ad-9a27-96121fe5eeb0-kube-api-access-wnd56\") pod \"postgres-864846d4f5-446m4\" (UID: \"141d630f-4a2c-45ad-9a27-96121fe5eeb0\") " pod="test-ns-feast/postgres-864846d4f5-446m4"
Sep 08 10:14:25.721888 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:25.721855    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/141d630f-4a2c-45ad-9a27-96121fe5eeb0-postgresdata\") pod \"postgres-864846d4f5-446m4\" (UID: \"141d630f-4a2c-45ad-9a27-96121fe5eeb0\") " pod="test-ns-feast/postgres-864846d4f5-446m4"
Sep 08 10:14:25.766386 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:25.766357    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:14:25.822530 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:25.822502    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/141d630f-4a2c-45ad-9a27-96121fe5eeb0-postgresdata\") pod \"postgres-864846d4f5-446m4\" (UID: \"141d630f-4a2c-45ad-9a27-96121fe5eeb0\") " pod="test-ns-feast/postgres-864846d4f5-446m4"
Sep 08 10:14:25.822887 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:25.822582    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wrhw\" (UniqueName: \"kubernetes.io/projected/4e37a702-ddbc-4c91-8b17-62c90f2bd6ad-kube-api-access-5wrhw\") pod \"redis-69bbd798b6-vmfmm\" (UID: \"4e37a702-ddbc-4c91-8b17-62c90f2bd6ad\") " pod="test-ns-feast/redis-69bbd798b6-vmfmm"
Sep 08 10:14:25.822887 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:25.822624    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnd56\" (UniqueName: \"kubernetes.io/projected/141d630f-4a2c-45ad-9a27-96121fe5eeb0-kube-api-access-wnd56\") pod \"postgres-864846d4f5-446m4\" (UID: \"141d630f-4a2c-45ad-9a27-96121fe5eeb0\") " pod="test-ns-feast/postgres-864846d4f5-446m4"
Sep 08 10:14:25.822887 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:25.822825    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/141d630f-4a2c-45ad-9a27-96121fe5eeb0-postgresdata\") pod \"postgres-864846d4f5-446m4\" (UID: \"141d630f-4a2c-45ad-9a27-96121fe5eeb0\") " pod="test-ns-feast/postgres-864846d4f5-446m4"
Sep 08 10:14:25.831651 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:25.831624    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wrhw\" (UniqueName: \"kubernetes.io/projected/4e37a702-ddbc-4c91-8b17-62c90f2bd6ad-kube-api-access-5wrhw\") pod \"redis-69bbd798b6-vmfmm\" (UID: \"4e37a702-ddbc-4c91-8b17-62c90f2bd6ad\") " pod="test-ns-feast/redis-69bbd798b6-vmfmm"
Sep 08 10:14:25.831732 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:25.831668    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnd56\" (UniqueName: \"kubernetes.io/projected/141d630f-4a2c-45ad-9a27-96121fe5eeb0-kube-api-access-wnd56\") pod \"postgres-864846d4f5-446m4\" (UID: \"141d630f-4a2c-45ad-9a27-96121fe5eeb0\") " pod="test-ns-feast/postgres-864846d4f5-446m4"
Sep 08 10:14:25.987069 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:25.986994    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-446m4"
Sep 08 10:14:26.007105 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:26.007080    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-vmfmm"
Sep 08 10:14:26.261315 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:26.261290    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-446m4"]
Sep 08 10:14:26.263180 ip-10-0-132-96 kubenswrapper[2579]: W0908 10:14:26.263143    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod141d630f_4a2c_45ad_9a27_96121fe5eeb0.slice/crio-e5c6989ef5a6b9b10936c723628bf348399f35c2533a787a7764757fe9086f7f WatchSource:0}: Error finding container e5c6989ef5a6b9b10936c723628bf348399f35c2533a787a7764757fe9086f7f: Status 404 returned error can't find the container with id e5c6989ef5a6b9b10936c723628bf348399f35c2533a787a7764757fe9086f7f
Sep 08 10:14:26.264978 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:26.264961    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 10:14:26.287219 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:26.287201    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-vmfmm"]
Sep 08 10:14:26.289376 ip-10-0-132-96 kubenswrapper[2579]: W0908 10:14:26.289353    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4e37a702_ddbc_4c91_8b17_62c90f2bd6ad.slice/crio-91d7af9993edc7d8e92c8c0f885f1236053d77e23bbe7c748a1bd3894b355c16 WatchSource:0}: Error finding container 91d7af9993edc7d8e92c8c0f885f1236053d77e23bbe7c748a1bd3894b355c16: Status 404 returned error can't find the container with id 91d7af9993edc7d8e92c8c0f885f1236053d77e23bbe7c748a1bd3894b355c16
Sep 08 10:14:26.693766 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:26.693731    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-vmfmm" event={"ID":"4e37a702-ddbc-4c91-8b17-62c90f2bd6ad","Type":"ContainerStarted","Data":"91d7af9993edc7d8e92c8c0f885f1236053d77e23bbe7c748a1bd3894b355c16"}
Sep 08 10:14:26.694739 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:26.694715    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-446m4" event={"ID":"141d630f-4a2c-45ad-9a27-96121fe5eeb0","Type":"ContainerStarted","Data":"e5c6989ef5a6b9b10936c723628bf348399f35c2533a787a7764757fe9086f7f"}
Sep 08 10:14:34.734778 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:34.734736    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-vmfmm" event={"ID":"4e37a702-ddbc-4c91-8b17-62c90f2bd6ad","Type":"ContainerStarted","Data":"8964c21d8bda26c8439996059f712746e4f35d4522fbcb4558f8803afc4ffaf8"}
Sep 08 10:14:34.736285 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:34.736261    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-446m4" event={"ID":"141d630f-4a2c-45ad-9a27-96121fe5eeb0","Type":"ContainerStarted","Data":"41afe76af5652b70932a0b35fb074eedb9bd5bbf00cca4438c32d1130baa762f"}
Sep 08 10:14:34.751502 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:34.751437    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/redis-69bbd798b6-vmfmm" podStartSLOduration=2.242158303 podStartE2EDuration="9.751416409s" totalImagesPullingTime="7.509258106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:14:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:14:34.750498903 +0000 UTC m=+988.446097804" watchObservedRunningTime="2026-09-08 10:14:34.751416409 +0000 UTC m=+988.447015310"
Sep 08 10:14:34.769257 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:34.769195    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/postgres-864846d4f5-446m4" podStartSLOduration=2.183832885 podStartE2EDuration="9.769175695s" totalImagesPullingTime="7.58534281s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:14:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:14:34.768417855 +0000 UTC m=+988.464016780" watchObservedRunningTime="2026-09-08 10:14:34.769175695 +0000 UTC m=+988.464774596"
Sep 08 10:14:38.378495 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:38.378461    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:14:38.474443 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:38.474403    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:14:38.482647 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:38.482619    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7"]
Sep 08 10:14:38.486226 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:38.486211    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7"
Sep 08 10:14:38.489029 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:38.489002    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-online-tls\""
Sep 08 10:14:38.489151 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:38.489121    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-registry-tls\""
Sep 08 10:14:38.489217 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:38.489203    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-offline-tls\""
Sep 08 10:14:38.489416 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:38.489399    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\""
Sep 08 10:14:38.489460 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:38.489439    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-wvltt\""
Sep 08 10:14:38.497590 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:38.497564    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7"]
Sep 08 10:14:38.526611 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:38.526583    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/31753bb2-8aa7-450b-b51f-8f76dac5e6a9-online-tls\") pod \"feast-credit-scoring-5f5cbf49-vlrg7\" (UID: \"31753bb2-8aa7-450b-b51f-8f76dac5e6a9\") " pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7"
Sep 08 10:14:38.526723 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:38.526627    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6db64\" (UniqueName: \"kubernetes.io/projected/31753bb2-8aa7-450b-b51f-8f76dac5e6a9-kube-api-access-6db64\") pod \"feast-credit-scoring-5f5cbf49-vlrg7\" (UID: \"31753bb2-8aa7-450b-b51f-8f76dac5e6a9\") " pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7"
Sep 08 10:14:38.526723 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:38.526702    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/31753bb2-8aa7-450b-b51f-8f76dac5e6a9-offline-tls\") pod \"feast-credit-scoring-5f5cbf49-vlrg7\" (UID: \"31753bb2-8aa7-450b-b51f-8f76dac5e6a9\") " pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7"
Sep 08 10:14:38.526863 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:38.526731    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/31753bb2-8aa7-450b-b51f-8f76dac5e6a9-registry-tls\") pod \"feast-credit-scoring-5f5cbf49-vlrg7\" (UID: \"31753bb2-8aa7-450b-b51f-8f76dac5e6a9\") " pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7"
Sep 08 10:14:38.526863 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:38.526755    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/31753bb2-8aa7-450b-b51f-8f76dac5e6a9-feast-data\") pod \"feast-credit-scoring-5f5cbf49-vlrg7\" (UID: \"31753bb2-8aa7-450b-b51f-8f76dac5e6a9\") " pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7"
Sep 08 10:14:38.539706 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:38.539683    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:14:38.627359 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:38.627336    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/31753bb2-8aa7-450b-b51f-8f76dac5e6a9-offline-tls\") pod \"feast-credit-scoring-5f5cbf49-vlrg7\" (UID: \"31753bb2-8aa7-450b-b51f-8f76dac5e6a9\") " pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7"
Sep 08 10:14:38.627466 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:38.627363    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/31753bb2-8aa7-450b-b51f-8f76dac5e6a9-registry-tls\") pod \"feast-credit-scoring-5f5cbf49-vlrg7\" (UID: \"31753bb2-8aa7-450b-b51f-8f76dac5e6a9\") " pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7"
Sep 08 10:14:38.627466 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:38.627382    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/31753bb2-8aa7-450b-b51f-8f76dac5e6a9-feast-data\") pod \"feast-credit-scoring-5f5cbf49-vlrg7\" (UID: \"31753bb2-8aa7-450b-b51f-8f76dac5e6a9\") " pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7"
Sep 08 10:14:38.627466 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:38.627423    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/31753bb2-8aa7-450b-b51f-8f76dac5e6a9-online-tls\") pod \"feast-credit-scoring-5f5cbf49-vlrg7\" (UID: \"31753bb2-8aa7-450b-b51f-8f76dac5e6a9\") " pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7"
Sep 08 10:14:38.627640 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:14:38.627494    2579 secret.go:189] Couldn't get secret test-ns-feast/feast-credit-scoring-registry-tls: secret "feast-credit-scoring-registry-tls" not found
Sep 08 10:14:38.627640 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:38.627554    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6db64\" (UniqueName: \"kubernetes.io/projected/31753bb2-8aa7-450b-b51f-8f76dac5e6a9-kube-api-access-6db64\") pod \"feast-credit-scoring-5f5cbf49-vlrg7\" (UID: \"31753bb2-8aa7-450b-b51f-8f76dac5e6a9\") " pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7"
Sep 08 10:14:38.627640 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:14:38.627577    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31753bb2-8aa7-450b-b51f-8f76dac5e6a9-registry-tls podName:31753bb2-8aa7-450b-b51f-8f76dac5e6a9 nodeName:}" failed. No retries permitted until 2026-09-08 10:14:39.127560095 +0000 UTC m=+992.823158973 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/31753bb2-8aa7-450b-b51f-8f76dac5e6a9-registry-tls") pod "feast-credit-scoring-5f5cbf49-vlrg7" (UID: "31753bb2-8aa7-450b-b51f-8f76dac5e6a9") : secret "feast-credit-scoring-registry-tls" not found
Sep 08 10:14:38.627807 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:38.627786    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/31753bb2-8aa7-450b-b51f-8f76dac5e6a9-feast-data\") pod \"feast-credit-scoring-5f5cbf49-vlrg7\" (UID: \"31753bb2-8aa7-450b-b51f-8f76dac5e6a9\") " pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7"
Sep 08 10:14:38.630002 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:38.629948    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/31753bb2-8aa7-450b-b51f-8f76dac5e6a9-offline-tls\") pod \"feast-credit-scoring-5f5cbf49-vlrg7\" (UID: \"31753bb2-8aa7-450b-b51f-8f76dac5e6a9\") " pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7"
Sep 08 10:14:38.630002 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:38.629978    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/31753bb2-8aa7-450b-b51f-8f76dac5e6a9-online-tls\") pod \"feast-credit-scoring-5f5cbf49-vlrg7\" (UID: \"31753bb2-8aa7-450b-b51f-8f76dac5e6a9\") " pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7"
Sep 08 10:14:38.640170 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:38.640150    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6db64\" (UniqueName: \"kubernetes.io/projected/31753bb2-8aa7-450b-b51f-8f76dac5e6a9-kube-api-access-6db64\") pod \"feast-credit-scoring-5f5cbf49-vlrg7\" (UID: \"31753bb2-8aa7-450b-b51f-8f76dac5e6a9\") " pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7"
Sep 08 10:14:38.678972 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:38.678951    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:14:38.745197 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:38.745168    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:14:39.131684 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:39.131648    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/31753bb2-8aa7-450b-b51f-8f76dac5e6a9-registry-tls\") pod \"feast-credit-scoring-5f5cbf49-vlrg7\" (UID: \"31753bb2-8aa7-450b-b51f-8f76dac5e6a9\") " pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7"
Sep 08 10:14:39.134267 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:39.134238    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/31753bb2-8aa7-450b-b51f-8f76dac5e6a9-registry-tls\") pod \"feast-credit-scoring-5f5cbf49-vlrg7\" (UID: \"31753bb2-8aa7-450b-b51f-8f76dac5e6a9\") " pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7"
Sep 08 10:14:39.395484 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:39.395405    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7"
Sep 08 10:14:39.676570 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:39.676520    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7"]
Sep 08 10:14:39.677136 ip-10-0-132-96 kubenswrapper[2579]: W0908 10:14:39.677111    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31753bb2_8aa7_450b_b51f_8f76dac5e6a9.slice/crio-b216ad7f6064769b29847f02085fdda05bf69991d6488185d0f89d536efc38a4 WatchSource:0}: Error finding container b216ad7f6064769b29847f02085fdda05bf69991d6488185d0f89d536efc38a4: Status 404 returned error can't find the container with id b216ad7f6064769b29847f02085fdda05bf69991d6488185d0f89d536efc38a4
Sep 08 10:14:39.758088 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:39.758054    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7" event={"ID":"31753bb2-8aa7-450b-b51f-8f76dac5e6a9","Type":"ContainerStarted","Data":"88d4a68f0a6b57cda366dbc38bb41e1a2e14a5e56f17ed19676630c6b22cf946"}
Sep 08 10:14:39.758177 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:39.758121    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7" event={"ID":"31753bb2-8aa7-450b-b51f-8f76dac5e6a9","Type":"ContainerStarted","Data":"b216ad7f6064769b29847f02085fdda05bf69991d6488185d0f89d536efc38a4"}
Sep 08 10:14:41.768599 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:41.768566    2579 generic.go:356] "Generic (PLEG): container finished" podID="31753bb2-8aa7-450b-b51f-8f76dac5e6a9" containerID="88d4a68f0a6b57cda366dbc38bb41e1a2e14a5e56f17ed19676630c6b22cf946" exitCode=0
Sep 08 10:14:41.768935 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:41.768626    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7" event={"ID":"31753bb2-8aa7-450b-b51f-8f76dac5e6a9","Type":"ContainerDied","Data":"88d4a68f0a6b57cda366dbc38bb41e1a2e14a5e56f17ed19676630c6b22cf946"}
Sep 08 10:14:42.775580 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:42.775521    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7" event={"ID":"31753bb2-8aa7-450b-b51f-8f76dac5e6a9","Type":"ContainerStarted","Data":"313cada514d19609fa63bc9c5a07d7ce3a3050a231af69c75a7fadf30ebed0c1"}
Sep 08 10:14:48.807965 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:48.807929    2579 generic.go:356] "Generic (PLEG): container finished" podID="31753bb2-8aa7-450b-b51f-8f76dac5e6a9" containerID="313cada514d19609fa63bc9c5a07d7ce3a3050a231af69c75a7fadf30ebed0c1" exitCode=0
Sep 08 10:14:48.807965 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:48.807967    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7" event={"ID":"31753bb2-8aa7-450b-b51f-8f76dac5e6a9","Type":"ContainerDied","Data":"313cada514d19609fa63bc9c5a07d7ce3a3050a231af69c75a7fadf30ebed0c1"}
Sep 08 10:14:49.817835 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:49.817796    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7" event={"ID":"31753bb2-8aa7-450b-b51f-8f76dac5e6a9","Type":"ContainerStarted","Data":"ec82d9094f2d55b9ce2e1c05096352a367ec3e37cd3947303ad252b5e03272c5"}
Sep 08 10:14:49.818323 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:49.817876    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7" event={"ID":"31753bb2-8aa7-450b-b51f-8f76dac5e6a9","Type":"ContainerStarted","Data":"b7f616326600ad7fef04e11bd463b1cdc7c66e95092bc0876323ab53a0e4ad91"}
Sep 08 10:14:49.818323 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:49.817907    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7" event={"ID":"31753bb2-8aa7-450b-b51f-8f76dac5e6a9","Type":"ContainerStarted","Data":"9b8197fb9c100b89b3d11a54cf347b434b6d1e093da6705ad7334007a1626a12"}
Sep 08 10:14:49.845847 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:49.845786    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7" podStartSLOduration=11.845764144 podStartE2EDuration="11.845764144s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:14:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:14:49.84310224 +0000 UTC m=+1003.538701173" watchObservedRunningTime="2026-09-08 10:14:49.845764144 +0000 UTC m=+1003.541363067"
Sep 08 10:14:50.309788 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:50.309732    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:14:51.395766 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:51.395722    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7"
Sep 08 10:14:51.396262 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:51.395817    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7"
Sep 08 10:14:51.396262 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:51.395845    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7"
Sep 08 10:14:51.397148 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:51.397118    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7" podUID="31753bb2-8aa7-450b-b51f-8f76dac5e6a9" containerName="online" probeResult="failure" output="Get \"https://10.133.0.33:6567/health\": dial tcp 10.133.0.33:6567: connect: connection refused"
Sep 08 10:14:51.397148 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:51.397137    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7" podUID="31753bb2-8aa7-450b-b51f-8f76dac5e6a9" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.33:6571: connect: connection refused"
Sep 08 10:14:51.397359 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:51.397154    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7" podUID="31753bb2-8aa7-450b-b51f-8f76dac5e6a9" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.33:8816: connect: connection refused"
Sep 08 10:14:54.395910 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:54.395870    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7" podUID="31753bb2-8aa7-450b-b51f-8f76dac5e6a9" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.33:6571: connect: connection refused"
Sep 08 10:14:54.395910 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:54.395871    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7" podUID="31753bb2-8aa7-450b-b51f-8f76dac5e6a9" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.33:8816: connect: connection refused"
Sep 08 10:14:54.396408 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:54.395887    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7" podUID="31753bb2-8aa7-450b-b51f-8f76dac5e6a9" containerName="online" probeResult="failure" output="Get \"https://10.133.0.33:6567/health\": dial tcp 10.133.0.33:6567: connect: connection refused"
Sep 08 10:14:57.396167 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:57.396125    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7" podUID="31753bb2-8aa7-450b-b51f-8f76dac5e6a9" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.33:6571: connect: connection refused"
Sep 08 10:14:57.396849 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:57.396820    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7"
Sep 08 10:14:57.397380 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:57.397354    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7"
Sep 08 10:14:57.397713 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:57.397690    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7"
Sep 08 10:14:57.402637 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:57.402614    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7"
Sep 08 10:14:57.863326 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:57.863295    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7"
Sep 08 10:14:57.866649 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:57.866625    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7"
Sep 08 10:14:59.395612 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:14:59.395575    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7"
Sep 08 10:15:00.396209 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:15:00.396164    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7" podUID="31753bb2-8aa7-450b-b51f-8f76dac5e6a9" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.33:6571: connect: connection refused"
Sep 08 10:15:03.397075 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:15:03.397044    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7"
Sep 08 10:15:03.397671 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:15:03.397649    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7"
Sep 08 10:15:03.785722 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:15:03.785690    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:15:10.018779 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:15:10.018745    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:15:10.119816 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:15:10.119774    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:15:35.845369 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:15:35.845332    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:16:00.801639 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:00.801525    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:16:05.776595 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:05.776550    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7"]
Sep 08 10:16:05.777066 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:05.776866    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7" podUID="31753bb2-8aa7-450b-b51f-8f76dac5e6a9" containerName="registry" containerID="cri-o://9b8197fb9c100b89b3d11a54cf347b434b6d1e093da6705ad7334007a1626a12" gracePeriod=30
Sep 08 10:16:05.777066 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:05.776944    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7" podUID="31753bb2-8aa7-450b-b51f-8f76dac5e6a9" containerName="offline" containerID="cri-o://ec82d9094f2d55b9ce2e1c05096352a367ec3e37cd3947303ad252b5e03272c5" gracePeriod=30
Sep 08 10:16:05.777190 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:05.776969    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7" podUID="31753bb2-8aa7-450b-b51f-8f76dac5e6a9" containerName="online" containerID="cri-o://b7f616326600ad7fef04e11bd463b1cdc7c66e95092bc0876323ab53a0e4ad91" gracePeriod=30
Sep 08 10:16:05.796683 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:05.796658    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-446m4"]
Sep 08 10:16:05.796818 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:05.796802    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/postgres-864846d4f5-446m4" podUID="141d630f-4a2c-45ad-9a27-96121fe5eeb0" containerName="postgres" containerID="cri-o://41afe76af5652b70932a0b35fb074eedb9bd5bbf00cca4438c32d1130baa762f" gracePeriod=30
Sep 08 10:16:05.806829 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:05.806790    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-vmfmm"]
Sep 08 10:16:05.807008 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:05.806977    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/redis-69bbd798b6-vmfmm" podUID="4e37a702-ddbc-4c91-8b17-62c90f2bd6ad" containerName="redis" containerID="cri-o://8964c21d8bda26c8439996059f712746e4f35d4522fbcb4558f8803afc4ffaf8" gracePeriod=30
Sep 08 10:16:05.868903 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:05.868870    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:16:06.073252 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:06.073226    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-446m4"
Sep 08 10:16:06.076217 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:06.076200    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-vmfmm"
Sep 08 10:16:06.166634 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:06.166601    2579 generic.go:356] "Generic (PLEG): container finished" podID="4e37a702-ddbc-4c91-8b17-62c90f2bd6ad" containerID="8964c21d8bda26c8439996059f712746e4f35d4522fbcb4558f8803afc4ffaf8" exitCode=0
Sep 08 10:16:06.166882 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:06.166681    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-vmfmm" event={"ID":"4e37a702-ddbc-4c91-8b17-62c90f2bd6ad","Type":"ContainerDied","Data":"8964c21d8bda26c8439996059f712746e4f35d4522fbcb4558f8803afc4ffaf8"}
Sep 08 10:16:06.166882 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:06.166718    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-vmfmm"
Sep 08 10:16:06.166882 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:06.166733    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-vmfmm" event={"ID":"4e37a702-ddbc-4c91-8b17-62c90f2bd6ad","Type":"ContainerDied","Data":"91d7af9993edc7d8e92c8c0f885f1236053d77e23bbe7c748a1bd3894b355c16"}
Sep 08 10:16:06.166882 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:06.166755    2579 scope.go:117] "RemoveContainer" containerID="8964c21d8bda26c8439996059f712746e4f35d4522fbcb4558f8803afc4ffaf8"
Sep 08 10:16:06.168042 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:06.167949    2579 generic.go:356] "Generic (PLEG): container finished" podID="141d630f-4a2c-45ad-9a27-96121fe5eeb0" containerID="41afe76af5652b70932a0b35fb074eedb9bd5bbf00cca4438c32d1130baa762f" exitCode=0
Sep 08 10:16:06.168042 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:06.167995    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-446m4" event={"ID":"141d630f-4a2c-45ad-9a27-96121fe5eeb0","Type":"ContainerDied","Data":"41afe76af5652b70932a0b35fb074eedb9bd5bbf00cca4438c32d1130baa762f"}
Sep 08 10:16:06.168042 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:06.168031    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-446m4" event={"ID":"141d630f-4a2c-45ad-9a27-96121fe5eeb0","Type":"ContainerDied","Data":"e5c6989ef5a6b9b10936c723628bf348399f35c2533a787a7764757fe9086f7f"}
Sep 08 10:16:06.168211 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:06.167993    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-446m4"
Sep 08 10:16:06.175353 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:06.175336    2579 scope.go:117] "RemoveContainer" containerID="8964c21d8bda26c8439996059f712746e4f35d4522fbcb4558f8803afc4ffaf8"
Sep 08 10:16:06.175652 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:16:06.175632    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8964c21d8bda26c8439996059f712746e4f35d4522fbcb4558f8803afc4ffaf8\": container with ID starting with 8964c21d8bda26c8439996059f712746e4f35d4522fbcb4558f8803afc4ffaf8 not found: ID does not exist" containerID="8964c21d8bda26c8439996059f712746e4f35d4522fbcb4558f8803afc4ffaf8"
Sep 08 10:16:06.175797 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:06.175660    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8964c21d8bda26c8439996059f712746e4f35d4522fbcb4558f8803afc4ffaf8"} err="failed to get container status \"8964c21d8bda26c8439996059f712746e4f35d4522fbcb4558f8803afc4ffaf8\": rpc error: code = NotFound desc = could not find container \"8964c21d8bda26c8439996059f712746e4f35d4522fbcb4558f8803afc4ffaf8\": container with ID starting with 8964c21d8bda26c8439996059f712746e4f35d4522fbcb4558f8803afc4ffaf8 not found: ID does not exist"
Sep 08 10:16:06.175797 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:06.175676    2579 scope.go:117] "RemoveContainer" containerID="41afe76af5652b70932a0b35fb074eedb9bd5bbf00cca4438c32d1130baa762f"
Sep 08 10:16:06.183210 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:06.183189    2579 scope.go:117] "RemoveContainer" containerID="41afe76af5652b70932a0b35fb074eedb9bd5bbf00cca4438c32d1130baa762f"
Sep 08 10:16:06.183513 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:16:06.183493    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41afe76af5652b70932a0b35fb074eedb9bd5bbf00cca4438c32d1130baa762f\": container with ID starting with 41afe76af5652b70932a0b35fb074eedb9bd5bbf00cca4438c32d1130baa762f not found: ID does not exist" containerID="41afe76af5652b70932a0b35fb074eedb9bd5bbf00cca4438c32d1130baa762f"
Sep 08 10:16:06.183625 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:06.183519    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41afe76af5652b70932a0b35fb074eedb9bd5bbf00cca4438c32d1130baa762f"} err="failed to get container status \"41afe76af5652b70932a0b35fb074eedb9bd5bbf00cca4438c32d1130baa762f\": rpc error: code = NotFound desc = could not find container \"41afe76af5652b70932a0b35fb074eedb9bd5bbf00cca4438c32d1130baa762f\": container with ID starting with 41afe76af5652b70932a0b35fb074eedb9bd5bbf00cca4438c32d1130baa762f not found: ID does not exist"
Sep 08 10:16:06.187855 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:06.187829    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wnd56\" (UniqueName: \"kubernetes.io/projected/141d630f-4a2c-45ad-9a27-96121fe5eeb0-kube-api-access-wnd56\") pod \"141d630f-4a2c-45ad-9a27-96121fe5eeb0\" (UID: \"141d630f-4a2c-45ad-9a27-96121fe5eeb0\") "
Sep 08 10:16:06.187944 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:06.187892    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/141d630f-4a2c-45ad-9a27-96121fe5eeb0-postgresdata\") pod \"141d630f-4a2c-45ad-9a27-96121fe5eeb0\" (UID: \"141d630f-4a2c-45ad-9a27-96121fe5eeb0\") "
Sep 08 10:16:06.188017 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:06.187996    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5wrhw\" (UniqueName: \"kubernetes.io/projected/4e37a702-ddbc-4c91-8b17-62c90f2bd6ad-kube-api-access-5wrhw\") pod \"4e37a702-ddbc-4c91-8b17-62c90f2bd6ad\" (UID: \"4e37a702-ddbc-4c91-8b17-62c90f2bd6ad\") "
Sep 08 10:16:06.190057 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:06.190031    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/141d630f-4a2c-45ad-9a27-96121fe5eeb0-kube-api-access-wnd56" (OuterVolumeSpecName: "kube-api-access-wnd56") pod "141d630f-4a2c-45ad-9a27-96121fe5eeb0" (UID: "141d630f-4a2c-45ad-9a27-96121fe5eeb0"). InnerVolumeSpecName "kube-api-access-wnd56". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:16:06.190159 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:06.190117    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e37a702-ddbc-4c91-8b17-62c90f2bd6ad-kube-api-access-5wrhw" (OuterVolumeSpecName: "kube-api-access-5wrhw") pod "4e37a702-ddbc-4c91-8b17-62c90f2bd6ad" (UID: "4e37a702-ddbc-4c91-8b17-62c90f2bd6ad"). InnerVolumeSpecName "kube-api-access-5wrhw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:16:06.221743 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:06.221713    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/141d630f-4a2c-45ad-9a27-96121fe5eeb0-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "141d630f-4a2c-45ad-9a27-96121fe5eeb0" (UID: "141d630f-4a2c-45ad-9a27-96121fe5eeb0"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:16:06.289086 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:06.289053    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnd56\" (UniqueName: \"kubernetes.io/projected/141d630f-4a2c-45ad-9a27-96121fe5eeb0-kube-api-access-wnd56\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:16:06.289086 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:06.289081    2579 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/141d630f-4a2c-45ad-9a27-96121fe5eeb0-postgresdata\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:16:06.289086 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:06.289090    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5wrhw\" (UniqueName: \"kubernetes.io/projected/4e37a702-ddbc-4c91-8b17-62c90f2bd6ad-kube-api-access-5wrhw\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:16:06.490828 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:06.490798    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-446m4"]
Sep 08 10:16:06.493280 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:06.493258    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/postgres-864846d4f5-446m4"]
Sep 08 10:16:06.505322 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:06.505295    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-vmfmm"]
Sep 08 10:16:06.509203 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:06.509177    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/redis-69bbd798b6-vmfmm"]
Sep 08 10:16:06.834258 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:06.834233    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="141d630f-4a2c-45ad-9a27-96121fe5eeb0" path="/var/lib/kubelet/pods/141d630f-4a2c-45ad-9a27-96121fe5eeb0/volumes"
Sep 08 10:16:06.834577 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:06.834562    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e37a702-ddbc-4c91-8b17-62c90f2bd6ad" path="/var/lib/kubelet/pods/4e37a702-ddbc-4c91-8b17-62c90f2bd6ad/volumes"
Sep 08 10:16:07.174973 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:07.174890    2579 generic.go:356] "Generic (PLEG): container finished" podID="31753bb2-8aa7-450b-b51f-8f76dac5e6a9" containerID="b7f616326600ad7fef04e11bd463b1cdc7c66e95092bc0876323ab53a0e4ad91" exitCode=0
Sep 08 10:16:07.174973 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:07.174925    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7" event={"ID":"31753bb2-8aa7-450b-b51f-8f76dac5e6a9","Type":"ContainerDied","Data":"b7f616326600ad7fef04e11bd463b1cdc7c66e95092bc0876323ab53a0e4ad91"}
Sep 08 10:16:07.864185 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:07.864145    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7" podUID="31753bb2-8aa7-450b-b51f-8f76dac5e6a9" containerName="online" probeResult="failure" output="Get \"https://10.133.0.33:6567/health\": dial tcp 10.133.0.33:6567: connect: connection refused"
Sep 08 10:16:17.863780 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:17.863740    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7" podUID="31753bb2-8aa7-450b-b51f-8f76dac5e6a9" containerName="online" probeResult="failure" output="Get \"https://10.133.0.33:6567/health\": dial tcp 10.133.0.33:6567: connect: connection refused"
Sep 08 10:16:27.864162 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:27.864114    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7" podUID="31753bb2-8aa7-450b-b51f-8f76dac5e6a9" containerName="online" probeResult="failure" output="Get \"https://10.133.0.33:6567/health\": dial tcp 10.133.0.33:6567: connect: connection refused"
Sep 08 10:16:27.864620 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:27.864235    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7"
Sep 08 10:16:36.291616 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:36.291514    2579 generic.go:356] "Generic (PLEG): container finished" podID="31753bb2-8aa7-450b-b51f-8f76dac5e6a9" containerID="ec82d9094f2d55b9ce2e1c05096352a367ec3e37cd3947303ad252b5e03272c5" exitCode=137
Sep 08 10:16:36.291616 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:36.291618    2579 generic.go:356] "Generic (PLEG): container finished" podID="31753bb2-8aa7-450b-b51f-8f76dac5e6a9" containerID="9b8197fb9c100b89b3d11a54cf347b434b6d1e093da6705ad7334007a1626a12" exitCode=137
Sep 08 10:16:36.291991 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:36.291569    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7" event={"ID":"31753bb2-8aa7-450b-b51f-8f76dac5e6a9","Type":"ContainerDied","Data":"ec82d9094f2d55b9ce2e1c05096352a367ec3e37cd3947303ad252b5e03272c5"}
Sep 08 10:16:36.291991 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:36.291711    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7" event={"ID":"31753bb2-8aa7-450b-b51f-8f76dac5e6a9","Type":"ContainerDied","Data":"9b8197fb9c100b89b3d11a54cf347b434b6d1e093da6705ad7334007a1626a12"}
Sep 08 10:16:36.431580 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:36.431556    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7"
Sep 08 10:16:36.535553 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:36.535517    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/31753bb2-8aa7-450b-b51f-8f76dac5e6a9-registry-tls\") pod \"31753bb2-8aa7-450b-b51f-8f76dac5e6a9\" (UID: \"31753bb2-8aa7-450b-b51f-8f76dac5e6a9\") "
Sep 08 10:16:36.535708 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:36.535589    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/31753bb2-8aa7-450b-b51f-8f76dac5e6a9-online-tls\") pod \"31753bb2-8aa7-450b-b51f-8f76dac5e6a9\" (UID: \"31753bb2-8aa7-450b-b51f-8f76dac5e6a9\") "
Sep 08 10:16:36.535708 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:36.535637    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/31753bb2-8aa7-450b-b51f-8f76dac5e6a9-feast-data\") pod \"31753bb2-8aa7-450b-b51f-8f76dac5e6a9\" (UID: \"31753bb2-8aa7-450b-b51f-8f76dac5e6a9\") "
Sep 08 10:16:36.535708 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:36.535679    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6db64\" (UniqueName: \"kubernetes.io/projected/31753bb2-8aa7-450b-b51f-8f76dac5e6a9-kube-api-access-6db64\") pod \"31753bb2-8aa7-450b-b51f-8f76dac5e6a9\" (UID: \"31753bb2-8aa7-450b-b51f-8f76dac5e6a9\") "
Sep 08 10:16:36.535708 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:36.535702    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/31753bb2-8aa7-450b-b51f-8f76dac5e6a9-offline-tls\") pod \"31753bb2-8aa7-450b-b51f-8f76dac5e6a9\" (UID: \"31753bb2-8aa7-450b-b51f-8f76dac5e6a9\") "
Sep 08 10:16:36.537849 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:36.537815    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31753bb2-8aa7-450b-b51f-8f76dac5e6a9-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "31753bb2-8aa7-450b-b51f-8f76dac5e6a9" (UID: "31753bb2-8aa7-450b-b51f-8f76dac5e6a9"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:16:36.537972 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:36.537892    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31753bb2-8aa7-450b-b51f-8f76dac5e6a9-kube-api-access-6db64" (OuterVolumeSpecName: "kube-api-access-6db64") pod "31753bb2-8aa7-450b-b51f-8f76dac5e6a9" (UID: "31753bb2-8aa7-450b-b51f-8f76dac5e6a9"). InnerVolumeSpecName "kube-api-access-6db64". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:16:36.538326 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:36.538299    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31753bb2-8aa7-450b-b51f-8f76dac5e6a9-online-tls" (OuterVolumeSpecName: "online-tls") pod "31753bb2-8aa7-450b-b51f-8f76dac5e6a9" (UID: "31753bb2-8aa7-450b-b51f-8f76dac5e6a9"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:16:36.538418 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:36.538325    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31753bb2-8aa7-450b-b51f-8f76dac5e6a9-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "31753bb2-8aa7-450b-b51f-8f76dac5e6a9" (UID: "31753bb2-8aa7-450b-b51f-8f76dac5e6a9"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:16:36.543805 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:36.543785    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31753bb2-8aa7-450b-b51f-8f76dac5e6a9-feast-data" (OuterVolumeSpecName: "feast-data") pod "31753bb2-8aa7-450b-b51f-8f76dac5e6a9" (UID: "31753bb2-8aa7-450b-b51f-8f76dac5e6a9"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:16:36.636850 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:36.636821    2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/31753bb2-8aa7-450b-b51f-8f76dac5e6a9-registry-tls\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:16:36.636850 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:36.636847    2579 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/31753bb2-8aa7-450b-b51f-8f76dac5e6a9-online-tls\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:16:36.636997 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:36.636855    2579 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/31753bb2-8aa7-450b-b51f-8f76dac5e6a9-feast-data\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:16:36.636997 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:36.636866    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6db64\" (UniqueName: \"kubernetes.io/projected/31753bb2-8aa7-450b-b51f-8f76dac5e6a9-kube-api-access-6db64\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:16:36.636997 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:36.636874    2579 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/31753bb2-8aa7-450b-b51f-8f76dac5e6a9-offline-tls\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:16:37.298883 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:37.298852    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7" event={"ID":"31753bb2-8aa7-450b-b51f-8f76dac5e6a9","Type":"ContainerDied","Data":"b216ad7f6064769b29847f02085fdda05bf69991d6488185d0f89d536efc38a4"}
Sep 08 10:16:37.298883 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:37.298871    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7"
Sep 08 10:16:37.299440 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:37.298930    2579 scope.go:117] "RemoveContainer" containerID="ec82d9094f2d55b9ce2e1c05096352a367ec3e37cd3947303ad252b5e03272c5"
Sep 08 10:16:37.307772 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:37.307750    2579 scope.go:117] "RemoveContainer" containerID="b7f616326600ad7fef04e11bd463b1cdc7c66e95092bc0876323ab53a0e4ad91"
Sep 08 10:16:37.318039 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:37.318012    2579 scope.go:117] "RemoveContainer" containerID="9b8197fb9c100b89b3d11a54cf347b434b6d1e093da6705ad7334007a1626a12"
Sep 08 10:16:37.320063 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:37.319806    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7"]
Sep 08 10:16:37.321304 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:37.321284    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-credit-scoring-5f5cbf49-vlrg7"]
Sep 08 10:16:37.327269 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:37.327250    2579 scope.go:117] "RemoveContainer" containerID="313cada514d19609fa63bc9c5a07d7ce3a3050a231af69c75a7fadf30ebed0c1"
Sep 08 10:16:37.334741 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:37.334721    2579 scope.go:117] "RemoveContainer" containerID="88d4a68f0a6b57cda366dbc38bb41e1a2e14a5e56f17ed19676630c6b22cf946"
Sep 08 10:16:38.832295 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:38.832265    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31753bb2-8aa7-450b-b51f-8f76dac5e6a9" path="/var/lib/kubelet/pods/31753bb2-8aa7-450b-b51f-8f76dac5e6a9/volumes"
Sep 08 10:16:43.552819 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:43.552781    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:16:43.648297 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:43.648253    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:16:43.773599 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:43.773562    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:16:43.989727 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:16:43.989637    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:23:09.721141 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:09.721100    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:23:27.936163 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:27.936127    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:23:28.036176 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:28.036144    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:23:28.104326 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:28.104288    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-whz2n"]
Sep 08 10:23:28.104667 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:28.104652    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31753bb2-8aa7-450b-b51f-8f76dac5e6a9" containerName="feast-init"
Sep 08 10:23:28.104746 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:28.104671    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="31753bb2-8aa7-450b-b51f-8f76dac5e6a9" containerName="feast-init"
Sep 08 10:23:28.104746 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:28.104687    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31753bb2-8aa7-450b-b51f-8f76dac5e6a9" containerName="offline"
Sep 08 10:23:28.104746 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:28.104693    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="31753bb2-8aa7-450b-b51f-8f76dac5e6a9" containerName="offline"
Sep 08 10:23:28.104746 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:28.104706    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31753bb2-8aa7-450b-b51f-8f76dac5e6a9" containerName="online"
Sep 08 10:23:28.104746 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:28.104711    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="31753bb2-8aa7-450b-b51f-8f76dac5e6a9" containerName="online"
Sep 08 10:23:28.104746 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:28.104721    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="141d630f-4a2c-45ad-9a27-96121fe5eeb0" containerName="postgres"
Sep 08 10:23:28.104746 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:28.104726    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="141d630f-4a2c-45ad-9a27-96121fe5eeb0" containerName="postgres"
Sep 08 10:23:28.104746 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:28.104732    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31753bb2-8aa7-450b-b51f-8f76dac5e6a9" containerName="feast-apply"
Sep 08 10:23:28.104746 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:28.104738    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="31753bb2-8aa7-450b-b51f-8f76dac5e6a9" containerName="feast-apply"
Sep 08 10:23:28.104746 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:28.104747    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e37a702-ddbc-4c91-8b17-62c90f2bd6ad" containerName="redis"
Sep 08 10:23:28.105262 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:28.104755    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e37a702-ddbc-4c91-8b17-62c90f2bd6ad" containerName="redis"
Sep 08 10:23:28.105262 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:28.104766    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31753bb2-8aa7-450b-b51f-8f76dac5e6a9" containerName="registry"
Sep 08 10:23:28.105262 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:28.104772    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="31753bb2-8aa7-450b-b51f-8f76dac5e6a9" containerName="registry"
Sep 08 10:23:28.105262 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:28.104822    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="31753bb2-8aa7-450b-b51f-8f76dac5e6a9" containerName="online"
Sep 08 10:23:28.105262 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:28.104836    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="31753bb2-8aa7-450b-b51f-8f76dac5e6a9" containerName="registry"
Sep 08 10:23:28.105262 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:28.104845    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e37a702-ddbc-4c91-8b17-62c90f2bd6ad" containerName="redis"
Sep 08 10:23:28.105262 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:28.104850    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="141d630f-4a2c-45ad-9a27-96121fe5eeb0" containerName="postgres"
Sep 08 10:23:28.105262 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:28.104855    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="31753bb2-8aa7-450b-b51f-8f76dac5e6a9" containerName="offline"
Sep 08 10:23:28.107623 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:28.107606    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-whz2n"
Sep 08 10:23:28.110225 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:28.110201    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\""
Sep 08 10:23:28.110327 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:28.110229    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\""
Sep 08 10:23:28.111515 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:28.111496    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"default-dockercfg-9mdjw\""
Sep 08 10:23:28.123941 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:28.123920    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-whz2n"]
Sep 08 10:23:28.135446 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:28.135418    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:23:28.160151 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:28.160129    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9425b\" (UniqueName: \"kubernetes.io/projected/38a14f61-4656-4e56-8e0e-2fee4a229458-kube-api-access-9425b\") pod \"redis-69bbd798b6-whz2n\" (UID: \"38a14f61-4656-4e56-8e0e-2fee4a229458\") " pod="test-ns-feast-rest/redis-69bbd798b6-whz2n"
Sep 08 10:23:28.261110 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:28.261017    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9425b\" (UniqueName: \"kubernetes.io/projected/38a14f61-4656-4e56-8e0e-2fee4a229458-kube-api-access-9425b\") pod \"redis-69bbd798b6-whz2n\" (UID: \"38a14f61-4656-4e56-8e0e-2fee4a229458\") " pod="test-ns-feast-rest/redis-69bbd798b6-whz2n"
Sep 08 10:23:28.270721 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:28.270701    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9425b\" (UniqueName: \"kubernetes.io/projected/38a14f61-4656-4e56-8e0e-2fee4a229458-kube-api-access-9425b\") pod \"redis-69bbd798b6-whz2n\" (UID: \"38a14f61-4656-4e56-8e0e-2fee4a229458\") " pod="test-ns-feast-rest/redis-69bbd798b6-whz2n"
Sep 08 10:23:28.426040 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:28.426009    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-whz2n"
Sep 08 10:23:28.694302 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:28.694279    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-whz2n"]
Sep 08 10:23:28.697024 ip-10-0-132-96 kubenswrapper[2579]: W0908 10:23:28.696987    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod38a14f61_4656_4e56_8e0e_2fee4a229458.slice/crio-e07c5ebd8cd9cee6810a950fa76f30b8661a0df75af7cf666b46c6e824560754 WatchSource:0}: Error finding container e07c5ebd8cd9cee6810a950fa76f30b8661a0df75af7cf666b46c6e824560754: Status 404 returned error can't find the container with id e07c5ebd8cd9cee6810a950fa76f30b8661a0df75af7cf666b46c6e824560754
Sep 08 10:23:28.941287 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:28.941252    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-whz2n" event={"ID":"38a14f61-4656-4e56-8e0e-2fee4a229458","Type":"ContainerStarted","Data":"8baf202520cb3f7097068b1d87bd0a7a9ea541917f0e8d0599ec67575776a5f5"}
Sep 08 10:23:28.941287 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:28.941291    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-whz2n" event={"ID":"38a14f61-4656-4e56-8e0e-2fee4a229458","Type":"ContainerStarted","Data":"e07c5ebd8cd9cee6810a950fa76f30b8661a0df75af7cf666b46c6e824560754"}
Sep 08 10:23:28.955944 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:28.955839    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/redis-69bbd798b6-whz2n" podStartSLOduration=0.955822083 podStartE2EDuration="955.822083ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:23:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:23:28.955047145 +0000 UTC m=+1522.650646047" watchObservedRunningTime="2026-09-08 10:23:28.955822083 +0000 UTC m=+1522.651420983"
Sep 08 10:23:33.539137 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:33.539102    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-stj42"]
Sep 08 10:23:33.542433 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:33.542408    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-stj42"
Sep 08 10:23:33.545073 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:33.545051    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\""
Sep 08 10:23:33.551296 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:33.551255    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-stj42"]
Sep 08 10:23:33.577259 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:33.577233    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:23:33.604300 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:33.604272    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/3cf07ec2-102c-4f82-beb9-5f27c4818ffd-postgresdata\") pod \"postgres-864846d4f5-stj42\" (UID: \"3cf07ec2-102c-4f82-beb9-5f27c4818ffd\") " pod="test-ns-feast-rest/postgres-864846d4f5-stj42"
Sep 08 10:23:33.604429 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:33.604308    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2slj\" (UniqueName: \"kubernetes.io/projected/3cf07ec2-102c-4f82-beb9-5f27c4818ffd-kube-api-access-z2slj\") pod \"postgres-864846d4f5-stj42\" (UID: \"3cf07ec2-102c-4f82-beb9-5f27c4818ffd\") " pod="test-ns-feast-rest/postgres-864846d4f5-stj42"
Sep 08 10:23:33.705624 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:33.705596    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/3cf07ec2-102c-4f82-beb9-5f27c4818ffd-postgresdata\") pod \"postgres-864846d4f5-stj42\" (UID: \"3cf07ec2-102c-4f82-beb9-5f27c4818ffd\") " pod="test-ns-feast-rest/postgres-864846d4f5-stj42"
Sep 08 10:23:33.705746 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:33.705630    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2slj\" (UniqueName: \"kubernetes.io/projected/3cf07ec2-102c-4f82-beb9-5f27c4818ffd-kube-api-access-z2slj\") pod \"postgres-864846d4f5-stj42\" (UID: \"3cf07ec2-102c-4f82-beb9-5f27c4818ffd\") " pod="test-ns-feast-rest/postgres-864846d4f5-stj42"
Sep 08 10:23:33.705985 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:33.705964    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/3cf07ec2-102c-4f82-beb9-5f27c4818ffd-postgresdata\") pod \"postgres-864846d4f5-stj42\" (UID: \"3cf07ec2-102c-4f82-beb9-5f27c4818ffd\") " pod="test-ns-feast-rest/postgres-864846d4f5-stj42"
Sep 08 10:23:33.714713 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:33.714695    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2slj\" (UniqueName: \"kubernetes.io/projected/3cf07ec2-102c-4f82-beb9-5f27c4818ffd-kube-api-access-z2slj\") pod \"postgres-864846d4f5-stj42\" (UID: \"3cf07ec2-102c-4f82-beb9-5f27c4818ffd\") " pod="test-ns-feast-rest/postgres-864846d4f5-stj42"
Sep 08 10:23:33.860623 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:33.860556    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-stj42"
Sep 08 10:23:34.127122 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:34.127099    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-stj42"]
Sep 08 10:23:34.129300 ip-10-0-132-96 kubenswrapper[2579]: W0908 10:23:34.129272    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3cf07ec2_102c_4f82_beb9_5f27c4818ffd.slice/crio-e454e9651729b3ecb6c19f08be5bb331ec5cbfa59cd08d47d47bf27c66f97232 WatchSource:0}: Error finding container e454e9651729b3ecb6c19f08be5bb331ec5cbfa59cd08d47d47bf27c66f97232: Status 404 returned error can't find the container with id e454e9651729b3ecb6c19f08be5bb331ec5cbfa59cd08d47d47bf27c66f97232
Sep 08 10:23:34.970560 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:34.970507    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-stj42" event={"ID":"3cf07ec2-102c-4f82-beb9-5f27c4818ffd","Type":"ContainerStarted","Data":"88a4c703ce20720fcfec5a75c65ad8889187702e36a59cd75795bb0135666424"}
Sep 08 10:23:34.970918 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:34.970585    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-stj42" event={"ID":"3cf07ec2-102c-4f82-beb9-5f27c4818ffd","Type":"ContainerStarted","Data":"e454e9651729b3ecb6c19f08be5bb331ec5cbfa59cd08d47d47bf27c66f97232"}
Sep 08 10:23:34.986918 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:34.986876    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/postgres-864846d4f5-stj42" podStartSLOduration=1.986861328 podStartE2EDuration="1.986861328s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:23:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:23:34.985317888 +0000 UTC m=+1528.680916789" watchObservedRunningTime="2026-09-08 10:23:34.986861328 +0000 UTC m=+1528.682460228"
Sep 08 10:23:39.031911 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:39.031875    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:23:39.128257 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:39.128221    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:23:39.129012 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:39.128989    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69"]
Sep 08 10:23:39.132454 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:39.132435    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69"
Sep 08 10:23:39.135396 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:39.135369    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-online-tls\""
Sep 08 10:23:39.135396 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:39.135382    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\""
Sep 08 10:23:39.135579 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:39.135371    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-registry-tls\""
Sep 08 10:23:39.135712 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:39.135697    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-dockercfg-r9cr8\""
Sep 08 10:23:39.149376 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:39.149356    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69"]
Sep 08 10:23:39.253783 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:39.253755    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/da807633-0a94-4b27-a43d-598d2bff957d-registry-tls\") pod \"feast-credit-scoring-7f55fcb7fc-hlp69\" (UID: \"da807633-0a94-4b27-a43d-598d2bff957d\") " pod="test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69"
Sep 08 10:23:39.253915 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:39.253798    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/da807633-0a94-4b27-a43d-598d2bff957d-feast-data\") pod \"feast-credit-scoring-7f55fcb7fc-hlp69\" (UID: \"da807633-0a94-4b27-a43d-598d2bff957d\") " pod="test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69"
Sep 08 10:23:39.253915 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:39.253897    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/da807633-0a94-4b27-a43d-598d2bff957d-online-tls\") pod \"feast-credit-scoring-7f55fcb7fc-hlp69\" (UID: \"da807633-0a94-4b27-a43d-598d2bff957d\") " pod="test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69"
Sep 08 10:23:39.253988 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:39.253934    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9b27d\" (UniqueName: \"kubernetes.io/projected/da807633-0a94-4b27-a43d-598d2bff957d-kube-api-access-9b27d\") pod \"feast-credit-scoring-7f55fcb7fc-hlp69\" (UID: \"da807633-0a94-4b27-a43d-598d2bff957d\") " pod="test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69"
Sep 08 10:23:39.333342 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:39.333272    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:23:39.355029 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:39.355001    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9b27d\" (UniqueName: \"kubernetes.io/projected/da807633-0a94-4b27-a43d-598d2bff957d-kube-api-access-9b27d\") pod \"feast-credit-scoring-7f55fcb7fc-hlp69\" (UID: \"da807633-0a94-4b27-a43d-598d2bff957d\") " pod="test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69"
Sep 08 10:23:39.355154 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:39.355062    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/da807633-0a94-4b27-a43d-598d2bff957d-registry-tls\") pod \"feast-credit-scoring-7f55fcb7fc-hlp69\" (UID: \"da807633-0a94-4b27-a43d-598d2bff957d\") " pod="test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69"
Sep 08 10:23:39.355154 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:39.355105    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/da807633-0a94-4b27-a43d-598d2bff957d-feast-data\") pod \"feast-credit-scoring-7f55fcb7fc-hlp69\" (UID: \"da807633-0a94-4b27-a43d-598d2bff957d\") " pod="test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69"
Sep 08 10:23:39.355268 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:39.355179    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/da807633-0a94-4b27-a43d-598d2bff957d-online-tls\") pod \"feast-credit-scoring-7f55fcb7fc-hlp69\" (UID: \"da807633-0a94-4b27-a43d-598d2bff957d\") " pod="test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69"
Sep 08 10:23:39.355321 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:23:39.355291    2579 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-credit-scoring-online-tls: secret "feast-credit-scoring-online-tls" not found
Sep 08 10:23:39.355379 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:23:39.355370    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da807633-0a94-4b27-a43d-598d2bff957d-online-tls podName:da807633-0a94-4b27-a43d-598d2bff957d nodeName:}" failed. No retries permitted until 2026-09-08 10:23:39.85534756 +0000 UTC m=+1533.550946438 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/da807633-0a94-4b27-a43d-598d2bff957d-online-tls") pod "feast-credit-scoring-7f55fcb7fc-hlp69" (UID: "da807633-0a94-4b27-a43d-598d2bff957d") : secret "feast-credit-scoring-online-tls" not found
Sep 08 10:23:39.355580 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:39.355559    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/da807633-0a94-4b27-a43d-598d2bff957d-feast-data\") pod \"feast-credit-scoring-7f55fcb7fc-hlp69\" (UID: \"da807633-0a94-4b27-a43d-598d2bff957d\") " pod="test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69"
Sep 08 10:23:39.357665 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:39.357643    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/da807633-0a94-4b27-a43d-598d2bff957d-registry-tls\") pod \"feast-credit-scoring-7f55fcb7fc-hlp69\" (UID: \"da807633-0a94-4b27-a43d-598d2bff957d\") " pod="test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69"
Sep 08 10:23:39.367388 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:39.367365    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9b27d\" (UniqueName: \"kubernetes.io/projected/da807633-0a94-4b27-a43d-598d2bff957d-kube-api-access-9b27d\") pod \"feast-credit-scoring-7f55fcb7fc-hlp69\" (UID: \"da807633-0a94-4b27-a43d-598d2bff957d\") " pod="test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69"
Sep 08 10:23:39.440805 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:39.440778    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:23:39.859808 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:39.859778    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/da807633-0a94-4b27-a43d-598d2bff957d-online-tls\") pod \"feast-credit-scoring-7f55fcb7fc-hlp69\" (UID: \"da807633-0a94-4b27-a43d-598d2bff957d\") " pod="test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69"
Sep 08 10:23:39.862236 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:39.862208    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/da807633-0a94-4b27-a43d-598d2bff957d-online-tls\") pod \"feast-credit-scoring-7f55fcb7fc-hlp69\" (UID: \"da807633-0a94-4b27-a43d-598d2bff957d\") " pod="test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69"
Sep 08 10:23:40.042260 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:40.042231    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69"
Sep 08 10:23:40.328046 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:40.328010    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69"]
Sep 08 10:23:40.998730 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:40.998699    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69" event={"ID":"da807633-0a94-4b27-a43d-598d2bff957d","Type":"ContainerStarted","Data":"8fc4edda3731669af6ce57e0651381861b38bfce8faa2e06197aa547758b590a"}
Sep 08 10:23:40.998972 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:40.998755    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69" event={"ID":"da807633-0a94-4b27-a43d-598d2bff957d","Type":"ContainerStarted","Data":"541867d667caf965770cc3886ef642b7441d6dcd16683546a3fea25dc7df876d"}
Sep 08 10:23:42.003969 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:42.003931    2579 generic.go:356] "Generic (PLEG): container finished" podID="da807633-0a94-4b27-a43d-598d2bff957d" containerID="8fc4edda3731669af6ce57e0651381861b38bfce8faa2e06197aa547758b590a" exitCode=0
Sep 08 10:23:42.004334 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:42.003988    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69" event={"ID":"da807633-0a94-4b27-a43d-598d2bff957d","Type":"ContainerDied","Data":"8fc4edda3731669af6ce57e0651381861b38bfce8faa2e06197aa547758b590a"}
Sep 08 10:23:43.010198 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:43.010162    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69" event={"ID":"da807633-0a94-4b27-a43d-598d2bff957d","Type":"ContainerStarted","Data":"26c2a2acb43bf462070a3bf0fa0f4de2524944ed5c5a83bcac72747f87dda693"}
Sep 08 10:23:49.038034 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:49.038004    2579 generic.go:356] "Generic (PLEG): container finished" podID="da807633-0a94-4b27-a43d-598d2bff957d" containerID="26c2a2acb43bf462070a3bf0fa0f4de2524944ed5c5a83bcac72747f87dda693" exitCode=0
Sep 08 10:23:49.038316 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:49.038081    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69" event={"ID":"da807633-0a94-4b27-a43d-598d2bff957d","Type":"ContainerDied","Data":"26c2a2acb43bf462070a3bf0fa0f4de2524944ed5c5a83bcac72747f87dda693"}
Sep 08 10:23:50.050518 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:50.050483    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69" event={"ID":"da807633-0a94-4b27-a43d-598d2bff957d","Type":"ContainerStarted","Data":"c36d78c3d56fb0ce5ec3a69e837e6fe7a22726adfda642d1da12ffb4b2acad16"}
Sep 08 10:23:50.050989 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:50.050569    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69" event={"ID":"da807633-0a94-4b27-a43d-598d2bff957d","Type":"ContainerStarted","Data":"205b6b982030bb56ec26f7f5963edbc8e5d14388589f7d4856ce2a3f9f1da7e3"}
Sep 08 10:23:50.076109 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:50.076051    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69" podStartSLOduration=11.076030929 podStartE2EDuration="11.076030929s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:23:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:23:50.073604603 +0000 UTC m=+1543.769203505" watchObservedRunningTime="2026-09-08 10:23:50.076030929 +0000 UTC m=+1543.771629828"
Sep 08 10:23:50.932032 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:50.931997    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:23:52.043219 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:52.043174    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69"
Sep 08 10:23:52.043729 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:52.043252    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69"
Sep 08 10:23:52.044867 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:52.044840    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69" podUID="da807633-0a94-4b27-a43d-598d2bff957d" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.36:6571: connect: connection refused"
Sep 08 10:23:52.044867 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:52.044854    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69" podUID="da807633-0a94-4b27-a43d-598d2bff957d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.36:6567/health\": dial tcp 10.133.0.36:6567: connect: connection refused"
Sep 08 10:23:55.042718 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:55.042660    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69" podUID="da807633-0a94-4b27-a43d-598d2bff957d" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.36:6571: connect: connection refused"
Sep 08 10:23:55.042718 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:55.042701    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69" podUID="da807633-0a94-4b27-a43d-598d2bff957d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.36:6567/health\": dial tcp 10.133.0.36:6567: connect: connection refused"
Sep 08 10:23:58.042729 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:58.042674    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69" podUID="da807633-0a94-4b27-a43d-598d2bff957d" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.36:6571: connect: connection refused"
Sep 08 10:23:58.050859 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:58.050834    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69"
Sep 08 10:23:58.051339 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:58.051309    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69"
Sep 08 10:23:58.054119 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:23:58.054097    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69"
Sep 08 10:24:00.043080 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:00.043041    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69"
Sep 08 10:24:01.043793 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:01.043760    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69"
Sep 08 10:24:01.102697 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:01.102670    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69"
Sep 08 10:24:01.418468 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:01.418381    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:24:04.806047 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:04.806012    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:24:04.907553 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:04.907505    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4"]
Sep 08 10:24:04.912083 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:04.912062    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4"
Sep 08 10:24:04.914834 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:04.914800    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-registry-tls\""
Sep 08 10:24:04.914951 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:04.914849    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-online-tls\""
Sep 08 10:24:04.914951 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:04.914878    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\""
Sep 08 10:24:04.914951 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:04.914878    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-dockercfg-lh768\""
Sep 08 10:24:04.923392 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:04.923369    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4"]
Sep 08 10:24:04.940296 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:04.940268    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:24:04.975629 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:04.975605    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhwrk\" (UniqueName: \"kubernetes.io/projected/fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c-kube-api-access-lhwrk\") pod \"feast-driver-ranking-6564f5b998-z55z4\" (UID: \"fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c\") " pod="test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4"
Sep 08 10:24:04.975756 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:04.975649    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c-online-tls\") pod \"feast-driver-ranking-6564f5b998-z55z4\" (UID: \"fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c\") " pod="test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4"
Sep 08 10:24:04.975756 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:04.975666    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c-feast-data\") pod \"feast-driver-ranking-6564f5b998-z55z4\" (UID: \"fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c\") " pod="test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4"
Sep 08 10:24:04.975873 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:04.975784    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c-registry-tls\") pod \"feast-driver-ranking-6564f5b998-z55z4\" (UID: \"fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c\") " pod="test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4"
Sep 08 10:24:05.042241 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:05.042214    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:24:05.076464 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:05.076407    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhwrk\" (UniqueName: \"kubernetes.io/projected/fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c-kube-api-access-lhwrk\") pod \"feast-driver-ranking-6564f5b998-z55z4\" (UID: \"fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c\") " pod="test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4"
Sep 08 10:24:05.076464 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:05.076443    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c-online-tls\") pod \"feast-driver-ranking-6564f5b998-z55z4\" (UID: \"fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c\") " pod="test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4"
Sep 08 10:24:05.076464 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:05.076461    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c-feast-data\") pod \"feast-driver-ranking-6564f5b998-z55z4\" (UID: \"fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c\") " pod="test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4"
Sep 08 10:24:05.076703 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:05.076487    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c-registry-tls\") pod \"feast-driver-ranking-6564f5b998-z55z4\" (UID: \"fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c\") " pod="test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4"
Sep 08 10:24:05.076703 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:24:05.076608    2579 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-driver-ranking-registry-tls: secret "feast-driver-ranking-registry-tls" not found
Sep 08 10:24:05.076703 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:24:05.076669    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c-registry-tls podName:fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c nodeName:}" failed. No retries permitted until 2026-09-08 10:24:05.576651692 +0000 UTC m=+1559.272250583 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c-registry-tls") pod "feast-driver-ranking-6564f5b998-z55z4" (UID: "fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c") : secret "feast-driver-ranking-registry-tls" not found
Sep 08 10:24:05.076868 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:05.076822    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c-feast-data\") pod \"feast-driver-ranking-6564f5b998-z55z4\" (UID: \"fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c\") " pod="test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4"
Sep 08 10:24:05.078995 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:05.078975    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c-online-tls\") pod \"feast-driver-ranking-6564f5b998-z55z4\" (UID: \"fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c\") " pod="test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4"
Sep 08 10:24:05.085786 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:05.085765    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhwrk\" (UniqueName: \"kubernetes.io/projected/fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c-kube-api-access-lhwrk\") pod \"feast-driver-ranking-6564f5b998-z55z4\" (UID: \"fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c\") " pod="test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4"
Sep 08 10:24:05.503317 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:05.503217    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:24:05.581169 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:05.581126    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c-registry-tls\") pod \"feast-driver-ranking-6564f5b998-z55z4\" (UID: \"fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c\") " pod="test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4"
Sep 08 10:24:05.583655 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:05.583631    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c-registry-tls\") pod \"feast-driver-ranking-6564f5b998-z55z4\" (UID: \"fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c\") " pod="test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4"
Sep 08 10:24:05.820981 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:05.820938    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4"
Sep 08 10:24:06.094262 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:06.094240    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4"]
Sep 08 10:24:06.095657 ip-10-0-132-96 kubenswrapper[2579]: W0908 10:24:06.095624    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa2d9f95_ee17_499b_8daa_d5c9e3c39f5c.slice/crio-bc602181593e6ae947f665e9f42a9d2d012db68e0b01a8426c0ce495f2ce34d4 WatchSource:0}: Error finding container bc602181593e6ae947f665e9f42a9d2d012db68e0b01a8426c0ce495f2ce34d4: Status 404 returned error can't find the container with id bc602181593e6ae947f665e9f42a9d2d012db68e0b01a8426c0ce495f2ce34d4
Sep 08 10:24:06.124958 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:06.124927    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4" event={"ID":"fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c","Type":"ContainerStarted","Data":"bc602181593e6ae947f665e9f42a9d2d012db68e0b01a8426c0ce495f2ce34d4"}
Sep 08 10:24:07.130746 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:07.130701    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4" event={"ID":"fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c","Type":"ContainerStarted","Data":"bafd386d067ba9525ae7b73212ed075749d25cd4b3fc6a4b0570c039aeaba069"}
Sep 08 10:24:11.149614 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:11.149490    2579 generic.go:356] "Generic (PLEG): container finished" podID="fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c" containerID="bafd386d067ba9525ae7b73212ed075749d25cd4b3fc6a4b0570c039aeaba069" exitCode=0
Sep 08 10:24:11.149614 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:11.149563    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4" event={"ID":"fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c","Type":"ContainerDied","Data":"bafd386d067ba9525ae7b73212ed075749d25cd4b3fc6a4b0570c039aeaba069"}
Sep 08 10:24:12.155603 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:12.155571    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4" event={"ID":"fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c","Type":"ContainerStarted","Data":"e9a198ba2f7a556bed76a96fc08a654ff371cc4a710df3ba95df92bc086208db"}
Sep 08 10:24:18.184334 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:18.184246    2579 generic.go:356] "Generic (PLEG): container finished" podID="fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c" containerID="e9a198ba2f7a556bed76a96fc08a654ff371cc4a710df3ba95df92bc086208db" exitCode=0
Sep 08 10:24:18.184334 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:18.184321    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4" event={"ID":"fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c","Type":"ContainerDied","Data":"e9a198ba2f7a556bed76a96fc08a654ff371cc4a710df3ba95df92bc086208db"}
Sep 08 10:24:18.187996 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:18.187976    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\""
Sep 08 10:24:19.193139 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:19.193105    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4" event={"ID":"fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c","Type":"ContainerStarted","Data":"0fe1d459d93910e483fc8b13caa0ae25ffc0b970be0e8cf13b7a84c1dd10081d"}
Sep 08 10:24:19.193519 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:19.193163    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4" event={"ID":"fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c","Type":"ContainerStarted","Data":"eb99246b4b63db87b5c7142995561aafbe77da9b6f936b309812c7119c36f609"}
Sep 08 10:24:19.237810 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:19.237759    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4" podStartSLOduration=15.237743332 podStartE2EDuration="15.237743332s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:24:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:24:19.237528675 +0000 UTC m=+1572.933127556" watchObservedRunningTime="2026-09-08 10:24:19.237743332 +0000 UTC m=+1572.933342231"
Sep 08 10:24:20.821168 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:20.821123    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4"
Sep 08 10:24:20.821554 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:20.821221    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4"
Sep 08 10:24:20.822779 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:20.822749    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4" podUID="fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.37:6571: connect: connection refused"
Sep 08 10:24:20.822779 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:20.822769    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4" podUID="fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c" containerName="online" probeResult="failure" output="Get \"https://10.133.0.37:6567/health\": dial tcp 10.133.0.37:6567: connect: connection refused"
Sep 08 10:24:23.821795 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:23.821747    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4" podUID="fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.37:6571: connect: connection refused"
Sep 08 10:24:23.822266 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:23.821846    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4" podUID="fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c" containerName="online" probeResult="failure" output="Get \"https://10.133.0.37:6567/health\": dial tcp 10.133.0.37:6567: connect: connection refused"
Sep 08 10:24:25.821351 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:25.821316    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4"
Sep 08 10:24:25.821756 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:25.821415    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4"
Sep 08 10:24:26.822003 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:26.821961    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4" podUID="fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.37:6571: connect: connection refused"
Sep 08 10:24:26.836313 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:26.836283    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4"
Sep 08 10:24:27.237922 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:27.237843    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4"
Sep 08 10:24:29.821427 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:29.821387    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4" podUID="fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.37:6571: connect: connection refused"
Sep 08 10:24:32.821814 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:32.821782    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4"
Sep 08 10:24:32.822559 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:24:32.822523    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4"
Sep 08 10:25:50.286355 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:50.286315    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:25:53.031744 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:53.031708    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:25:53.502366 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:53.502278    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-77944b5d44-d55x7"]
Sep 08 10:25:53.502525 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:53.502473    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-77944b5d44-d55x7" podUID="07dd8d17-18da-433c-99b8-b1009040f13d" containerName="manager" containerID="cri-o://f4ec3e0b42ad60ffd0776d8eccc670caddfef6b6fa50333cf9acf73db208ffa5" gracePeriod=10
Sep 08 10:25:53.531799 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:53.531773    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:25:53.628095 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:53.628065    2579 generic.go:356] "Generic (PLEG): container finished" podID="07dd8d17-18da-433c-99b8-b1009040f13d" containerID="f4ec3e0b42ad60ffd0776d8eccc670caddfef6b6fa50333cf9acf73db208ffa5" exitCode=0
Sep 08 10:25:53.628236 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:53.628144    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-77944b5d44-d55x7" event={"ID":"07dd8d17-18da-433c-99b8-b1009040f13d","Type":"ContainerDied","Data":"f4ec3e0b42ad60ffd0776d8eccc670caddfef6b6fa50333cf9acf73db208ffa5"}
Sep 08 10:25:53.742825 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:53.742796    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-77944b5d44-d55x7"
Sep 08 10:25:53.816125 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:53.816093    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hdbr7\" (UniqueName: \"kubernetes.io/projected/07dd8d17-18da-433c-99b8-b1009040f13d-kube-api-access-hdbr7\") pod \"07dd8d17-18da-433c-99b8-b1009040f13d\" (UID: \"07dd8d17-18da-433c-99b8-b1009040f13d\") "
Sep 08 10:25:53.818397 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:53.818369    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07dd8d17-18da-433c-99b8-b1009040f13d-kube-api-access-hdbr7" (OuterVolumeSpecName: "kube-api-access-hdbr7") pod "07dd8d17-18da-433c-99b8-b1009040f13d" (UID: "07dd8d17-18da-433c-99b8-b1009040f13d"). InnerVolumeSpecName "kube-api-access-hdbr7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:25:53.861780 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:53.861746    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:25:53.894099 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:53.894065    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69"]
Sep 08 10:25:53.894334 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:53.894304    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69" podUID="da807633-0a94-4b27-a43d-598d2bff957d" containerName="registry" containerID="cri-o://205b6b982030bb56ec26f7f5963edbc8e5d14388589f7d4856ce2a3f9f1da7e3" gracePeriod=30
Sep 08 10:25:53.894578 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:53.894352    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69" podUID="da807633-0a94-4b27-a43d-598d2bff957d" containerName="online" containerID="cri-o://c36d78c3d56fb0ce5ec3a69e837e6fe7a22726adfda642d1da12ffb4b2acad16" gracePeriod=30
Sep 08 10:25:53.899898 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:53.899873    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4"]
Sep 08 10:25:53.900115 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:53.900090    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4" podUID="fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c" containerName="registry" containerID="cri-o://eb99246b4b63db87b5c7142995561aafbe77da9b6f936b309812c7119c36f609" gracePeriod=30
Sep 08 10:25:53.900233 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:53.900117    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4" podUID="fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c" containerName="online" containerID="cri-o://0fe1d459d93910e483fc8b13caa0ae25ffc0b970be0e8cf13b7a84c1dd10081d" gracePeriod=30
Sep 08 10:25:53.917556 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:53.917515    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hdbr7\" (UniqueName: \"kubernetes.io/projected/07dd8d17-18da-433c-99b8-b1009040f13d-kube-api-access-hdbr7\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:25:53.940937 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:53.940909    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:25:54.634005 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:54.633969    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-77944b5d44-d55x7" event={"ID":"07dd8d17-18da-433c-99b8-b1009040f13d","Type":"ContainerDied","Data":"8f329ee9e193e03ecceec5452dcc7148ac1813d4d497e78fdc71346622881352"}
Sep 08 10:25:54.634474 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:54.634017    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-77944b5d44-d55x7"
Sep 08 10:25:54.634474 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:54.634039    2579 scope.go:117] "RemoveContainer" containerID="f4ec3e0b42ad60ffd0776d8eccc670caddfef6b6fa50333cf9acf73db208ffa5"
Sep 08 10:25:54.662505 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:54.662472    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-77944b5d44-d55x7"]
Sep 08 10:25:54.665968 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:54.665948    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-77944b5d44-d55x7"]
Sep 08 10:25:54.833391 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:54.833362    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07dd8d17-18da-433c-99b8-b1009040f13d" path="/var/lib/kubelet/pods/07dd8d17-18da-433c-99b8-b1009040f13d/volumes"
Sep 08 10:25:55.157992 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:55.157953    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-stj42"]
Sep 08 10:25:55.158160 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:55.158142    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/postgres-864846d4f5-stj42" podUID="3cf07ec2-102c-4f82-beb9-5f27c4818ffd" containerName="postgres" containerID="cri-o://88a4c703ce20720fcfec5a75c65ad8889187702e36a59cd75795bb0135666424" gracePeriod=30
Sep 08 10:25:55.165861 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:55.164964    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-whz2n"]
Sep 08 10:25:55.165861 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:55.165143    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/redis-69bbd798b6-whz2n" podUID="38a14f61-4656-4e56-8e0e-2fee4a229458" containerName="redis" containerID="cri-o://8baf202520cb3f7097068b1d87bd0a7a9ea541917f0e8d0599ec67575776a5f5" gracePeriod=30
Sep 08 10:25:55.214361 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:55.214331    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:25:55.430616 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:55.430593    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-stj42"
Sep 08 10:25:55.433389 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:55.433371    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-whz2n"
Sep 08 10:25:55.531623 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:55.531594    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/3cf07ec2-102c-4f82-beb9-5f27c4818ffd-postgresdata\") pod \"3cf07ec2-102c-4f82-beb9-5f27c4818ffd\" (UID: \"3cf07ec2-102c-4f82-beb9-5f27c4818ffd\") "
Sep 08 10:25:55.531787 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:55.531663    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z2slj\" (UniqueName: \"kubernetes.io/projected/3cf07ec2-102c-4f82-beb9-5f27c4818ffd-kube-api-access-z2slj\") pod \"3cf07ec2-102c-4f82-beb9-5f27c4818ffd\" (UID: \"3cf07ec2-102c-4f82-beb9-5f27c4818ffd\") "
Sep 08 10:25:55.531787 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:55.531702    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9425b\" (UniqueName: \"kubernetes.io/projected/38a14f61-4656-4e56-8e0e-2fee4a229458-kube-api-access-9425b\") pod \"38a14f61-4656-4e56-8e0e-2fee4a229458\" (UID: \"38a14f61-4656-4e56-8e0e-2fee4a229458\") "
Sep 08 10:25:55.533907 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:55.533870    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/38a14f61-4656-4e56-8e0e-2fee4a229458-kube-api-access-9425b" (OuterVolumeSpecName: "kube-api-access-9425b") pod "38a14f61-4656-4e56-8e0e-2fee4a229458" (UID: "38a14f61-4656-4e56-8e0e-2fee4a229458"). InnerVolumeSpecName "kube-api-access-9425b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:25:55.534007 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:55.533908    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3cf07ec2-102c-4f82-beb9-5f27c4818ffd-kube-api-access-z2slj" (OuterVolumeSpecName: "kube-api-access-z2slj") pod "3cf07ec2-102c-4f82-beb9-5f27c4818ffd" (UID: "3cf07ec2-102c-4f82-beb9-5f27c4818ffd"). InnerVolumeSpecName "kube-api-access-z2slj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:25:55.560878 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:55.560853    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3cf07ec2-102c-4f82-beb9-5f27c4818ffd-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "3cf07ec2-102c-4f82-beb9-5f27c4818ffd" (UID: "3cf07ec2-102c-4f82-beb9-5f27c4818ffd"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:25:55.632750 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:55.632719    2579 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/3cf07ec2-102c-4f82-beb9-5f27c4818ffd-postgresdata\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:25:55.632750 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:55.632746    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2slj\" (UniqueName: \"kubernetes.io/projected/3cf07ec2-102c-4f82-beb9-5f27c4818ffd-kube-api-access-z2slj\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:25:55.632750 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:55.632755    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9425b\" (UniqueName: \"kubernetes.io/projected/38a14f61-4656-4e56-8e0e-2fee4a229458-kube-api-access-9425b\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:25:55.640224 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:55.640195    2579 generic.go:356] "Generic (PLEG): container finished" podID="38a14f61-4656-4e56-8e0e-2fee4a229458" containerID="8baf202520cb3f7097068b1d87bd0a7a9ea541917f0e8d0599ec67575776a5f5" exitCode=0
Sep 08 10:25:55.640658 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:55.640239    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-whz2n"
Sep 08 10:25:55.640658 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:55.640279    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-whz2n" event={"ID":"38a14f61-4656-4e56-8e0e-2fee4a229458","Type":"ContainerDied","Data":"8baf202520cb3f7097068b1d87bd0a7a9ea541917f0e8d0599ec67575776a5f5"}
Sep 08 10:25:55.640658 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:55.640331    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-whz2n" event={"ID":"38a14f61-4656-4e56-8e0e-2fee4a229458","Type":"ContainerDied","Data":"e07c5ebd8cd9cee6810a950fa76f30b8661a0df75af7cf666b46c6e824560754"}
Sep 08 10:25:55.640658 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:55.640358    2579 scope.go:117] "RemoveContainer" containerID="8baf202520cb3f7097068b1d87bd0a7a9ea541917f0e8d0599ec67575776a5f5"
Sep 08 10:25:55.643155 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:55.643138    2579 generic.go:356] "Generic (PLEG): container finished" podID="da807633-0a94-4b27-a43d-598d2bff957d" containerID="c36d78c3d56fb0ce5ec3a69e837e6fe7a22726adfda642d1da12ffb4b2acad16" exitCode=0
Sep 08 10:25:55.643277 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:55.643208    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69" event={"ID":"da807633-0a94-4b27-a43d-598d2bff957d","Type":"ContainerDied","Data":"c36d78c3d56fb0ce5ec3a69e837e6fe7a22726adfda642d1da12ffb4b2acad16"}
Sep 08 10:25:55.645824 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:55.645804    2579 generic.go:356] "Generic (PLEG): container finished" podID="fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c" containerID="0fe1d459d93910e483fc8b13caa0ae25ffc0b970be0e8cf13b7a84c1dd10081d" exitCode=0
Sep 08 10:25:55.645906 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:55.645880    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4" event={"ID":"fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c","Type":"ContainerDied","Data":"0fe1d459d93910e483fc8b13caa0ae25ffc0b970be0e8cf13b7a84c1dd10081d"}
Sep 08 10:25:55.653139 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:55.650132    2579 generic.go:356] "Generic (PLEG): container finished" podID="3cf07ec2-102c-4f82-beb9-5f27c4818ffd" containerID="88a4c703ce20720fcfec5a75c65ad8889187702e36a59cd75795bb0135666424" exitCode=0
Sep 08 10:25:55.653139 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:55.650160    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-stj42" event={"ID":"3cf07ec2-102c-4f82-beb9-5f27c4818ffd","Type":"ContainerDied","Data":"88a4c703ce20720fcfec5a75c65ad8889187702e36a59cd75795bb0135666424"}
Sep 08 10:25:55.653139 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:55.650184    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-stj42" event={"ID":"3cf07ec2-102c-4f82-beb9-5f27c4818ffd","Type":"ContainerDied","Data":"e454e9651729b3ecb6c19f08be5bb331ec5cbfa59cd08d47d47bf27c66f97232"}
Sep 08 10:25:55.653139 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:55.650376    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-stj42"
Sep 08 10:25:55.657072 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:55.657054    2579 scope.go:117] "RemoveContainer" containerID="8baf202520cb3f7097068b1d87bd0a7a9ea541917f0e8d0599ec67575776a5f5"
Sep 08 10:25:55.657363 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:25:55.657341    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8baf202520cb3f7097068b1d87bd0a7a9ea541917f0e8d0599ec67575776a5f5\": container with ID starting with 8baf202520cb3f7097068b1d87bd0a7a9ea541917f0e8d0599ec67575776a5f5 not found: ID does not exist" containerID="8baf202520cb3f7097068b1d87bd0a7a9ea541917f0e8d0599ec67575776a5f5"
Sep 08 10:25:55.657453 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:55.657366    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8baf202520cb3f7097068b1d87bd0a7a9ea541917f0e8d0599ec67575776a5f5"} err="failed to get container status \"8baf202520cb3f7097068b1d87bd0a7a9ea541917f0e8d0599ec67575776a5f5\": rpc error: code = NotFound desc = could not find container \"8baf202520cb3f7097068b1d87bd0a7a9ea541917f0e8d0599ec67575776a5f5\": container with ID starting with 8baf202520cb3f7097068b1d87bd0a7a9ea541917f0e8d0599ec67575776a5f5 not found: ID does not exist"
Sep 08 10:25:55.657453 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:55.657382    2579 scope.go:117] "RemoveContainer" containerID="88a4c703ce20720fcfec5a75c65ad8889187702e36a59cd75795bb0135666424"
Sep 08 10:25:55.665364 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:55.665345    2579 scope.go:117] "RemoveContainer" containerID="88a4c703ce20720fcfec5a75c65ad8889187702e36a59cd75795bb0135666424"
Sep 08 10:25:55.665678 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:25:55.665658    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88a4c703ce20720fcfec5a75c65ad8889187702e36a59cd75795bb0135666424\": container with ID starting with 88a4c703ce20720fcfec5a75c65ad8889187702e36a59cd75795bb0135666424 not found: ID does not exist" containerID="88a4c703ce20720fcfec5a75c65ad8889187702e36a59cd75795bb0135666424"
Sep 08 10:25:55.665736 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:55.665685    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88a4c703ce20720fcfec5a75c65ad8889187702e36a59cd75795bb0135666424"} err="failed to get container status \"88a4c703ce20720fcfec5a75c65ad8889187702e36a59cd75795bb0135666424\": rpc error: code = NotFound desc = could not find container \"88a4c703ce20720fcfec5a75c65ad8889187702e36a59cd75795bb0135666424\": container with ID starting with 88a4c703ce20720fcfec5a75c65ad8889187702e36a59cd75795bb0135666424 not found: ID does not exist"
Sep 08 10:25:55.666776 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:55.666735    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-whz2n"]
Sep 08 10:25:55.672493 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:55.672473    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-whz2n"]
Sep 08 10:25:55.687292 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:55.687272    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-stj42"]
Sep 08 10:25:55.691142 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:55.691122    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-stj42"]
Sep 08 10:25:56.584395 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:56.584364    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:25:56.833347 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:56.833314    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="38a14f61-4656-4e56-8e0e-2fee4a229458" path="/var/lib/kubelet/pods/38a14f61-4656-4e56-8e0e-2fee4a229458/volumes"
Sep 08 10:25:56.833708 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:56.833685    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3cf07ec2-102c-4f82-beb9-5f27c4818ffd" path="/var/lib/kubelet/pods/3cf07ec2-102c-4f82-beb9-5f27c4818ffd/volumes"
Sep 08 10:25:57.234725 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:57.234681    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4" podUID="fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c" containerName="online" probeResult="failure" output="Get \"https://10.133.0.37:6567/health\": dial tcp 10.133.0.37:6567: connect: connection refused"
Sep 08 10:25:58.051427 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:58.051389    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69" podUID="da807633-0a94-4b27-a43d-598d2bff957d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.36:6567/health\": dial tcp 10.133.0.36:6567: connect: connection refused"
Sep 08 10:25:58.512759 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:58.512683    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:25:58.566881 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:25:58.566856    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:26:07.234500 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:07.234412    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4" podUID="fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c" containerName="online" probeResult="failure" output="Get \"https://10.133.0.37:6567/health\": dial tcp 10.133.0.37:6567: connect: connection refused"
Sep 08 10:26:08.052047 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:08.052001    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69" podUID="da807633-0a94-4b27-a43d-598d2bff957d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.36:6567/health\": dial tcp 10.133.0.36:6567: connect: connection refused"
Sep 08 10:26:17.234774 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:17.234735    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4" podUID="fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c" containerName="online" probeResult="failure" output="Get \"https://10.133.0.37:6567/health\": dial tcp 10.133.0.37:6567: connect: connection refused"
Sep 08 10:26:17.235217 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:17.234862    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4"
Sep 08 10:26:18.052259 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:18.052218    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69" podUID="da807633-0a94-4b27-a43d-598d2bff957d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.36:6567/health\": dial tcp 10.133.0.36:6567: connect: connection refused"
Sep 08 10:26:18.052445 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:18.052328    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69"
Sep 08 10:26:19.385643 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:19.385615    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:26:19.483792 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:19.483764    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:26:19.896452 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:19.896417    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:26:24.564951 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.564927    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69"
Sep 08 10:26:24.567696 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.567675    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4"
Sep 08 10:26:24.568461 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.568440    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lhwrk\" (UniqueName: \"kubernetes.io/projected/fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c-kube-api-access-lhwrk\") pod \"fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c\" (UID: \"fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c\") "
Sep 08 10:26:24.568578 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.568480    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/da807633-0a94-4b27-a43d-598d2bff957d-registry-tls\") pod \"da807633-0a94-4b27-a43d-598d2bff957d\" (UID: \"da807633-0a94-4b27-a43d-598d2bff957d\") "
Sep 08 10:26:24.568578 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.568500    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c-registry-tls\") pod \"fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c\" (UID: \"fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c\") "
Sep 08 10:26:24.568578 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.568517    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9b27d\" (UniqueName: \"kubernetes.io/projected/da807633-0a94-4b27-a43d-598d2bff957d-kube-api-access-9b27d\") pod \"da807633-0a94-4b27-a43d-598d2bff957d\" (UID: \"da807633-0a94-4b27-a43d-598d2bff957d\") "
Sep 08 10:26:24.568754 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.568650    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c-feast-data\") pod \"fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c\" (UID: \"fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c\") "
Sep 08 10:26:24.568754 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.568693    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/da807633-0a94-4b27-a43d-598d2bff957d-feast-data\") pod \"da807633-0a94-4b27-a43d-598d2bff957d\" (UID: \"da807633-0a94-4b27-a43d-598d2bff957d\") "
Sep 08 10:26:24.568864 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.568760    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/da807633-0a94-4b27-a43d-598d2bff957d-online-tls\") pod \"da807633-0a94-4b27-a43d-598d2bff957d\" (UID: \"da807633-0a94-4b27-a43d-598d2bff957d\") "
Sep 08 10:26:24.568864 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.568804    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c-online-tls\") pod \"fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c\" (UID: \"fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c\") "
Sep 08 10:26:24.569601 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.569130    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c-feast-data" (OuterVolumeSpecName: "feast-data") pod "fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c" (UID: "fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:26:24.570996 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.570922    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c" (UID: "fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:26:24.571357 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.571327    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da807633-0a94-4b27-a43d-598d2bff957d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "da807633-0a94-4b27-a43d-598d2bff957d" (UID: "da807633-0a94-4b27-a43d-598d2bff957d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:26:24.571357 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.571340    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da807633-0a94-4b27-a43d-598d2bff957d-kube-api-access-9b27d" (OuterVolumeSpecName: "kube-api-access-9b27d") pod "da807633-0a94-4b27-a43d-598d2bff957d" (UID: "da807633-0a94-4b27-a43d-598d2bff957d"). InnerVolumeSpecName "kube-api-access-9b27d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:26:24.571522 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.571490    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da807633-0a94-4b27-a43d-598d2bff957d-online-tls" (OuterVolumeSpecName: "online-tls") pod "da807633-0a94-4b27-a43d-598d2bff957d" (UID: "da807633-0a94-4b27-a43d-598d2bff957d"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:26:24.571607 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.571531    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c-kube-api-access-lhwrk" (OuterVolumeSpecName: "kube-api-access-lhwrk") pod "fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c" (UID: "fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c"). InnerVolumeSpecName "kube-api-access-lhwrk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:26:24.571697 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.571682    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c-online-tls" (OuterVolumeSpecName: "online-tls") pod "fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c" (UID: "fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:26:24.578625 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.578517    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da807633-0a94-4b27-a43d-598d2bff957d-feast-data" (OuterVolumeSpecName: "feast-data") pod "da807633-0a94-4b27-a43d-598d2bff957d" (UID: "da807633-0a94-4b27-a43d-598d2bff957d"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:26:24.669683 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.669606    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lhwrk\" (UniqueName: \"kubernetes.io/projected/fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c-kube-api-access-lhwrk\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:26:24.669683 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.669632    2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/da807633-0a94-4b27-a43d-598d2bff957d-registry-tls\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:26:24.669683 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.669641    2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c-registry-tls\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:26:24.669683 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.669649    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9b27d\" (UniqueName: \"kubernetes.io/projected/da807633-0a94-4b27-a43d-598d2bff957d-kube-api-access-9b27d\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:26:24.669683 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.669658    2579 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c-feast-data\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:26:24.669683 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.669665    2579 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/da807633-0a94-4b27-a43d-598d2bff957d-feast-data\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:26:24.669683 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.669673    2579 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/da807633-0a94-4b27-a43d-598d2bff957d-online-tls\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:26:24.669683 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.669680    2579 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c-online-tls\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:26:24.770220 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.770190    2579 generic.go:356] "Generic (PLEG): container finished" podID="da807633-0a94-4b27-a43d-598d2bff957d" containerID="205b6b982030bb56ec26f7f5963edbc8e5d14388589f7d4856ce2a3f9f1da7e3" exitCode=137
Sep 08 10:26:24.770394 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.770249    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69"
Sep 08 10:26:24.770394 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.770276    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69" event={"ID":"da807633-0a94-4b27-a43d-598d2bff957d","Type":"ContainerDied","Data":"205b6b982030bb56ec26f7f5963edbc8e5d14388589f7d4856ce2a3f9f1da7e3"}
Sep 08 10:26:24.770394 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.770324    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69" event={"ID":"da807633-0a94-4b27-a43d-598d2bff957d","Type":"ContainerDied","Data":"541867d667caf965770cc3886ef642b7441d6dcd16683546a3fea25dc7df876d"}
Sep 08 10:26:24.770394 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.770349    2579 scope.go:117] "RemoveContainer" containerID="c36d78c3d56fb0ce5ec3a69e837e6fe7a22726adfda642d1da12ffb4b2acad16"
Sep 08 10:26:24.772949 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.772925    2579 generic.go:356] "Generic (PLEG): container finished" podID="fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c" containerID="eb99246b4b63db87b5c7142995561aafbe77da9b6f936b309812c7119c36f609" exitCode=137
Sep 08 10:26:24.773052 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.772978    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4" event={"ID":"fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c","Type":"ContainerDied","Data":"eb99246b4b63db87b5c7142995561aafbe77da9b6f936b309812c7119c36f609"}
Sep 08 10:26:24.773052 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.772989    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4"
Sep 08 10:26:24.773052 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.773020    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4" event={"ID":"fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c","Type":"ContainerDied","Data":"bc602181593e6ae947f665e9f42a9d2d012db68e0b01a8426c0ce495f2ce34d4"}
Sep 08 10:26:24.780509 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.780487    2579 scope.go:117] "RemoveContainer" containerID="205b6b982030bb56ec26f7f5963edbc8e5d14388589f7d4856ce2a3f9f1da7e3"
Sep 08 10:26:24.788208 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.788192    2579 scope.go:117] "RemoveContainer" containerID="26c2a2acb43bf462070a3bf0fa0f4de2524944ed5c5a83bcac72747f87dda693"
Sep 08 10:26:24.796320 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.796298    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69"]
Sep 08 10:26:24.799405 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.799387    2579 scope.go:117] "RemoveContainer" containerID="8fc4edda3731669af6ce57e0651381861b38bfce8faa2e06197aa547758b590a"
Sep 08 10:26:24.800836 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.800818    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-7f55fcb7fc-hlp69"]
Sep 08 10:26:24.806573 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.806553    2579 scope.go:117] "RemoveContainer" containerID="c36d78c3d56fb0ce5ec3a69e837e6fe7a22726adfda642d1da12ffb4b2acad16"
Sep 08 10:26:24.806829 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:26:24.806806    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c36d78c3d56fb0ce5ec3a69e837e6fe7a22726adfda642d1da12ffb4b2acad16\": container with ID starting with c36d78c3d56fb0ce5ec3a69e837e6fe7a22726adfda642d1da12ffb4b2acad16 not found: ID does not exist" containerID="c36d78c3d56fb0ce5ec3a69e837e6fe7a22726adfda642d1da12ffb4b2acad16"
Sep 08 10:26:24.806888 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.806833    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c36d78c3d56fb0ce5ec3a69e837e6fe7a22726adfda642d1da12ffb4b2acad16"} err="failed to get container status \"c36d78c3d56fb0ce5ec3a69e837e6fe7a22726adfda642d1da12ffb4b2acad16\": rpc error: code = NotFound desc = could not find container \"c36d78c3d56fb0ce5ec3a69e837e6fe7a22726adfda642d1da12ffb4b2acad16\": container with ID starting with c36d78c3d56fb0ce5ec3a69e837e6fe7a22726adfda642d1da12ffb4b2acad16 not found: ID does not exist"
Sep 08 10:26:24.806888 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.806849    2579 scope.go:117] "RemoveContainer" containerID="205b6b982030bb56ec26f7f5963edbc8e5d14388589f7d4856ce2a3f9f1da7e3"
Sep 08 10:26:24.807131 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:26:24.807112    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"205b6b982030bb56ec26f7f5963edbc8e5d14388589f7d4856ce2a3f9f1da7e3\": container with ID starting with 205b6b982030bb56ec26f7f5963edbc8e5d14388589f7d4856ce2a3f9f1da7e3 not found: ID does not exist" containerID="205b6b982030bb56ec26f7f5963edbc8e5d14388589f7d4856ce2a3f9f1da7e3"
Sep 08 10:26:24.807181 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.807136    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"205b6b982030bb56ec26f7f5963edbc8e5d14388589f7d4856ce2a3f9f1da7e3"} err="failed to get container status \"205b6b982030bb56ec26f7f5963edbc8e5d14388589f7d4856ce2a3f9f1da7e3\": rpc error: code = NotFound desc = could not find container \"205b6b982030bb56ec26f7f5963edbc8e5d14388589f7d4856ce2a3f9f1da7e3\": container with ID starting with 205b6b982030bb56ec26f7f5963edbc8e5d14388589f7d4856ce2a3f9f1da7e3 not found: ID does not exist"
Sep 08 10:26:24.807181 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.807158    2579 scope.go:117] "RemoveContainer" containerID="26c2a2acb43bf462070a3bf0fa0f4de2524944ed5c5a83bcac72747f87dda693"
Sep 08 10:26:24.807407 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:26:24.807392    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26c2a2acb43bf462070a3bf0fa0f4de2524944ed5c5a83bcac72747f87dda693\": container with ID starting with 26c2a2acb43bf462070a3bf0fa0f4de2524944ed5c5a83bcac72747f87dda693 not found: ID does not exist" containerID="26c2a2acb43bf462070a3bf0fa0f4de2524944ed5c5a83bcac72747f87dda693"
Sep 08 10:26:24.807447 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.807410    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26c2a2acb43bf462070a3bf0fa0f4de2524944ed5c5a83bcac72747f87dda693"} err="failed to get container status \"26c2a2acb43bf462070a3bf0fa0f4de2524944ed5c5a83bcac72747f87dda693\": rpc error: code = NotFound desc = could not find container \"26c2a2acb43bf462070a3bf0fa0f4de2524944ed5c5a83bcac72747f87dda693\": container with ID starting with 26c2a2acb43bf462070a3bf0fa0f4de2524944ed5c5a83bcac72747f87dda693 not found: ID does not exist"
Sep 08 10:26:24.807447 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.807424    2579 scope.go:117] "RemoveContainer" containerID="8fc4edda3731669af6ce57e0651381861b38bfce8faa2e06197aa547758b590a"
Sep 08 10:26:24.807673 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:26:24.807655    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fc4edda3731669af6ce57e0651381861b38bfce8faa2e06197aa547758b590a\": container with ID starting with 8fc4edda3731669af6ce57e0651381861b38bfce8faa2e06197aa547758b590a not found: ID does not exist" containerID="8fc4edda3731669af6ce57e0651381861b38bfce8faa2e06197aa547758b590a"
Sep 08 10:26:24.807767 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.807677    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fc4edda3731669af6ce57e0651381861b38bfce8faa2e06197aa547758b590a"} err="failed to get container status \"8fc4edda3731669af6ce57e0651381861b38bfce8faa2e06197aa547758b590a\": rpc error: code = NotFound desc = could not find container \"8fc4edda3731669af6ce57e0651381861b38bfce8faa2e06197aa547758b590a\": container with ID starting with 8fc4edda3731669af6ce57e0651381861b38bfce8faa2e06197aa547758b590a not found: ID does not exist"
Sep 08 10:26:24.807767 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.807689    2579 scope.go:117] "RemoveContainer" containerID="0fe1d459d93910e483fc8b13caa0ae25ffc0b970be0e8cf13b7a84c1dd10081d"
Sep 08 10:26:24.813757 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.813736    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4"]
Sep 08 10:26:24.815155 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.815141    2579 scope.go:117] "RemoveContainer" containerID="eb99246b4b63db87b5c7142995561aafbe77da9b6f936b309812c7119c36f609"
Sep 08 10:26:24.822706 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.822690    2579 scope.go:117] "RemoveContainer" containerID="e9a198ba2f7a556bed76a96fc08a654ff371cc4a710df3ba95df92bc086208db"
Sep 08 10:26:24.823707 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.823691    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-6564f5b998-z55z4"]
Sep 08 10:26:24.830054 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.830036    2579 scope.go:117] "RemoveContainer" containerID="bafd386d067ba9525ae7b73212ed075749d25cd4b3fc6a4b0570c039aeaba069"
Sep 08 10:26:24.831848 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.831830    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da807633-0a94-4b27-a43d-598d2bff957d" path="/var/lib/kubelet/pods/da807633-0a94-4b27-a43d-598d2bff957d/volumes"
Sep 08 10:26:24.832303 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.832290    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c" path="/var/lib/kubelet/pods/fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c/volumes"
Sep 08 10:26:24.837206 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.837192    2579 scope.go:117] "RemoveContainer" containerID="0fe1d459d93910e483fc8b13caa0ae25ffc0b970be0e8cf13b7a84c1dd10081d"
Sep 08 10:26:24.837448 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:26:24.837431    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fe1d459d93910e483fc8b13caa0ae25ffc0b970be0e8cf13b7a84c1dd10081d\": container with ID starting with 0fe1d459d93910e483fc8b13caa0ae25ffc0b970be0e8cf13b7a84c1dd10081d not found: ID does not exist" containerID="0fe1d459d93910e483fc8b13caa0ae25ffc0b970be0e8cf13b7a84c1dd10081d"
Sep 08 10:26:24.837495 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.837453    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fe1d459d93910e483fc8b13caa0ae25ffc0b970be0e8cf13b7a84c1dd10081d"} err="failed to get container status \"0fe1d459d93910e483fc8b13caa0ae25ffc0b970be0e8cf13b7a84c1dd10081d\": rpc error: code = NotFound desc = could not find container \"0fe1d459d93910e483fc8b13caa0ae25ffc0b970be0e8cf13b7a84c1dd10081d\": container with ID starting with 0fe1d459d93910e483fc8b13caa0ae25ffc0b970be0e8cf13b7a84c1dd10081d not found: ID does not exist"
Sep 08 10:26:24.837495 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.837468    2579 scope.go:117] "RemoveContainer" containerID="eb99246b4b63db87b5c7142995561aafbe77da9b6f936b309812c7119c36f609"
Sep 08 10:26:24.837714 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:26:24.837700    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb99246b4b63db87b5c7142995561aafbe77da9b6f936b309812c7119c36f609\": container with ID starting with eb99246b4b63db87b5c7142995561aafbe77da9b6f936b309812c7119c36f609 not found: ID does not exist" containerID="eb99246b4b63db87b5c7142995561aafbe77da9b6f936b309812c7119c36f609"
Sep 08 10:26:24.837755 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.837717    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb99246b4b63db87b5c7142995561aafbe77da9b6f936b309812c7119c36f609"} err="failed to get container status \"eb99246b4b63db87b5c7142995561aafbe77da9b6f936b309812c7119c36f609\": rpc error: code = NotFound desc = could not find container \"eb99246b4b63db87b5c7142995561aafbe77da9b6f936b309812c7119c36f609\": container with ID starting with eb99246b4b63db87b5c7142995561aafbe77da9b6f936b309812c7119c36f609 not found: ID does not exist"
Sep 08 10:26:24.837755 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.837730    2579 scope.go:117] "RemoveContainer" containerID="e9a198ba2f7a556bed76a96fc08a654ff371cc4a710df3ba95df92bc086208db"
Sep 08 10:26:24.837943 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:26:24.837925    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9a198ba2f7a556bed76a96fc08a654ff371cc4a710df3ba95df92bc086208db\": container with ID starting with e9a198ba2f7a556bed76a96fc08a654ff371cc4a710df3ba95df92bc086208db not found: ID does not exist" containerID="e9a198ba2f7a556bed76a96fc08a654ff371cc4a710df3ba95df92bc086208db"
Sep 08 10:26:24.837979 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.837948    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9a198ba2f7a556bed76a96fc08a654ff371cc4a710df3ba95df92bc086208db"} err="failed to get container status \"e9a198ba2f7a556bed76a96fc08a654ff371cc4a710df3ba95df92bc086208db\": rpc error: code = NotFound desc = could not find container \"e9a198ba2f7a556bed76a96fc08a654ff371cc4a710df3ba95df92bc086208db\": container with ID starting with e9a198ba2f7a556bed76a96fc08a654ff371cc4a710df3ba95df92bc086208db not found: ID does not exist"
Sep 08 10:26:24.837979 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.837968    2579 scope.go:117] "RemoveContainer" containerID="bafd386d067ba9525ae7b73212ed075749d25cd4b3fc6a4b0570c039aeaba069"
Sep 08 10:26:24.838164 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:26:24.838149    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bafd386d067ba9525ae7b73212ed075749d25cd4b3fc6a4b0570c039aeaba069\": container with ID starting with bafd386d067ba9525ae7b73212ed075749d25cd4b3fc6a4b0570c039aeaba069 not found: ID does not exist" containerID="bafd386d067ba9525ae7b73212ed075749d25cd4b3fc6a4b0570c039aeaba069"
Sep 08 10:26:24.838205 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:24.838167    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bafd386d067ba9525ae7b73212ed075749d25cd4b3fc6a4b0570c039aeaba069"} err="failed to get container status \"bafd386d067ba9525ae7b73212ed075749d25cd4b3fc6a4b0570c039aeaba069\": rpc error: code = NotFound desc = could not find container \"bafd386d067ba9525ae7b73212ed075749d25cd4b3fc6a4b0570c039aeaba069\": container with ID starting with bafd386d067ba9525ae7b73212ed075749d25cd4b3fc6a4b0570c039aeaba069 not found: ID does not exist"
Sep 08 10:26:32.872647 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:32.872574    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:26:32.933505 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:32.933465    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:26:33.189727 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:33.189647    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:26:36.140833 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:36.140795    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:26:36.238871 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:36.238835    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:26:36.784904 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:36.784875    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:26:36.889361 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:36.889333    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:26:36.897422 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:36.897388    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv"]
Sep 08 10:26:36.897763 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:36.897749    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="38a14f61-4656-4e56-8e0e-2fee4a229458" containerName="redis"
Sep 08 10:26:36.897829 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:36.897765    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="38a14f61-4656-4e56-8e0e-2fee4a229458" containerName="redis"
Sep 08 10:26:36.897829 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:36.897773    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3cf07ec2-102c-4f82-beb9-5f27c4818ffd" containerName="postgres"
Sep 08 10:26:36.897829 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:36.897778    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3cf07ec2-102c-4f82-beb9-5f27c4818ffd" containerName="postgres"
Sep 08 10:26:36.897829 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:36.897785    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da807633-0a94-4b27-a43d-598d2bff957d" containerName="online"
Sep 08 10:26:36.897829 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:36.897795    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="da807633-0a94-4b27-a43d-598d2bff957d" containerName="online"
Sep 08 10:26:36.897829 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:36.897802    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c" containerName="feast-apply"
Sep 08 10:26:36.897829 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:36.897807    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c" containerName="feast-apply"
Sep 08 10:26:36.897829 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:36.897814    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da807633-0a94-4b27-a43d-598d2bff957d" containerName="feast-init"
Sep 08 10:26:36.897829 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:36.897819    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="da807633-0a94-4b27-a43d-598d2bff957d" containerName="feast-init"
Sep 08 10:26:36.897829 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:36.897827    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c" containerName="feast-init"
Sep 08 10:26:36.897829 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:36.897831    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c" containerName="feast-init"
Sep 08 10:26:36.898195 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:36.897841    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da807633-0a94-4b27-a43d-598d2bff957d" containerName="feast-apply"
Sep 08 10:26:36.898195 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:36.897846    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="da807633-0a94-4b27-a43d-598d2bff957d" containerName="feast-apply"
Sep 08 10:26:36.898195 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:36.897851    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da807633-0a94-4b27-a43d-598d2bff957d" containerName="registry"
Sep 08 10:26:36.898195 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:36.897855    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="da807633-0a94-4b27-a43d-598d2bff957d" containerName="registry"
Sep 08 10:26:36.898195 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:36.897873    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c" containerName="registry"
Sep 08 10:26:36.898195 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:36.897881    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c" containerName="registry"
Sep 08 10:26:36.898195 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:36.897892    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c" containerName="online"
Sep 08 10:26:36.898195 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:36.897896    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c" containerName="online"
Sep 08 10:26:36.898195 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:36.897904    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07dd8d17-18da-433c-99b8-b1009040f13d" containerName="manager"
Sep 08 10:26:36.898195 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:36.897909    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="07dd8d17-18da-433c-99b8-b1009040f13d" containerName="manager"
Sep 08 10:26:36.898195 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:36.897976    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3cf07ec2-102c-4f82-beb9-5f27c4818ffd" containerName="postgres"
Sep 08 10:26:36.898195 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:36.897984    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c" containerName="online"
Sep 08 10:26:36.898195 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:36.897990    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="da807633-0a94-4b27-a43d-598d2bff957d" containerName="online"
Sep 08 10:26:36.898195 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:36.897996    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="07dd8d17-18da-433c-99b8-b1009040f13d" containerName="manager"
Sep 08 10:26:36.898195 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:36.898003    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="da807633-0a94-4b27-a43d-598d2bff957d" containerName="registry"
Sep 08 10:26:36.898195 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:36.898008    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa2d9f95-ee17-499b-8daa-d5c9e3c39f5c" containerName="registry"
Sep 08 10:26:36.898195 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:36.898013    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="38a14f61-4656-4e56-8e0e-2fee4a229458" containerName="redis"
Sep 08 10:26:36.903576 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:36.903558    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv"
Sep 08 10:26:36.906504 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:36.906484    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Sep 08 10:26:36.906644 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:36.906525    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Sep 08 10:26:36.906644 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:36.906550    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Sep 08 10:26:36.906644 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:36.906566    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Sep 08 10:26:36.906818 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:36.906806    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Sep 08 10:26:36.906879 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:36.906819    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Sep 08 10:26:36.907057 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:36.907044    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-n5rx9\""
Sep 08 10:26:36.915592 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:36.915573    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv"]
Sep 08 10:26:36.966400 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:36.966373    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ca4cad81-97d3-4d87-82a7-d4890458d809-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-f62vv\" (UID: \"ca4cad81-97d3-4d87-82a7-d4890458d809\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv"
Sep 08 10:26:36.966518 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:36.966428    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ca4cad81-97d3-4d87-82a7-d4890458d809-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-f62vv\" (UID: \"ca4cad81-97d3-4d87-82a7-d4890458d809\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv"
Sep 08 10:26:36.966518 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:36.966459    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ca4cad81-97d3-4d87-82a7-d4890458d809-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-f62vv\" (UID: \"ca4cad81-97d3-4d87-82a7-d4890458d809\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv"
Sep 08 10:26:36.966518 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:36.966475    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ca4cad81-97d3-4d87-82a7-d4890458d809-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-f62vv\" (UID: \"ca4cad81-97d3-4d87-82a7-d4890458d809\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv"
Sep 08 10:26:36.966518 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:36.966491    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ca4cad81-97d3-4d87-82a7-d4890458d809-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-f62vv\" (UID: \"ca4cad81-97d3-4d87-82a7-d4890458d809\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv"
Sep 08 10:26:36.966719 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:36.966520    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl624\" (UniqueName: \"kubernetes.io/projected/ca4cad81-97d3-4d87-82a7-d4890458d809-kube-api-access-zl624\") pod \"feast-simple-feast-setup-57576b8fcf-f62vv\" (UID: \"ca4cad81-97d3-4d87-82a7-d4890458d809\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv"
Sep 08 10:26:37.037389 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:37.037311    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:26:37.067052 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:37.067028    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ca4cad81-97d3-4d87-82a7-d4890458d809-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-f62vv\" (UID: \"ca4cad81-97d3-4d87-82a7-d4890458d809\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv"
Sep 08 10:26:37.067172 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:37.067055    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ca4cad81-97d3-4d87-82a7-d4890458d809-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-f62vv\" (UID: \"ca4cad81-97d3-4d87-82a7-d4890458d809\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv"
Sep 08 10:26:37.067172 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:37.067072    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ca4cad81-97d3-4d87-82a7-d4890458d809-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-f62vv\" (UID: \"ca4cad81-97d3-4d87-82a7-d4890458d809\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv"
Sep 08 10:26:37.067172 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:37.067088    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ca4cad81-97d3-4d87-82a7-d4890458d809-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-f62vv\" (UID: \"ca4cad81-97d3-4d87-82a7-d4890458d809\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv"
Sep 08 10:26:37.067172 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:37.067155    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl624\" (UniqueName: \"kubernetes.io/projected/ca4cad81-97d3-4d87-82a7-d4890458d809-kube-api-access-zl624\") pod \"feast-simple-feast-setup-57576b8fcf-f62vv\" (UID: \"ca4cad81-97d3-4d87-82a7-d4890458d809\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv"
Sep 08 10:26:37.067342 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:26:37.067183    2579 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
Sep 08 10:26:37.067342 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:37.067208    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ca4cad81-97d3-4d87-82a7-d4890458d809-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-f62vv\" (UID: \"ca4cad81-97d3-4d87-82a7-d4890458d809\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv"
Sep 08 10:26:37.067342 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:26:37.067254    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca4cad81-97d3-4d87-82a7-d4890458d809-registry-tls podName:ca4cad81-97d3-4d87-82a7-d4890458d809 nodeName:}" failed. No retries permitted until 2026-09-08 10:26:37.567235417 +0000 UTC m=+1711.262834298 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/ca4cad81-97d3-4d87-82a7-d4890458d809-registry-tls") pod "feast-simple-feast-setup-57576b8fcf-f62vv" (UID: "ca4cad81-97d3-4d87-82a7-d4890458d809") : secret "feast-simple-feast-setup-registry-tls" not found
Sep 08 10:26:37.067342 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:26:37.067285    2579 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Sep 08 10:26:37.067342 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:26:37.067327    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca4cad81-97d3-4d87-82a7-d4890458d809-ui-tls podName:ca4cad81-97d3-4d87-82a7-d4890458d809 nodeName:}" failed. No retries permitted until 2026-09-08 10:26:37.567316486 +0000 UTC m=+1711.262915364 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/ca4cad81-97d3-4d87-82a7-d4890458d809-ui-tls") pod "feast-simple-feast-setup-57576b8fcf-f62vv" (UID: "ca4cad81-97d3-4d87-82a7-d4890458d809") : secret "feast-simple-feast-setup-ui-tls" not found
Sep 08 10:26:37.067591 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:37.067436    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ca4cad81-97d3-4d87-82a7-d4890458d809-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-f62vv\" (UID: \"ca4cad81-97d3-4d87-82a7-d4890458d809\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv"
Sep 08 10:26:37.069767 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:37.069746    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ca4cad81-97d3-4d87-82a7-d4890458d809-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-f62vv\" (UID: \"ca4cad81-97d3-4d87-82a7-d4890458d809\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv"
Sep 08 10:26:37.069850 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:37.069814    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ca4cad81-97d3-4d87-82a7-d4890458d809-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-f62vv\" (UID: \"ca4cad81-97d3-4d87-82a7-d4890458d809\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv"
Sep 08 10:26:37.079324 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:37.079301    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl624\" (UniqueName: \"kubernetes.io/projected/ca4cad81-97d3-4d87-82a7-d4890458d809-kube-api-access-zl624\") pod \"feast-simple-feast-setup-57576b8fcf-f62vv\" (UID: \"ca4cad81-97d3-4d87-82a7-d4890458d809\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv"
Sep 08 10:26:37.138666 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:37.138643    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:26:37.239770 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:37.239738    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:26:37.353054 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:37.352971    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:26:37.570851 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:37.570802    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ca4cad81-97d3-4d87-82a7-d4890458d809-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-f62vv\" (UID: \"ca4cad81-97d3-4d87-82a7-d4890458d809\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv"
Sep 08 10:26:37.571047 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:37.570897    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ca4cad81-97d3-4d87-82a7-d4890458d809-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-f62vv\" (UID: \"ca4cad81-97d3-4d87-82a7-d4890458d809\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv"
Sep 08 10:26:37.573453 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:37.573417    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ca4cad81-97d3-4d87-82a7-d4890458d809-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-f62vv\" (UID: \"ca4cad81-97d3-4d87-82a7-d4890458d809\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv"
Sep 08 10:26:37.573596 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:37.573452    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ca4cad81-97d3-4d87-82a7-d4890458d809-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-f62vv\" (UID: \"ca4cad81-97d3-4d87-82a7-d4890458d809\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv"
Sep 08 10:26:37.821555 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:37.821497    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv"
Sep 08 10:26:38.100508 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:38.100485    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv"]
Sep 08 10:26:38.101003 ip-10-0-132-96 kubenswrapper[2579]: W0908 10:26:38.100976    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podca4cad81_97d3_4d87_82a7_d4890458d809.slice/crio-7d8538a03f2a14e014c3c948e2aa2c133a9452552e576c63c78770cead9868c7 WatchSource:0}: Error finding container 7d8538a03f2a14e014c3c948e2aa2c133a9452552e576c63c78770cead9868c7: Status 404 returned error can't find the container with id 7d8538a03f2a14e014c3c948e2aa2c133a9452552e576c63c78770cead9868c7
Sep 08 10:26:38.102946 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:38.102926    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 10:26:38.835370 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:38.835310    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv" event={"ID":"ca4cad81-97d3-4d87-82a7-d4890458d809","Type":"ContainerStarted","Data":"7d8538a03f2a14e014c3c948e2aa2c133a9452552e576c63c78770cead9868c7"}
Sep 08 10:26:51.899934 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:51.899888    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv" event={"ID":"ca4cad81-97d3-4d87-82a7-d4890458d809","Type":"ContainerStarted","Data":"69a403ab1c012850bb33aed0343a13ed56360d5ed562235d77c5a97873de889c"}
Sep 08 10:26:56.921205 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:56.921174    2579 generic.go:356] "Generic (PLEG): container finished" podID="ca4cad81-97d3-4d87-82a7-d4890458d809" containerID="69a403ab1c012850bb33aed0343a13ed56360d5ed562235d77c5a97873de889c" exitCode=0
Sep 08 10:26:56.921662 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:56.921247    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv" event={"ID":"ca4cad81-97d3-4d87-82a7-d4890458d809","Type":"ContainerDied","Data":"69a403ab1c012850bb33aed0343a13ed56360d5ed562235d77c5a97873de889c"}
Sep 08 10:26:57.927836 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:26:57.927806    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv" event={"ID":"ca4cad81-97d3-4d87-82a7-d4890458d809","Type":"ContainerStarted","Data":"9bcb6e4bcae79b3308b32fb2c7b0170aabf1132accd6140fada3ff42343c52cd"}
Sep 08 10:27:02.953426 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:27:02.953330    2579 generic.go:356] "Generic (PLEG): container finished" podID="ca4cad81-97d3-4d87-82a7-d4890458d809" containerID="9bcb6e4bcae79b3308b32fb2c7b0170aabf1132accd6140fada3ff42343c52cd" exitCode=0
Sep 08 10:27:02.953426 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:27:02.953410    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv" event={"ID":"ca4cad81-97d3-4d87-82a7-d4890458d809","Type":"ContainerDied","Data":"9bcb6e4bcae79b3308b32fb2c7b0170aabf1132accd6140fada3ff42343c52cd"}
Sep 08 10:27:03.963689 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:27:03.963646    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv" event={"ID":"ca4cad81-97d3-4d87-82a7-d4890458d809","Type":"ContainerStarted","Data":"1921863d105c2257296be1cff3bbadc0df0983e763edfe979e49bc246e4e67e4"}
Sep 08 10:27:03.964157 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:27:03.963717    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv" event={"ID":"ca4cad81-97d3-4d87-82a7-d4890458d809","Type":"ContainerStarted","Data":"82be2eda4e109a5b6c9ef404fb804874fd9d4df35fc5b5ed6adbe5934c0ee89b"}
Sep 08 10:27:03.964157 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:27:03.963742    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv" event={"ID":"ca4cad81-97d3-4d87-82a7-d4890458d809","Type":"ContainerStarted","Data":"0ab475b0ca67243b002b8dd114e6253c8266d68a3c17e52486297aa9c59b11f5"}
Sep 08 10:27:03.964157 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:27:03.963760    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv" event={"ID":"ca4cad81-97d3-4d87-82a7-d4890458d809","Type":"ContainerStarted","Data":"b5f139c9bd3332c475a0eb3ed51a39e0cb55dae97425fe89c27bb45b2f7f8676"}
Sep 08 10:27:03.990877 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:27:03.990811    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv" podStartSLOduration=14.40972883 podStartE2EDuration="27.99078772s" totalImagesPullingTime="13.58105889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:26:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:27:03.988875387 +0000 UTC m=+1737.684474290" watchObservedRunningTime="2026-09-08 10:27:03.99078772 +0000 UTC m=+1737.686386623"
Sep 08 10:27:04.821767 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:27:04.821724    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv"
Sep 08 10:27:04.821970 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:27:04.821790    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv"
Sep 08 10:27:04.821970 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:27:04.821809    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv"
Sep 08 10:27:04.821970 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:27:04.821826    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv"
Sep 08 10:27:04.824314 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:27:04.824051    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv" podUID="ca4cad81-97d3-4d87-82a7-d4890458d809" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.38:8816: connect: connection refused"
Sep 08 10:27:04.824314 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:27:04.824085    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv" podUID="ca4cad81-97d3-4d87-82a7-d4890458d809" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.38:6571: connect: connection refused"
Sep 08 10:27:04.824314 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:27:04.824114    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv" podUID="ca4cad81-97d3-4d87-82a7-d4890458d809" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.38:8443: connect: connection refused"
Sep 08 10:27:04.824314 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:27:04.824231    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv" podUID="ca4cad81-97d3-4d87-82a7-d4890458d809" containerName="online" probeResult="failure" output="Get \"https://10.133.0.38:6567/health\": dial tcp 10.133.0.38:6567: connect: connection refused"
Sep 08 10:27:07.822161 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:27:07.822026    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv"
Sep 08 10:27:07.822769 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:27:07.822260    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv" podUID="ca4cad81-97d3-4d87-82a7-d4890458d809" containerName="online" probeResult="failure" output="Get \"https://10.133.0.38:6567/health\": dial tcp 10.133.0.38:6567: connect: connection refused"
Sep 08 10:27:07.822769 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:27:07.822338    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv" podUID="ca4cad81-97d3-4d87-82a7-d4890458d809" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.38:8443: connect: connection refused"
Sep 08 10:27:07.822769 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:27:07.822338    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv" podUID="ca4cad81-97d3-4d87-82a7-d4890458d809" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.38:6571: connect: connection refused"
Sep 08 10:27:07.822959 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:27:07.822787    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv"
Sep 08 10:27:07.822959 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:27:07.822826    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv"
Sep 08 10:27:07.822959 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:27:07.822844    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv"
Sep 08 10:27:07.822959 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:27:07.822782    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv" podUID="ca4cad81-97d3-4d87-82a7-d4890458d809" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.38:8816: connect: connection refused"
Sep 08 10:27:10.821879 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:27:10.821825    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv" podUID="ca4cad81-97d3-4d87-82a7-d4890458d809" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.38:8443: connect: connection refused"
Sep 08 10:27:10.822761 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:27:10.822696    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv"
Sep 08 10:27:10.822881 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:27:10.822833    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv"
Sep 08 10:27:10.823519 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:27:10.823500    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv"
Sep 08 10:27:10.823683 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:27:10.823664    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv"
Sep 08 10:27:10.845349 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:27:10.845324    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv"
Sep 08 10:27:11.009294 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:27:11.009264    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv"
Sep 08 10:27:13.822813 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:27:13.822778    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv"
Sep 08 10:27:14.018343 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:27:14.018314    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv"
Sep 08 10:28:15.304010 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:15.303969    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv"]
Sep 08 10:28:15.304479 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:15.304296    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv" podUID="ca4cad81-97d3-4d87-82a7-d4890458d809" containerName="registry" containerID="cri-o://b5f139c9bd3332c475a0eb3ed51a39e0cb55dae97425fe89c27bb45b2f7f8676" gracePeriod=30
Sep 08 10:28:15.304479 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:15.304433    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv" podUID="ca4cad81-97d3-4d87-82a7-d4890458d809" containerName="ui" containerID="cri-o://1921863d105c2257296be1cff3bbadc0df0983e763edfe979e49bc246e4e67e4" gracePeriod=30
Sep 08 10:28:15.304639 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:15.304485    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv" podUID="ca4cad81-97d3-4d87-82a7-d4890458d809" containerName="online" containerID="cri-o://0ab475b0ca67243b002b8dd114e6253c8266d68a3c17e52486297aa9c59b11f5" gracePeriod=30
Sep 08 10:28:15.304639 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:15.304441    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv" podUID="ca4cad81-97d3-4d87-82a7-d4890458d809" containerName="offline" containerID="cri-o://82be2eda4e109a5b6c9ef404fb804874fd9d4df35fc5b5ed6adbe5934c0ee89b" gracePeriod=30
Sep 08 10:28:15.354929 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:15.354902    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:28:15.779997 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:15.779957    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq"]
Sep 08 10:28:15.783753 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:15.783735    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq"
Sep 08 10:28:15.786519 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:15.786489    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-jts6f\""
Sep 08 10:28:15.795658 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:15.795627    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2e2bdb6a-c320-4a6c-a790-d9dcb577d02d-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-sk9mq\" (UID: \"2e2bdb6a-c320-4a6c-a790-d9dcb577d02d\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq"
Sep 08 10:28:15.795790 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:15.795696    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2e2bdb6a-c320-4a6c-a790-d9dcb577d02d-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-sk9mq\" (UID: \"2e2bdb6a-c320-4a6c-a790-d9dcb577d02d\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq"
Sep 08 10:28:15.795790 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:15.795757    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2e2bdb6a-c320-4a6c-a790-d9dcb577d02d-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-sk9mq\" (UID: \"2e2bdb6a-c320-4a6c-a790-d9dcb577d02d\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq"
Sep 08 10:28:15.795915 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:15.795821    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2e2bdb6a-c320-4a6c-a790-d9dcb577d02d-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-sk9mq\" (UID: \"2e2bdb6a-c320-4a6c-a790-d9dcb577d02d\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq"
Sep 08 10:28:15.795915 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:15.795855    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6cgt\" (UniqueName: \"kubernetes.io/projected/2e2bdb6a-c320-4a6c-a790-d9dcb577d02d-kube-api-access-n6cgt\") pod \"feast-simple-feast-setup-57576b8fcf-sk9mq\" (UID: \"2e2bdb6a-c320-4a6c-a790-d9dcb577d02d\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq"
Sep 08 10:28:15.796016 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:15.795949    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2e2bdb6a-c320-4a6c-a790-d9dcb577d02d-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-sk9mq\" (UID: \"2e2bdb6a-c320-4a6c-a790-d9dcb577d02d\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq"
Sep 08 10:28:15.797468 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:15.797445    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq"]
Sep 08 10:28:15.897132 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:15.897093    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2e2bdb6a-c320-4a6c-a790-d9dcb577d02d-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-sk9mq\" (UID: \"2e2bdb6a-c320-4a6c-a790-d9dcb577d02d\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq"
Sep 08 10:28:15.897338 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:15.897136    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2e2bdb6a-c320-4a6c-a790-d9dcb577d02d-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-sk9mq\" (UID: \"2e2bdb6a-c320-4a6c-a790-d9dcb577d02d\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq"
Sep 08 10:28:15.897338 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:15.897183    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2e2bdb6a-c320-4a6c-a790-d9dcb577d02d-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-sk9mq\" (UID: \"2e2bdb6a-c320-4a6c-a790-d9dcb577d02d\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq"
Sep 08 10:28:15.897338 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:15.897210    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2e2bdb6a-c320-4a6c-a790-d9dcb577d02d-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-sk9mq\" (UID: \"2e2bdb6a-c320-4a6c-a790-d9dcb577d02d\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq"
Sep 08 10:28:15.897338 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:15.897231    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6cgt\" (UniqueName: \"kubernetes.io/projected/2e2bdb6a-c320-4a6c-a790-d9dcb577d02d-kube-api-access-n6cgt\") pod \"feast-simple-feast-setup-57576b8fcf-sk9mq\" (UID: \"2e2bdb6a-c320-4a6c-a790-d9dcb577d02d\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq"
Sep 08 10:28:15.897338 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:28:15.897246    2579 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
Sep 08 10:28:15.897338 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:15.897290    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2e2bdb6a-c320-4a6c-a790-d9dcb577d02d-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-sk9mq\" (UID: \"2e2bdb6a-c320-4a6c-a790-d9dcb577d02d\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq"
Sep 08 10:28:15.897338 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:28:15.897316    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e2bdb6a-c320-4a6c-a790-d9dcb577d02d-registry-tls podName:2e2bdb6a-c320-4a6c-a790-d9dcb577d02d nodeName:}" failed. No retries permitted until 2026-09-08 10:28:16.397295019 +0000 UTC m=+1810.092893911 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/2e2bdb6a-c320-4a6c-a790-d9dcb577d02d-registry-tls") pod "feast-simple-feast-setup-57576b8fcf-sk9mq" (UID: "2e2bdb6a-c320-4a6c-a790-d9dcb577d02d") : secret "feast-simple-feast-setup-registry-tls" not found
Sep 08 10:28:15.897759 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:28:15.897350    2579 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
Sep 08 10:28:15.897759 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:28:15.897364    2579 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found
Sep 08 10:28:15.897759 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:28:15.897395    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e2bdb6a-c320-4a6c-a790-d9dcb577d02d-online-tls podName:2e2bdb6a-c320-4a6c-a790-d9dcb577d02d nodeName:}" failed. No retries permitted until 2026-09-08 10:28:16.397383475 +0000 UTC m=+1810.092982359 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/2e2bdb6a-c320-4a6c-a790-d9dcb577d02d-online-tls") pod "feast-simple-feast-setup-57576b8fcf-sk9mq" (UID: "2e2bdb6a-c320-4a6c-a790-d9dcb577d02d") : secret "feast-simple-feast-setup-online-tls" not found
Sep 08 10:28:15.897759 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:28:15.897440    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e2bdb6a-c320-4a6c-a790-d9dcb577d02d-offline-tls podName:2e2bdb6a-c320-4a6c-a790-d9dcb577d02d nodeName:}" failed. No retries permitted until 2026-09-08 10:28:16.397420849 +0000 UTC m=+1810.093019752 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/2e2bdb6a-c320-4a6c-a790-d9dcb577d02d-offline-tls") pod "feast-simple-feast-setup-57576b8fcf-sk9mq" (UID: "2e2bdb6a-c320-4a6c-a790-d9dcb577d02d") : secret "feast-simple-feast-setup-offline-tls" not found
Sep 08 10:28:15.897759 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:15.897676    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2e2bdb6a-c320-4a6c-a790-d9dcb577d02d-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-sk9mq\" (UID: \"2e2bdb6a-c320-4a6c-a790-d9dcb577d02d\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq"
Sep 08 10:28:15.900339 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:15.900304    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2e2bdb6a-c320-4a6c-a790-d9dcb577d02d-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-sk9mq\" (UID: \"2e2bdb6a-c320-4a6c-a790-d9dcb577d02d\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq"
Sep 08 10:28:15.906166 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:15.906139    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6cgt\" (UniqueName: \"kubernetes.io/projected/2e2bdb6a-c320-4a6c-a790-d9dcb577d02d-kube-api-access-n6cgt\") pod \"feast-simple-feast-setup-57576b8fcf-sk9mq\" (UID: \"2e2bdb6a-c320-4a6c-a790-d9dcb577d02d\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq"
Sep 08 10:28:16.272333 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:16.272293    2579 generic.go:356] "Generic (PLEG): container finished" podID="ca4cad81-97d3-4d87-82a7-d4890458d809" containerID="1921863d105c2257296be1cff3bbadc0df0983e763edfe979e49bc246e4e67e4" exitCode=0
Sep 08 10:28:16.272333 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:16.272318    2579 generic.go:356] "Generic (PLEG): container finished" podID="ca4cad81-97d3-4d87-82a7-d4890458d809" containerID="0ab475b0ca67243b002b8dd114e6253c8266d68a3c17e52486297aa9c59b11f5" exitCode=0
Sep 08 10:28:16.272333 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:16.272337    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv" event={"ID":"ca4cad81-97d3-4d87-82a7-d4890458d809","Type":"ContainerDied","Data":"1921863d105c2257296be1cff3bbadc0df0983e763edfe979e49bc246e4e67e4"}
Sep 08 10:28:16.272580 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:16.272367    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv" event={"ID":"ca4cad81-97d3-4d87-82a7-d4890458d809","Type":"ContainerDied","Data":"0ab475b0ca67243b002b8dd114e6253c8266d68a3c17e52486297aa9c59b11f5"}
Sep 08 10:28:16.402415 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:16.402328    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2e2bdb6a-c320-4a6c-a790-d9dcb577d02d-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-sk9mq\" (UID: \"2e2bdb6a-c320-4a6c-a790-d9dcb577d02d\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq"
Sep 08 10:28:16.402415 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:16.402380    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2e2bdb6a-c320-4a6c-a790-d9dcb577d02d-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-sk9mq\" (UID: \"2e2bdb6a-c320-4a6c-a790-d9dcb577d02d\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq"
Sep 08 10:28:16.402908 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:16.402559    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2e2bdb6a-c320-4a6c-a790-d9dcb577d02d-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-sk9mq\" (UID: \"2e2bdb6a-c320-4a6c-a790-d9dcb577d02d\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq"
Sep 08 10:28:16.404882 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:16.404860    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2e2bdb6a-c320-4a6c-a790-d9dcb577d02d-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-sk9mq\" (UID: \"2e2bdb6a-c320-4a6c-a790-d9dcb577d02d\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq"
Sep 08 10:28:16.404986 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:16.404926    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2e2bdb6a-c320-4a6c-a790-d9dcb577d02d-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-sk9mq\" (UID: \"2e2bdb6a-c320-4a6c-a790-d9dcb577d02d\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq"
Sep 08 10:28:16.405028 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:16.404989    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2e2bdb6a-c320-4a6c-a790-d9dcb577d02d-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-sk9mq\" (UID: \"2e2bdb6a-c320-4a6c-a790-d9dcb577d02d\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq"
Sep 08 10:28:16.694036 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:16.693932    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq"
Sep 08 10:28:16.974435 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:16.974406    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq"]
Sep 08 10:28:16.975524 ip-10-0-132-96 kubenswrapper[2579]: W0908 10:28:16.975497    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e2bdb6a_c320_4a6c_a790_d9dcb577d02d.slice/crio-8ee85e9245b7b638410fce3c1339e76061a0680e04deacc3250ea651577f1253 WatchSource:0}: Error finding container 8ee85e9245b7b638410fce3c1339e76061a0680e04deacc3250ea651577f1253: Status 404 returned error can't find the container with id 8ee85e9245b7b638410fce3c1339e76061a0680e04deacc3250ea651577f1253
Sep 08 10:28:17.280809 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:17.280759    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq" event={"ID":"2e2bdb6a-c320-4a6c-a790-d9dcb577d02d","Type":"ContainerStarted","Data":"5237ccab88406e2c5c5bf0c9a79e511aa40541c54c876a15c5139da7829f2f09"}
Sep 08 10:28:17.280989 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:17.280833    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq" event={"ID":"2e2bdb6a-c320-4a6c-a790-d9dcb577d02d","Type":"ContainerStarted","Data":"8ee85e9245b7b638410fce3c1339e76061a0680e04deacc3250ea651577f1253"}
Sep 08 10:28:19.263521 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:19.263479    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:28:21.006250 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:21.006201    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv" podUID="ca4cad81-97d3-4d87-82a7-d4890458d809" containerName="online" probeResult="failure" output="Get \"https://10.133.0.38:6567/health\": dial tcp 10.133.0.38:6567: connect: connection refused"
Sep 08 10:28:22.303236 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:22.303204    2579 generic.go:356] "Generic (PLEG): container finished" podID="2e2bdb6a-c320-4a6c-a790-d9dcb577d02d" containerID="5237ccab88406e2c5c5bf0c9a79e511aa40541c54c876a15c5139da7829f2f09" exitCode=0
Sep 08 10:28:22.303666 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:22.303283    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq" event={"ID":"2e2bdb6a-c320-4a6c-a790-d9dcb577d02d","Type":"ContainerDied","Data":"5237ccab88406e2c5c5bf0c9a79e511aa40541c54c876a15c5139da7829f2f09"}
Sep 08 10:28:23.309366 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:23.309333    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq" event={"ID":"2e2bdb6a-c320-4a6c-a790-d9dcb577d02d","Type":"ContainerStarted","Data":"f18dbad581dc72567d195332d884918eb6b07ea8562ebda043d964a984c81ff0"}
Sep 08 10:28:24.018860 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:24.018823    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv" podUID="ca4cad81-97d3-4d87-82a7-d4890458d809" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.38:8443: connect: connection refused"
Sep 08 10:28:28.333197 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:28.333118    2579 generic.go:356] "Generic (PLEG): container finished" podID="2e2bdb6a-c320-4a6c-a790-d9dcb577d02d" containerID="f18dbad581dc72567d195332d884918eb6b07ea8562ebda043d964a984c81ff0" exitCode=0
Sep 08 10:28:28.333560 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:28.333197    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq" event={"ID":"2e2bdb6a-c320-4a6c-a790-d9dcb577d02d","Type":"ContainerDied","Data":"f18dbad581dc72567d195332d884918eb6b07ea8562ebda043d964a984c81ff0"}
Sep 08 10:28:29.344397 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:29.344355    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq" event={"ID":"2e2bdb6a-c320-4a6c-a790-d9dcb577d02d","Type":"ContainerStarted","Data":"f1946fe78303d383e45927603083d05d3f3e8c0d2daeedd02d0c3e463e0f67d5"}
Sep 08 10:28:29.344898 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:29.344425    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq" event={"ID":"2e2bdb6a-c320-4a6c-a790-d9dcb577d02d","Type":"ContainerStarted","Data":"98666cfbce39cad6cf995c0f18a2606693c3b925dabea1c311293fcbaeb5fd0c"}
Sep 08 10:28:29.344898 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:29.344452    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq" event={"ID":"2e2bdb6a-c320-4a6c-a790-d9dcb577d02d","Type":"ContainerStarted","Data":"9b3a896d8891d3082f5b0e84ff54e7a02960a50eb8689ecf58c57b413f4e2138"}
Sep 08 10:28:29.344898 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:29.344469    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq" event={"ID":"2e2bdb6a-c320-4a6c-a790-d9dcb577d02d","Type":"ContainerStarted","Data":"46642172ebf6a489deb607d2ba5d87e5191f21f2670cb0848668a8d121210084"}
Sep 08 10:28:29.372474 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:29.372409    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq" podStartSLOduration=14.372387374 podStartE2EDuration="14.372387374s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:28:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:28:29.370697559 +0000 UTC m=+1823.066296483" watchObservedRunningTime="2026-09-08 10:28:29.372387374 +0000 UTC m=+1823.067986278"
Sep 08 10:28:31.007233 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:31.007175    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv" podUID="ca4cad81-97d3-4d87-82a7-d4890458d809" containerName="online" probeResult="failure" output="Get \"https://10.133.0.38:6567/health\": dial tcp 10.133.0.38:6567: connect: connection refused"
Sep 08 10:28:31.694851 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:31.694809    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq"
Sep 08 10:28:31.695145 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:31.695120    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq"
Sep 08 10:28:31.695145 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:31.695152    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq"
Sep 08 10:28:31.695338 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:31.695170    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq"
Sep 08 10:28:31.697353 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:31.697190    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq" podUID="2e2bdb6a-c320-4a6c-a790-d9dcb577d02d" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.39:6571: connect: connection refused"
Sep 08 10:28:31.697353 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:31.697223    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq" podUID="2e2bdb6a-c320-4a6c-a790-d9dcb577d02d" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.39:8816: connect: connection refused"
Sep 08 10:28:31.697353 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:31.697274    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq" podUID="2e2bdb6a-c320-4a6c-a790-d9dcb577d02d" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.39:8443: connect: connection refused"
Sep 08 10:28:31.697353 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:31.697231    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq" podUID="2e2bdb6a-c320-4a6c-a790-d9dcb577d02d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.39:6567/health\": dial tcp 10.133.0.39:6567: connect: connection refused"
Sep 08 10:28:34.018585 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:34.018505    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv" podUID="ca4cad81-97d3-4d87-82a7-d4890458d809" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.38:8443: connect: connection refused"
Sep 08 10:28:34.695123 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:34.695078    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq" podUID="2e2bdb6a-c320-4a6c-a790-d9dcb577d02d" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.39:8443: connect: connection refused"
Sep 08 10:28:34.695446 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:34.695076    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq" podUID="2e2bdb6a-c320-4a6c-a790-d9dcb577d02d" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.39:6571: connect: connection refused"
Sep 08 10:28:34.695697 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:34.695083    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq" podUID="2e2bdb6a-c320-4a6c-a790-d9dcb577d02d" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.39:8816: connect: connection refused"
Sep 08 10:28:34.695829 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:34.695110    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq" podUID="2e2bdb6a-c320-4a6c-a790-d9dcb577d02d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.39:6567/health\": dial tcp 10.133.0.39:6567: connect: connection refused"
Sep 08 10:28:36.694099 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:36.694060    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq"
Sep 08 10:28:36.694462 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:36.694133    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq"
Sep 08 10:28:36.694462 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:36.694175    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq"
Sep 08 10:28:36.694462 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:36.694189    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq"
Sep 08 10:28:37.695557 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:37.695505    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq"
Sep 08 10:28:37.695929 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:37.695680    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq"
Sep 08 10:28:37.695929 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:37.695900    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq"
Sep 08 10:28:37.700382 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:37.700359    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq"
Sep 08 10:28:38.399403 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:38.399364    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq"
Sep 08 10:28:38.399623 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:38.399490    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq"
Sep 08 10:28:38.399623 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:38.399576    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq"
Sep 08 10:28:38.402065 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:38.402048    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq"
Sep 08 10:28:41.007021 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:41.006984    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv" podUID="ca4cad81-97d3-4d87-82a7-d4890458d809" containerName="online" probeResult="failure" output="Get \"https://10.133.0.38:6567/health\": dial tcp 10.133.0.38:6567: connect: connection refused"
Sep 08 10:28:41.007525 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:41.007098    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv"
Sep 08 10:28:44.017995 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:44.017956    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv" podUID="ca4cad81-97d3-4d87-82a7-d4890458d809" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.38:8443: connect: connection refused"
Sep 08 10:28:44.018438 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:44.018092    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv"
Sep 08 10:28:45.431265 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:45.431234    2579 generic.go:356] "Generic (PLEG): container finished" podID="ca4cad81-97d3-4d87-82a7-d4890458d809" containerID="82be2eda4e109a5b6c9ef404fb804874fd9d4df35fc5b5ed6adbe5934c0ee89b" exitCode=137
Sep 08 10:28:45.431265 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:45.431256    2579 generic.go:356] "Generic (PLEG): container finished" podID="ca4cad81-97d3-4d87-82a7-d4890458d809" containerID="b5f139c9bd3332c475a0eb3ed51a39e0cb55dae97425fe89c27bb45b2f7f8676" exitCode=137
Sep 08 10:28:45.431670 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:45.431304    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv" event={"ID":"ca4cad81-97d3-4d87-82a7-d4890458d809","Type":"ContainerDied","Data":"82be2eda4e109a5b6c9ef404fb804874fd9d4df35fc5b5ed6adbe5934c0ee89b"}
Sep 08 10:28:45.431670 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:45.431347    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv" event={"ID":"ca4cad81-97d3-4d87-82a7-d4890458d809","Type":"ContainerDied","Data":"b5f139c9bd3332c475a0eb3ed51a39e0cb55dae97425fe89c27bb45b2f7f8676"}
Sep 08 10:28:45.943683 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:45.943662    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv"
Sep 08 10:28:46.062376 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:46.062334    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ca4cad81-97d3-4d87-82a7-d4890458d809-registry-tls\") pod \"ca4cad81-97d3-4d87-82a7-d4890458d809\" (UID: \"ca4cad81-97d3-4d87-82a7-d4890458d809\") "
Sep 08 10:28:46.062376 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:46.062373    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ca4cad81-97d3-4d87-82a7-d4890458d809-online-tls\") pod \"ca4cad81-97d3-4d87-82a7-d4890458d809\" (UID: \"ca4cad81-97d3-4d87-82a7-d4890458d809\") "
Sep 08 10:28:46.062643 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:46.062399    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ca4cad81-97d3-4d87-82a7-d4890458d809-offline-tls\") pod \"ca4cad81-97d3-4d87-82a7-d4890458d809\" (UID: \"ca4cad81-97d3-4d87-82a7-d4890458d809\") "
Sep 08 10:28:46.062643 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:46.062447    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ca4cad81-97d3-4d87-82a7-d4890458d809-feast-data\") pod \"ca4cad81-97d3-4d87-82a7-d4890458d809\" (UID: \"ca4cad81-97d3-4d87-82a7-d4890458d809\") "
Sep 08 10:28:46.062643 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:46.062522    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ca4cad81-97d3-4d87-82a7-d4890458d809-ui-tls\") pod \"ca4cad81-97d3-4d87-82a7-d4890458d809\" (UID: \"ca4cad81-97d3-4d87-82a7-d4890458d809\") "
Sep 08 10:28:46.062643 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:46.062564    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zl624\" (UniqueName: \"kubernetes.io/projected/ca4cad81-97d3-4d87-82a7-d4890458d809-kube-api-access-zl624\") pod \"ca4cad81-97d3-4d87-82a7-d4890458d809\" (UID: \"ca4cad81-97d3-4d87-82a7-d4890458d809\") "
Sep 08 10:28:46.063180 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:46.063120    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca4cad81-97d3-4d87-82a7-d4890458d809-feast-data" (OuterVolumeSpecName: "feast-data") pod "ca4cad81-97d3-4d87-82a7-d4890458d809" (UID: "ca4cad81-97d3-4d87-82a7-d4890458d809"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:28:46.065160 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:46.065129    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca4cad81-97d3-4d87-82a7-d4890458d809-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "ca4cad81-97d3-4d87-82a7-d4890458d809" (UID: "ca4cad81-97d3-4d87-82a7-d4890458d809"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:28:46.065352 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:46.065279    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca4cad81-97d3-4d87-82a7-d4890458d809-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "ca4cad81-97d3-4d87-82a7-d4890458d809" (UID: "ca4cad81-97d3-4d87-82a7-d4890458d809"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:28:46.065352 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:46.065335    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca4cad81-97d3-4d87-82a7-d4890458d809-online-tls" (OuterVolumeSpecName: "online-tls") pod "ca4cad81-97d3-4d87-82a7-d4890458d809" (UID: "ca4cad81-97d3-4d87-82a7-d4890458d809"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:28:46.065592 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:46.065559    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca4cad81-97d3-4d87-82a7-d4890458d809-kube-api-access-zl624" (OuterVolumeSpecName: "kube-api-access-zl624") pod "ca4cad81-97d3-4d87-82a7-d4890458d809" (UID: "ca4cad81-97d3-4d87-82a7-d4890458d809"). InnerVolumeSpecName "kube-api-access-zl624". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:28:46.065710 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:46.065594    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca4cad81-97d3-4d87-82a7-d4890458d809-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "ca4cad81-97d3-4d87-82a7-d4890458d809" (UID: "ca4cad81-97d3-4d87-82a7-d4890458d809"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:28:46.163474 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:46.163354    2579 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/ca4cad81-97d3-4d87-82a7-d4890458d809-feast-data\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:28:46.163474 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:46.163392    2579 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/ca4cad81-97d3-4d87-82a7-d4890458d809-ui-tls\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:28:46.163474 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:46.163410    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zl624\" (UniqueName: \"kubernetes.io/projected/ca4cad81-97d3-4d87-82a7-d4890458d809-kube-api-access-zl624\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:28:46.163474 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:46.163424    2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/ca4cad81-97d3-4d87-82a7-d4890458d809-registry-tls\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:28:46.163474 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:46.163438    2579 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/ca4cad81-97d3-4d87-82a7-d4890458d809-online-tls\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:28:46.163474 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:46.163451    2579 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/ca4cad81-97d3-4d87-82a7-d4890458d809-offline-tls\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:28:46.438274 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:46.438191    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv"
Sep 08 10:28:46.438702 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:46.438193    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv" event={"ID":"ca4cad81-97d3-4d87-82a7-d4890458d809","Type":"ContainerDied","Data":"7d8538a03f2a14e014c3c948e2aa2c133a9452552e576c63c78770cead9868c7"}
Sep 08 10:28:46.438702 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:46.438330    2579 scope.go:117] "RemoveContainer" containerID="1921863d105c2257296be1cff3bbadc0df0983e763edfe979e49bc246e4e67e4"
Sep 08 10:28:46.447485 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:46.447470    2579 scope.go:117] "RemoveContainer" containerID="82be2eda4e109a5b6c9ef404fb804874fd9d4df35fc5b5ed6adbe5934c0ee89b"
Sep 08 10:28:46.455599 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:46.455582    2579 scope.go:117] "RemoveContainer" containerID="0ab475b0ca67243b002b8dd114e6253c8266d68a3c17e52486297aa9c59b11f5"
Sep 08 10:28:46.461035 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:46.461013    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv"]
Sep 08 10:28:46.463749 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:46.463636    2579 scope.go:117] "RemoveContainer" containerID="b5f139c9bd3332c475a0eb3ed51a39e0cb55dae97425fe89c27bb45b2f7f8676"
Sep 08 10:28:46.465057 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:46.465036    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-f62vv"]
Sep 08 10:28:46.470733 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:46.470718    2579 scope.go:117] "RemoveContainer" containerID="9bcb6e4bcae79b3308b32fb2c7b0170aabf1132accd6140fada3ff42343c52cd"
Sep 08 10:28:46.477594 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:46.477580    2579 scope.go:117] "RemoveContainer" containerID="69a403ab1c012850bb33aed0343a13ed56360d5ed562235d77c5a97873de889c"
Sep 08 10:28:46.836807 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:28:46.834056    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca4cad81-97d3-4d87-82a7-d4890458d809" path="/var/lib/kubelet/pods/ca4cad81-97d3-4d87-82a7-d4890458d809/volumes"
Sep 08 10:29:38.173733 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:38.173656    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:29:40.395296 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:40.395258    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:29:40.484674 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:40.484636    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:29:40.780695 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:40.780664    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:29:40.913508 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:40.913473    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s"]
Sep 08 10:29:40.913817 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:40.913803    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca4cad81-97d3-4d87-82a7-d4890458d809" containerName="offline"
Sep 08 10:29:40.913817 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:40.913817    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca4cad81-97d3-4d87-82a7-d4890458d809" containerName="offline"
Sep 08 10:29:40.913914 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:40.913827    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca4cad81-97d3-4d87-82a7-d4890458d809" containerName="feast-init"
Sep 08 10:29:40.913914 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:40.913833    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca4cad81-97d3-4d87-82a7-d4890458d809" containerName="feast-init"
Sep 08 10:29:40.913914 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:40.913850    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca4cad81-97d3-4d87-82a7-d4890458d809" containerName="feast-apply"
Sep 08 10:29:40.913914 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:40.913856    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca4cad81-97d3-4d87-82a7-d4890458d809" containerName="feast-apply"
Sep 08 10:29:40.913914 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:40.913863    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca4cad81-97d3-4d87-82a7-d4890458d809" containerName="online"
Sep 08 10:29:40.913914 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:40.913868    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca4cad81-97d3-4d87-82a7-d4890458d809" containerName="online"
Sep 08 10:29:40.913914 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:40.913879    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca4cad81-97d3-4d87-82a7-d4890458d809" containerName="registry"
Sep 08 10:29:40.913914 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:40.913884    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca4cad81-97d3-4d87-82a7-d4890458d809" containerName="registry"
Sep 08 10:29:40.913914 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:40.913889    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca4cad81-97d3-4d87-82a7-d4890458d809" containerName="ui"
Sep 08 10:29:40.913914 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:40.913895    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca4cad81-97d3-4d87-82a7-d4890458d809" containerName="ui"
Sep 08 10:29:40.914210 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:40.913943    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca4cad81-97d3-4d87-82a7-d4890458d809" containerName="ui"
Sep 08 10:29:40.914210 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:40.913952    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca4cad81-97d3-4d87-82a7-d4890458d809" containerName="online"
Sep 08 10:29:40.914210 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:40.913957    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca4cad81-97d3-4d87-82a7-d4890458d809" containerName="offline"
Sep 08 10:29:40.914210 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:40.913964    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca4cad81-97d3-4d87-82a7-d4890458d809" containerName="registry"
Sep 08 10:29:40.917263 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:40.917244    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s"
Sep 08 10:29:40.920485 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:40.920467    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Sep 08 10:29:40.921347 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:40.921332    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Sep 08 10:29:40.921921 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:40.921903    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Sep 08 10:29:40.922020 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:40.921911    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-mgxdm\""
Sep 08 10:29:40.922141 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:40.922128    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Sep 08 10:29:40.922282 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:40.922268    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Sep 08 10:29:40.922350 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:40.922271    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Sep 08 10:29:40.940365 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:40.940338    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s"]
Sep 08 10:29:41.015057 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:41.015022    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/cef55264-5bd8-4db2-911c-edbeeeb99349-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-82l8s\" (UID: \"cef55264-5bd8-4db2-911c-edbeeeb99349\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s"
Sep 08 10:29:41.015057 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:41.015060    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/cef55264-5bd8-4db2-911c-edbeeeb99349-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-82l8s\" (UID: \"cef55264-5bd8-4db2-911c-edbeeeb99349\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s"
Sep 08 10:29:41.015260 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:41.015150    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/cef55264-5bd8-4db2-911c-edbeeeb99349-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-82l8s\" (UID: \"cef55264-5bd8-4db2-911c-edbeeeb99349\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s"
Sep 08 10:29:41.015260 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:41.015181    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/cef55264-5bd8-4db2-911c-edbeeeb99349-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-82l8s\" (UID: \"cef55264-5bd8-4db2-911c-edbeeeb99349\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s"
Sep 08 10:29:41.015260 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:41.015200    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/cef55264-5bd8-4db2-911c-edbeeeb99349-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-82l8s\" (UID: \"cef55264-5bd8-4db2-911c-edbeeeb99349\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s"
Sep 08 10:29:41.015260 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:41.015234    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clddj\" (UniqueName: \"kubernetes.io/projected/cef55264-5bd8-4db2-911c-edbeeeb99349-kube-api-access-clddj\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-82l8s\" (UID: \"cef55264-5bd8-4db2-911c-edbeeeb99349\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s"
Sep 08 10:29:41.116582 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:41.116487    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/cef55264-5bd8-4db2-911c-edbeeeb99349-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-82l8s\" (UID: \"cef55264-5bd8-4db2-911c-edbeeeb99349\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s"
Sep 08 10:29:41.116582 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:41.116520    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/cef55264-5bd8-4db2-911c-edbeeeb99349-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-82l8s\" (UID: \"cef55264-5bd8-4db2-911c-edbeeeb99349\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s"
Sep 08 10:29:41.116582 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:41.116561    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/cef55264-5bd8-4db2-911c-edbeeeb99349-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-82l8s\" (UID: \"cef55264-5bd8-4db2-911c-edbeeeb99349\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s"
Sep 08 10:29:41.116800 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:41.116585    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clddj\" (UniqueName: \"kubernetes.io/projected/cef55264-5bd8-4db2-911c-edbeeeb99349-kube-api-access-clddj\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-82l8s\" (UID: \"cef55264-5bd8-4db2-911c-edbeeeb99349\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s"
Sep 08 10:29:41.116800 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:41.116612    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/cef55264-5bd8-4db2-911c-edbeeeb99349-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-82l8s\" (UID: \"cef55264-5bd8-4db2-911c-edbeeeb99349\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s"
Sep 08 10:29:41.116800 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:41.116634    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/cef55264-5bd8-4db2-911c-edbeeeb99349-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-82l8s\" (UID: \"cef55264-5bd8-4db2-911c-edbeeeb99349\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s"
Sep 08 10:29:41.117090 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:41.117067    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/cef55264-5bd8-4db2-911c-edbeeeb99349-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-82l8s\" (UID: \"cef55264-5bd8-4db2-911c-edbeeeb99349\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s"
Sep 08 10:29:41.117423 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:41.117338    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/cef55264-5bd8-4db2-911c-edbeeeb99349-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-82l8s\" (UID: \"cef55264-5bd8-4db2-911c-edbeeeb99349\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s"
Sep 08 10:29:41.119321 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:41.119300    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/cef55264-5bd8-4db2-911c-edbeeeb99349-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-82l8s\" (UID: \"cef55264-5bd8-4db2-911c-edbeeeb99349\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s"
Sep 08 10:29:41.119416 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:41.119395    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/cef55264-5bd8-4db2-911c-edbeeeb99349-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-82l8s\" (UID: \"cef55264-5bd8-4db2-911c-edbeeeb99349\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s"
Sep 08 10:29:41.119486 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:41.119462    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/cef55264-5bd8-4db2-911c-edbeeeb99349-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-82l8s\" (UID: \"cef55264-5bd8-4db2-911c-edbeeeb99349\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s"
Sep 08 10:29:41.125766 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:41.125738    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clddj\" (UniqueName: \"kubernetes.io/projected/cef55264-5bd8-4db2-911c-edbeeeb99349-kube-api-access-clddj\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-82l8s\" (UID: \"cef55264-5bd8-4db2-911c-edbeeeb99349\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s"
Sep 08 10:29:41.226123 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:41.226089    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s"
Sep 08 10:29:41.507033 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:41.506998    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s"]
Sep 08 10:29:41.509230 ip-10-0-132-96 kubenswrapper[2579]: W0908 10:29:41.509201    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcef55264_5bd8_4db2_911c_edbeeeb99349.slice/crio-96d9993a7b4878f02085890fc8a99d1cd0bd59c28602e27823c80aa7f38841f1 WatchSource:0}: Error finding container 96d9993a7b4878f02085890fc8a99d1cd0bd59c28602e27823c80aa7f38841f1: Status 404 returned error can't find the container with id 96d9993a7b4878f02085890fc8a99d1cd0bd59c28602e27823c80aa7f38841f1
Sep 08 10:29:41.636205 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:41.636165    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:29:41.658638 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:41.658602    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s" event={"ID":"cef55264-5bd8-4db2-911c-edbeeeb99349","Type":"ContainerStarted","Data":"22649ae02160c329cf0fb0b286e919f29c432bb7761df18d1f87d6e56f59b728"}
Sep 08 10:29:41.658788 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:41.658652    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s" event={"ID":"cef55264-5bd8-4db2-911c-edbeeeb99349","Type":"ContainerStarted","Data":"96d9993a7b4878f02085890fc8a99d1cd0bd59c28602e27823c80aa7f38841f1"}
Sep 08 10:29:41.735697 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:41.735663    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:29:46.680793 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:46.680704    2579 generic.go:356] "Generic (PLEG): container finished" podID="cef55264-5bd8-4db2-911c-edbeeeb99349" containerID="22649ae02160c329cf0fb0b286e919f29c432bb7761df18d1f87d6e56f59b728" exitCode=0
Sep 08 10:29:46.680793 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:46.680759    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s" event={"ID":"cef55264-5bd8-4db2-911c-edbeeeb99349","Type":"ContainerDied","Data":"22649ae02160c329cf0fb0b286e919f29c432bb7761df18d1f87d6e56f59b728"}
Sep 08 10:29:46.834936 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:46.834904    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:29:47.686347 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:29:47.686313    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s" event={"ID":"cef55264-5bd8-4db2-911c-edbeeeb99349","Type":"ContainerStarted","Data":"6e04f3829030c2559f48012f89a14cf2dbdacdd93e31262f91d78532b7ce0d8f"}
Sep 08 10:30:13.805839 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:30:13.805802    2579 generic.go:356] "Generic (PLEG): container finished" podID="cef55264-5bd8-4db2-911c-edbeeeb99349" containerID="6e04f3829030c2559f48012f89a14cf2dbdacdd93e31262f91d78532b7ce0d8f" exitCode=0
Sep 08 10:30:13.806286 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:30:13.805872    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s" event={"ID":"cef55264-5bd8-4db2-911c-edbeeeb99349","Type":"ContainerDied","Data":"6e04f3829030c2559f48012f89a14cf2dbdacdd93e31262f91d78532b7ce0d8f"}
Sep 08 10:30:14.814887 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:30:14.814849    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s" event={"ID":"cef55264-5bd8-4db2-911c-edbeeeb99349","Type":"ContainerStarted","Data":"474fd12e34b69e2cf2a487ff7b60e05ac236346169e7ed3320f99dbe6ce2be92"}
Sep 08 10:30:14.815363 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:30:14.814908    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s" event={"ID":"cef55264-5bd8-4db2-911c-edbeeeb99349","Type":"ContainerStarted","Data":"42550e1293515f8194086595bdc8a6393f950434774ffd97e11ecb0388245d9e"}
Sep 08 10:30:14.815363 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:30:14.814926    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s" event={"ID":"cef55264-5bd8-4db2-911c-edbeeeb99349","Type":"ContainerStarted","Data":"460b625127dfb58058a5a37363649da087556f491420ac58b8833ce82c4beb06"}
Sep 08 10:30:14.857748 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:30:14.857682    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s" podStartSLOduration=34.857659232 podStartE2EDuration="34.857659232s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:29:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:30:14.855626953 +0000 UTC m=+1928.551225853" watchObservedRunningTime="2026-09-08 10:30:14.857659232 +0000 UTC m=+1928.553258157"
Sep 08 10:30:17.226317 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:30:17.226272    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s"
Sep 08 10:30:17.226808 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:30:17.226333    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s"
Sep 08 10:30:17.226808 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:30:17.226350    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s"
Sep 08 10:30:17.228028 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:30:17.227997    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s" podUID="cef55264-5bd8-4db2-911c-edbeeeb99349" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.40:8816: connect: connection refused"
Sep 08 10:30:17.228132 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:30:17.228023    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s" podUID="cef55264-5bd8-4db2-911c-edbeeeb99349" containerName="online" probeResult="failure" output="Get \"https://10.133.0.40:6567/health\": dial tcp 10.133.0.40:6567: connect: connection refused"
Sep 08 10:30:17.228251 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:30:17.228208    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s" podUID="cef55264-5bd8-4db2-911c-edbeeeb99349" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.40:8443: connect: connection refused"
Sep 08 10:30:20.227145 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:30:20.227095    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s" podUID="cef55264-5bd8-4db2-911c-edbeeeb99349" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.40:8816: connect: connection refused"
Sep 08 10:30:20.227676 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:30:20.227095    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s" podUID="cef55264-5bd8-4db2-911c-edbeeeb99349" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.40:8443: connect: connection refused"
Sep 08 10:30:20.227676 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:30:20.227222    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s" podUID="cef55264-5bd8-4db2-911c-edbeeeb99349" containerName="online" probeResult="failure" output="Get \"https://10.133.0.40:6567/health\": dial tcp 10.133.0.40:6567: connect: connection refused"
Sep 08 10:30:21.226509 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:30:21.226465    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s"
Sep 08 10:30:21.226736 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:30:21.226523    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s"
Sep 08 10:30:21.226736 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:30:21.226551    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s"
Sep 08 10:30:23.227349 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:30:23.227313    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s"
Sep 08 10:30:23.227779 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:30:23.227449    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s"
Sep 08 10:30:23.228286 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:30:23.228261    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s"
Sep 08 10:30:23.229668 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:30:23.229651    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s"
Sep 08 10:30:24.230709 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:30:24.230662    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s" podUID="cef55264-5bd8-4db2-911c-edbeeeb99349" containerName="online" probeResult="failure" output="Get \"https://10.133.0.40:6567/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Sep 08 10:30:27.106999 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:30:27.106970    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s"
Sep 08 10:30:28.048559 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:30:28.048504    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s"
Sep 08 10:31:22.701267 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:22.701214    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:31:22.767917 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:22.767875    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:31:29.297349 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:29.297313    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:31:29.304766 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:29.304737    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s"]
Sep 08 10:31:29.304970 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:29.304946    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s" podUID="cef55264-5bd8-4db2-911c-edbeeeb99349" containerName="online" containerID="cri-o://460b625127dfb58058a5a37363649da087556f491420ac58b8833ce82c4beb06" gracePeriod=30
Sep 08 10:31:29.305039 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:29.305001    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s" podUID="cef55264-5bd8-4db2-911c-edbeeeb99349" containerName="ui" containerID="cri-o://474fd12e34b69e2cf2a487ff7b60e05ac236346169e7ed3320f99dbe6ce2be92" gracePeriod=30
Sep 08 10:31:29.305111 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:29.305044    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s" podUID="cef55264-5bd8-4db2-911c-edbeeeb99349" containerName="offline" containerID="cri-o://42550e1293515f8194086595bdc8a6393f950434774ffd97e11ecb0388245d9e" gracePeriod=30
Sep 08 10:31:29.394646 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:29.394609    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:31:29.450597 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:29.450558    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq"]
Sep 08 10:31:29.450848 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:29.450819    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq" podUID="2e2bdb6a-c320-4a6c-a790-d9dcb577d02d" containerName="registry" containerID="cri-o://46642172ebf6a489deb607d2ba5d87e5191f21f2670cb0848668a8d121210084" gracePeriod=30
Sep 08 10:31:29.450954 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:29.450866    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq" podUID="2e2bdb6a-c320-4a6c-a790-d9dcb577d02d" containerName="offline" containerID="cri-o://98666cfbce39cad6cf995c0f18a2606693c3b925dabea1c311293fcbaeb5fd0c" gracePeriod=30
Sep 08 10:31:29.450954 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:29.450884    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq" podUID="2e2bdb6a-c320-4a6c-a790-d9dcb577d02d" containerName="online" containerID="cri-o://9b3a896d8891d3082f5b0e84ff54e7a02960a50eb8689ecf58c57b413f4e2138" gracePeriod=30
Sep 08 10:31:29.451122 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:29.451096    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq" podUID="2e2bdb6a-c320-4a6c-a790-d9dcb577d02d" containerName="ui" containerID="cri-o://f1946fe78303d383e45927603083d05d3f3e8c0d2daeedd02d0c3e463e0f67d5" gracePeriod=30
Sep 08 10:31:29.499996 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:29.499960    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:31:29.574574 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:29.574451    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:31:30.135489 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:30.135458    2579 generic.go:356] "Generic (PLEG): container finished" podID="2e2bdb6a-c320-4a6c-a790-d9dcb577d02d" containerID="f1946fe78303d383e45927603083d05d3f3e8c0d2daeedd02d0c3e463e0f67d5" exitCode=0
Sep 08 10:31:30.135642 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:30.135547    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq" event={"ID":"2e2bdb6a-c320-4a6c-a790-d9dcb577d02d","Type":"ContainerDied","Data":"f1946fe78303d383e45927603083d05d3f3e8c0d2daeedd02d0c3e463e0f67d5"}
Sep 08 10:31:30.138907 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:30.138881    2579 generic.go:356] "Generic (PLEG): container finished" podID="cef55264-5bd8-4db2-911c-edbeeeb99349" containerID="474fd12e34b69e2cf2a487ff7b60e05ac236346169e7ed3320f99dbe6ce2be92" exitCode=0
Sep 08 10:31:30.139021 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:30.138932    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s" event={"ID":"cef55264-5bd8-4db2-911c-edbeeeb99349","Type":"ContainerDied","Data":"474fd12e34b69e2cf2a487ff7b60e05ac236346169e7ed3320f99dbe6ce2be92"}
Sep 08 10:31:31.152778 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:31.152746    2579 generic.go:356] "Generic (PLEG): container finished" podID="2e2bdb6a-c320-4a6c-a790-d9dcb577d02d" containerID="9b3a896d8891d3082f5b0e84ff54e7a02960a50eb8689ecf58c57b413f4e2138" exitCode=0
Sep 08 10:31:31.153166 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:31.152814    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq" event={"ID":"2e2bdb6a-c320-4a6c-a790-d9dcb577d02d","Type":"ContainerDied","Data":"9b3a896d8891d3082f5b0e84ff54e7a02960a50eb8689ecf58c57b413f4e2138"}
Sep 08 10:31:31.155525 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:31.155502    2579 generic.go:356] "Generic (PLEG): container finished" podID="cef55264-5bd8-4db2-911c-edbeeeb99349" containerID="460b625127dfb58058a5a37363649da087556f491420ac58b8833ce82c4beb06" exitCode=0
Sep 08 10:31:31.155658 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:31.155578    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s" event={"ID":"cef55264-5bd8-4db2-911c-edbeeeb99349","Type":"ContainerDied","Data":"460b625127dfb58058a5a37363649da087556f491420ac58b8833ce82c4beb06"}
Sep 08 10:31:33.228600 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:33.228559    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s" podUID="cef55264-5bd8-4db2-911c-edbeeeb99349" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.40:8443: connect: connection refused"
Sep 08 10:31:34.597355 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:34.597314    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:31:37.107779 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:37.107742    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s" podUID="cef55264-5bd8-4db2-911c-edbeeeb99349" containerName="online" probeResult="failure" output="Get \"https://10.133.0.40:6567/health\": dial tcp 10.133.0.40:6567: connect: connection refused"
Sep 08 10:31:38.399835 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:38.399782    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq" podUID="2e2bdb6a-c320-4a6c-a790-d9dcb577d02d" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.39:8443: connect: connection refused"
Sep 08 10:31:38.400270 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:38.399836    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq" podUID="2e2bdb6a-c320-4a6c-a790-d9dcb577d02d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.39:6567/health\": dial tcp 10.133.0.39:6567: connect: connection refused"
Sep 08 10:31:43.228517 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:43.228473    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s" podUID="cef55264-5bd8-4db2-911c-edbeeeb99349" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.40:8443: connect: connection refused"
Sep 08 10:31:47.108198 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:47.108148    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s" podUID="cef55264-5bd8-4db2-911c-edbeeeb99349" containerName="online" probeResult="failure" output="Get \"https://10.133.0.40:6567/health\": dial tcp 10.133.0.40:6567: connect: connection refused"
Sep 08 10:31:48.399129 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:48.399084    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq" podUID="2e2bdb6a-c320-4a6c-a790-d9dcb577d02d" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.39:8443: connect: connection refused"
Sep 08 10:31:48.399604 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:48.399148    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq" podUID="2e2bdb6a-c320-4a6c-a790-d9dcb577d02d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.39:6567/health\": dial tcp 10.133.0.39:6567: connect: connection refused"
Sep 08 10:31:53.228679 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:53.228631    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s" podUID="cef55264-5bd8-4db2-911c-edbeeeb99349" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.40:8443: connect: connection refused"
Sep 08 10:31:53.229072 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:53.228764    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s"
Sep 08 10:31:57.107894 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:57.107858    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s" podUID="cef55264-5bd8-4db2-911c-edbeeeb99349" containerName="online" probeResult="failure" output="Get \"https://10.133.0.40:6567/health\": dial tcp 10.133.0.40:6567: connect: connection refused"
Sep 08 10:31:57.108313 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:57.107966    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s"
Sep 08 10:31:58.399728 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:58.399684    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq" podUID="2e2bdb6a-c320-4a6c-a790-d9dcb577d02d" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.39:8443: connect: connection refused"
Sep 08 10:31:58.400184 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:58.399697    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq" podUID="2e2bdb6a-c320-4a6c-a790-d9dcb577d02d" containerName="online" probeResult="failure" output="Get \"https://10.133.0.39:6567/health\": dial tcp 10.133.0.39:6567: connect: connection refused"
Sep 08 10:31:58.400184 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:58.399817    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq"
Sep 08 10:31:58.400184 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:58.399883    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq"
Sep 08 10:31:59.494307 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:59.494285    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s"
Sep 08 10:31:59.637417 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:59.637334    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/cef55264-5bd8-4db2-911c-edbeeeb99349-registry-tls\") pod \"cef55264-5bd8-4db2-911c-edbeeeb99349\" (UID: \"cef55264-5bd8-4db2-911c-edbeeeb99349\") "
Sep 08 10:31:59.637417 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:59.637406    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/cef55264-5bd8-4db2-911c-edbeeeb99349-offline-tls\") pod \"cef55264-5bd8-4db2-911c-edbeeeb99349\" (UID: \"cef55264-5bd8-4db2-911c-edbeeeb99349\") "
Sep 08 10:31:59.637686 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:59.637452    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/cef55264-5bd8-4db2-911c-edbeeeb99349-feast-data\") pod \"cef55264-5bd8-4db2-911c-edbeeeb99349\" (UID: \"cef55264-5bd8-4db2-911c-edbeeeb99349\") "
Sep 08 10:31:59.637686 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:59.637476    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/cef55264-5bd8-4db2-911c-edbeeeb99349-ui-tls\") pod \"cef55264-5bd8-4db2-911c-edbeeeb99349\" (UID: \"cef55264-5bd8-4db2-911c-edbeeeb99349\") "
Sep 08 10:31:59.637686 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:59.637573    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-clddj\" (UniqueName: \"kubernetes.io/projected/cef55264-5bd8-4db2-911c-edbeeeb99349-kube-api-access-clddj\") pod \"cef55264-5bd8-4db2-911c-edbeeeb99349\" (UID: \"cef55264-5bd8-4db2-911c-edbeeeb99349\") "
Sep 08 10:31:59.637686 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:59.637623    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/cef55264-5bd8-4db2-911c-edbeeeb99349-online-tls\") pod \"cef55264-5bd8-4db2-911c-edbeeeb99349\" (UID: \"cef55264-5bd8-4db2-911c-edbeeeb99349\") "
Sep 08 10:31:59.637902 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:59.637780    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cef55264-5bd8-4db2-911c-edbeeeb99349-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "cef55264-5bd8-4db2-911c-edbeeeb99349" (UID: "cef55264-5bd8-4db2-911c-edbeeeb99349"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:31:59.637960 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:59.637913    2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/cef55264-5bd8-4db2-911c-edbeeeb99349-registry-tls\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:31:59.638083 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:59.638057    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cef55264-5bd8-4db2-911c-edbeeeb99349-feast-data" (OuterVolumeSpecName: "feast-data") pod "cef55264-5bd8-4db2-911c-edbeeeb99349" (UID: "cef55264-5bd8-4db2-911c-edbeeeb99349"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:31:59.640109 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:59.640075    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cef55264-5bd8-4db2-911c-edbeeeb99349-online-tls" (OuterVolumeSpecName: "online-tls") pod "cef55264-5bd8-4db2-911c-edbeeeb99349" (UID: "cef55264-5bd8-4db2-911c-edbeeeb99349"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:31:59.640231 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:59.640130    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cef55264-5bd8-4db2-911c-edbeeeb99349-kube-api-access-clddj" (OuterVolumeSpecName: "kube-api-access-clddj") pod "cef55264-5bd8-4db2-911c-edbeeeb99349" (UID: "cef55264-5bd8-4db2-911c-edbeeeb99349"). InnerVolumeSpecName "kube-api-access-clddj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:31:59.640231 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:59.640154    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cef55264-5bd8-4db2-911c-edbeeeb99349-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "cef55264-5bd8-4db2-911c-edbeeeb99349" (UID: "cef55264-5bd8-4db2-911c-edbeeeb99349"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:31:59.640352 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:59.640300    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cef55264-5bd8-4db2-911c-edbeeeb99349-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "cef55264-5bd8-4db2-911c-edbeeeb99349" (UID: "cef55264-5bd8-4db2-911c-edbeeeb99349"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:31:59.738245 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:59.738222    2579 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/cef55264-5bd8-4db2-911c-edbeeeb99349-ui-tls\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:31:59.738245 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:59.738244    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-clddj\" (UniqueName: \"kubernetes.io/projected/cef55264-5bd8-4db2-911c-edbeeeb99349-kube-api-access-clddj\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:31:59.738406 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:59.738256    2579 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/cef55264-5bd8-4db2-911c-edbeeeb99349-online-tls\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:31:59.738406 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:59.738264    2579 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/cef55264-5bd8-4db2-911c-edbeeeb99349-offline-tls\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:31:59.738406 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:31:59.738271    2579 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/cef55264-5bd8-4db2-911c-edbeeeb99349-feast-data\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:32:00.086389 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.086364    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq"
Sep 08 10:32:00.243208 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.243120    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2e2bdb6a-c320-4a6c-a790-d9dcb577d02d-ui-tls\") pod \"2e2bdb6a-c320-4a6c-a790-d9dcb577d02d\" (UID: \"2e2bdb6a-c320-4a6c-a790-d9dcb577d02d\") "
Sep 08 10:32:00.243208 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.243190    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2e2bdb6a-c320-4a6c-a790-d9dcb577d02d-feast-data\") pod \"2e2bdb6a-c320-4a6c-a790-d9dcb577d02d\" (UID: \"2e2bdb6a-c320-4a6c-a790-d9dcb577d02d\") "
Sep 08 10:32:00.243442 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.243243    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2e2bdb6a-c320-4a6c-a790-d9dcb577d02d-offline-tls\") pod \"2e2bdb6a-c320-4a6c-a790-d9dcb577d02d\" (UID: \"2e2bdb6a-c320-4a6c-a790-d9dcb577d02d\") "
Sep 08 10:32:00.243442 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.243291    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n6cgt\" (UniqueName: \"kubernetes.io/projected/2e2bdb6a-c320-4a6c-a790-d9dcb577d02d-kube-api-access-n6cgt\") pod \"2e2bdb6a-c320-4a6c-a790-d9dcb577d02d\" (UID: \"2e2bdb6a-c320-4a6c-a790-d9dcb577d02d\") "
Sep 08 10:32:00.243442 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.243331    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2e2bdb6a-c320-4a6c-a790-d9dcb577d02d-online-tls\") pod \"2e2bdb6a-c320-4a6c-a790-d9dcb577d02d\" (UID: \"2e2bdb6a-c320-4a6c-a790-d9dcb577d02d\") "
Sep 08 10:32:00.243442 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.243362    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2e2bdb6a-c320-4a6c-a790-d9dcb577d02d-registry-tls\") pod \"2e2bdb6a-c320-4a6c-a790-d9dcb577d02d\" (UID: \"2e2bdb6a-c320-4a6c-a790-d9dcb577d02d\") "
Sep 08 10:32:00.243913 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.243841    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e2bdb6a-c320-4a6c-a790-d9dcb577d02d-feast-data" (OuterVolumeSpecName: "feast-data") pod "2e2bdb6a-c320-4a6c-a790-d9dcb577d02d" (UID: "2e2bdb6a-c320-4a6c-a790-d9dcb577d02d"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:32:00.245676 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.245643    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e2bdb6a-c320-4a6c-a790-d9dcb577d02d-online-tls" (OuterVolumeSpecName: "online-tls") pod "2e2bdb6a-c320-4a6c-a790-d9dcb577d02d" (UID: "2e2bdb6a-c320-4a6c-a790-d9dcb577d02d"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:32:00.245676 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.245663    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e2bdb6a-c320-4a6c-a790-d9dcb577d02d-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "2e2bdb6a-c320-4a6c-a790-d9dcb577d02d" (UID: "2e2bdb6a-c320-4a6c-a790-d9dcb577d02d"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:32:00.245829 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.245680    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e2bdb6a-c320-4a6c-a790-d9dcb577d02d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2e2bdb6a-c320-4a6c-a790-d9dcb577d02d" (UID: "2e2bdb6a-c320-4a6c-a790-d9dcb577d02d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:32:00.245928 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.245912    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e2bdb6a-c320-4a6c-a790-d9dcb577d02d-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "2e2bdb6a-c320-4a6c-a790-d9dcb577d02d" (UID: "2e2bdb6a-c320-4a6c-a790-d9dcb577d02d"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:32:00.245928 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.245921    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e2bdb6a-c320-4a6c-a790-d9dcb577d02d-kube-api-access-n6cgt" (OuterVolumeSpecName: "kube-api-access-n6cgt") pod "2e2bdb6a-c320-4a6c-a790-d9dcb577d02d" (UID: "2e2bdb6a-c320-4a6c-a790-d9dcb577d02d"). InnerVolumeSpecName "kube-api-access-n6cgt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:32:00.277692 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.277663    2579 generic.go:356] "Generic (PLEG): container finished" podID="cef55264-5bd8-4db2-911c-edbeeeb99349" containerID="42550e1293515f8194086595bdc8a6393f950434774ffd97e11ecb0388245d9e" exitCode=137
Sep 08 10:32:00.277808 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.277739    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s"
Sep 08 10:32:00.277808 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.277745    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s" event={"ID":"cef55264-5bd8-4db2-911c-edbeeeb99349","Type":"ContainerDied","Data":"42550e1293515f8194086595bdc8a6393f950434774ffd97e11ecb0388245d9e"}
Sep 08 10:32:00.277808 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.277800    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s" event={"ID":"cef55264-5bd8-4db2-911c-edbeeeb99349","Type":"ContainerDied","Data":"96d9993a7b4878f02085890fc8a99d1cd0bd59c28602e27823c80aa7f38841f1"}
Sep 08 10:32:00.277970 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.277828    2579 scope.go:117] "RemoveContainer" containerID="474fd12e34b69e2cf2a487ff7b60e05ac236346169e7ed3320f99dbe6ce2be92"
Sep 08 10:32:00.281049 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.281001    2579 generic.go:356] "Generic (PLEG): container finished" podID="2e2bdb6a-c320-4a6c-a790-d9dcb577d02d" containerID="98666cfbce39cad6cf995c0f18a2606693c3b925dabea1c311293fcbaeb5fd0c" exitCode=137
Sep 08 10:32:00.281049 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.281024    2579 generic.go:356] "Generic (PLEG): container finished" podID="2e2bdb6a-c320-4a6c-a790-d9dcb577d02d" containerID="46642172ebf6a489deb607d2ba5d87e5191f21f2670cb0848668a8d121210084" exitCode=137
Sep 08 10:32:00.281049 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.281041    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq" event={"ID":"2e2bdb6a-c320-4a6c-a790-d9dcb577d02d","Type":"ContainerDied","Data":"98666cfbce39cad6cf995c0f18a2606693c3b925dabea1c311293fcbaeb5fd0c"}
Sep 08 10:32:00.281264 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.281065    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq" event={"ID":"2e2bdb6a-c320-4a6c-a790-d9dcb577d02d","Type":"ContainerDied","Data":"46642172ebf6a489deb607d2ba5d87e5191f21f2670cb0848668a8d121210084"}
Sep 08 10:32:00.281264 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.281064    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq"
Sep 08 10:32:00.281264 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.281078    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq" event={"ID":"2e2bdb6a-c320-4a6c-a790-d9dcb577d02d","Type":"ContainerDied","Data":"8ee85e9245b7b638410fce3c1339e76061a0680e04deacc3250ea651577f1253"}
Sep 08 10:32:00.287370 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.287354    2579 scope.go:117] "RemoveContainer" containerID="42550e1293515f8194086595bdc8a6393f950434774ffd97e11ecb0388245d9e"
Sep 08 10:32:00.295093 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.295076    2579 scope.go:117] "RemoveContainer" containerID="460b625127dfb58058a5a37363649da087556f491420ac58b8833ce82c4beb06"
Sep 08 10:32:00.302304 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.302287    2579 scope.go:117] "RemoveContainer" containerID="6e04f3829030c2559f48012f89a14cf2dbdacdd93e31262f91d78532b7ce0d8f"
Sep 08 10:32:00.306128 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.306105    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s"]
Sep 08 10:32:00.309965 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.309849    2579 scope.go:117] "RemoveContainer" containerID="22649ae02160c329cf0fb0b286e919f29c432bb7761df18d1f87d6e56f59b728"
Sep 08 10:32:00.312963 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.312940    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-82l8s"]
Sep 08 10:32:00.318078 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.318061    2579 scope.go:117] "RemoveContainer" containerID="474fd12e34b69e2cf2a487ff7b60e05ac236346169e7ed3320f99dbe6ce2be92"
Sep 08 10:32:00.318356 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:32:00.318338    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"474fd12e34b69e2cf2a487ff7b60e05ac236346169e7ed3320f99dbe6ce2be92\": container with ID starting with 474fd12e34b69e2cf2a487ff7b60e05ac236346169e7ed3320f99dbe6ce2be92 not found: ID does not exist" containerID="474fd12e34b69e2cf2a487ff7b60e05ac236346169e7ed3320f99dbe6ce2be92"
Sep 08 10:32:00.318397 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.318366    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"474fd12e34b69e2cf2a487ff7b60e05ac236346169e7ed3320f99dbe6ce2be92"} err="failed to get container status \"474fd12e34b69e2cf2a487ff7b60e05ac236346169e7ed3320f99dbe6ce2be92\": rpc error: code = NotFound desc = could not find container \"474fd12e34b69e2cf2a487ff7b60e05ac236346169e7ed3320f99dbe6ce2be92\": container with ID starting with 474fd12e34b69e2cf2a487ff7b60e05ac236346169e7ed3320f99dbe6ce2be92 not found: ID does not exist"
Sep 08 10:32:00.318397 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.318385    2579 scope.go:117] "RemoveContainer" containerID="42550e1293515f8194086595bdc8a6393f950434774ffd97e11ecb0388245d9e"
Sep 08 10:32:00.318722 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:32:00.318703    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42550e1293515f8194086595bdc8a6393f950434774ffd97e11ecb0388245d9e\": container with ID starting with 42550e1293515f8194086595bdc8a6393f950434774ffd97e11ecb0388245d9e not found: ID does not exist" containerID="42550e1293515f8194086595bdc8a6393f950434774ffd97e11ecb0388245d9e"
Sep 08 10:32:00.318770 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.318727    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42550e1293515f8194086595bdc8a6393f950434774ffd97e11ecb0388245d9e"} err="failed to get container status \"42550e1293515f8194086595bdc8a6393f950434774ffd97e11ecb0388245d9e\": rpc error: code = NotFound desc = could not find container \"42550e1293515f8194086595bdc8a6393f950434774ffd97e11ecb0388245d9e\": container with ID starting with 42550e1293515f8194086595bdc8a6393f950434774ffd97e11ecb0388245d9e not found: ID does not exist"
Sep 08 10:32:00.318770 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.318743    2579 scope.go:117] "RemoveContainer" containerID="460b625127dfb58058a5a37363649da087556f491420ac58b8833ce82c4beb06"
Sep 08 10:32:00.318999 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:32:00.318981    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"460b625127dfb58058a5a37363649da087556f491420ac58b8833ce82c4beb06\": container with ID starting with 460b625127dfb58058a5a37363649da087556f491420ac58b8833ce82c4beb06 not found: ID does not exist" containerID="460b625127dfb58058a5a37363649da087556f491420ac58b8833ce82c4beb06"
Sep 08 10:32:00.319055 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.319001    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"460b625127dfb58058a5a37363649da087556f491420ac58b8833ce82c4beb06"} err="failed to get container status \"460b625127dfb58058a5a37363649da087556f491420ac58b8833ce82c4beb06\": rpc error: code = NotFound desc = could not find container \"460b625127dfb58058a5a37363649da087556f491420ac58b8833ce82c4beb06\": container with ID starting with 460b625127dfb58058a5a37363649da087556f491420ac58b8833ce82c4beb06 not found: ID does not exist"
Sep 08 10:32:00.319055 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.319017    2579 scope.go:117] "RemoveContainer" containerID="6e04f3829030c2559f48012f89a14cf2dbdacdd93e31262f91d78532b7ce0d8f"
Sep 08 10:32:00.319238 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:32:00.319225    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e04f3829030c2559f48012f89a14cf2dbdacdd93e31262f91d78532b7ce0d8f\": container with ID starting with 6e04f3829030c2559f48012f89a14cf2dbdacdd93e31262f91d78532b7ce0d8f not found: ID does not exist" containerID="6e04f3829030c2559f48012f89a14cf2dbdacdd93e31262f91d78532b7ce0d8f"
Sep 08 10:32:00.319282 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.319241    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e04f3829030c2559f48012f89a14cf2dbdacdd93e31262f91d78532b7ce0d8f"} err="failed to get container status \"6e04f3829030c2559f48012f89a14cf2dbdacdd93e31262f91d78532b7ce0d8f\": rpc error: code = NotFound desc = could not find container \"6e04f3829030c2559f48012f89a14cf2dbdacdd93e31262f91d78532b7ce0d8f\": container with ID starting with 6e04f3829030c2559f48012f89a14cf2dbdacdd93e31262f91d78532b7ce0d8f not found: ID does not exist"
Sep 08 10:32:00.319282 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.319253    2579 scope.go:117] "RemoveContainer" containerID="22649ae02160c329cf0fb0b286e919f29c432bb7761df18d1f87d6e56f59b728"
Sep 08 10:32:00.319473 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:32:00.319455    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22649ae02160c329cf0fb0b286e919f29c432bb7761df18d1f87d6e56f59b728\": container with ID starting with 22649ae02160c329cf0fb0b286e919f29c432bb7761df18d1f87d6e56f59b728 not found: ID does not exist" containerID="22649ae02160c329cf0fb0b286e919f29c432bb7761df18d1f87d6e56f59b728"
Sep 08 10:32:00.319516 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.319478    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22649ae02160c329cf0fb0b286e919f29c432bb7761df18d1f87d6e56f59b728"} err="failed to get container status \"22649ae02160c329cf0fb0b286e919f29c432bb7761df18d1f87d6e56f59b728\": rpc error: code = NotFound desc = could not find container \"22649ae02160c329cf0fb0b286e919f29c432bb7761df18d1f87d6e56f59b728\": container with ID starting with 22649ae02160c329cf0fb0b286e919f29c432bb7761df18d1f87d6e56f59b728 not found: ID does not exist"
Sep 08 10:32:00.319516 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.319490    2579 scope.go:117] "RemoveContainer" containerID="f1946fe78303d383e45927603083d05d3f3e8c0d2daeedd02d0c3e463e0f67d5"
Sep 08 10:32:00.326001 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.325977    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq"]
Sep 08 10:32:00.327138 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.327114    2579 scope.go:117] "RemoveContainer" containerID="98666cfbce39cad6cf995c0f18a2606693c3b925dabea1c311293fcbaeb5fd0c"
Sep 08 10:32:00.331021 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.330991    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-sk9mq"]
Sep 08 10:32:00.340299 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.340277    2579 scope.go:117] "RemoveContainer" containerID="9b3a896d8891d3082f5b0e84ff54e7a02960a50eb8689ecf58c57b413f4e2138"
Sep 08 10:32:00.344645 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.344624    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n6cgt\" (UniqueName: \"kubernetes.io/projected/2e2bdb6a-c320-4a6c-a790-d9dcb577d02d-kube-api-access-n6cgt\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:32:00.344745 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.344646    2579 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2e2bdb6a-c320-4a6c-a790-d9dcb577d02d-online-tls\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:32:00.344745 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.344657    2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2e2bdb6a-c320-4a6c-a790-d9dcb577d02d-registry-tls\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:32:00.344745 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.344664    2579 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2e2bdb6a-c320-4a6c-a790-d9dcb577d02d-ui-tls\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:32:00.344745 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.344672    2579 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2e2bdb6a-c320-4a6c-a790-d9dcb577d02d-feast-data\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:32:00.344745 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.344678    2579 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2e2bdb6a-c320-4a6c-a790-d9dcb577d02d-offline-tls\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:32:00.347978 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.347962    2579 scope.go:117] "RemoveContainer" containerID="46642172ebf6a489deb607d2ba5d87e5191f21f2670cb0848668a8d121210084"
Sep 08 10:32:00.355308 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.355289    2579 scope.go:117] "RemoveContainer" containerID="f18dbad581dc72567d195332d884918eb6b07ea8562ebda043d964a984c81ff0"
Sep 08 10:32:00.362280 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.362262    2579 scope.go:117] "RemoveContainer" containerID="5237ccab88406e2c5c5bf0c9a79e511aa40541c54c876a15c5139da7829f2f09"
Sep 08 10:32:00.369121 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.369104    2579 scope.go:117] "RemoveContainer" containerID="f1946fe78303d383e45927603083d05d3f3e8c0d2daeedd02d0c3e463e0f67d5"
Sep 08 10:32:00.369387 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:32:00.369348    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1946fe78303d383e45927603083d05d3f3e8c0d2daeedd02d0c3e463e0f67d5\": container with ID starting with f1946fe78303d383e45927603083d05d3f3e8c0d2daeedd02d0c3e463e0f67d5 not found: ID does not exist" containerID="f1946fe78303d383e45927603083d05d3f3e8c0d2daeedd02d0c3e463e0f67d5"
Sep 08 10:32:00.369439 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.369396    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1946fe78303d383e45927603083d05d3f3e8c0d2daeedd02d0c3e463e0f67d5"} err="failed to get container status \"f1946fe78303d383e45927603083d05d3f3e8c0d2daeedd02d0c3e463e0f67d5\": rpc error: code = NotFound desc = could not find container \"f1946fe78303d383e45927603083d05d3f3e8c0d2daeedd02d0c3e463e0f67d5\": container with ID starting with f1946fe78303d383e45927603083d05d3f3e8c0d2daeedd02d0c3e463e0f67d5 not found: ID does not exist"
Sep 08 10:32:00.369439 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.369416    2579 scope.go:117] "RemoveContainer" containerID="98666cfbce39cad6cf995c0f18a2606693c3b925dabea1c311293fcbaeb5fd0c"
Sep 08 10:32:00.369672 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:32:00.369657    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98666cfbce39cad6cf995c0f18a2606693c3b925dabea1c311293fcbaeb5fd0c\": container with ID starting with 98666cfbce39cad6cf995c0f18a2606693c3b925dabea1c311293fcbaeb5fd0c not found: ID does not exist" containerID="98666cfbce39cad6cf995c0f18a2606693c3b925dabea1c311293fcbaeb5fd0c"
Sep 08 10:32:00.369734 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.369676    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98666cfbce39cad6cf995c0f18a2606693c3b925dabea1c311293fcbaeb5fd0c"} err="failed to get container status \"98666cfbce39cad6cf995c0f18a2606693c3b925dabea1c311293fcbaeb5fd0c\": rpc error: code = NotFound desc = could not find container \"98666cfbce39cad6cf995c0f18a2606693c3b925dabea1c311293fcbaeb5fd0c\": container with ID starting with 98666cfbce39cad6cf995c0f18a2606693c3b925dabea1c311293fcbaeb5fd0c not found: ID does not exist"
Sep 08 10:32:00.369734 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.369692    2579 scope.go:117] "RemoveContainer" containerID="9b3a896d8891d3082f5b0e84ff54e7a02960a50eb8689ecf58c57b413f4e2138"
Sep 08 10:32:00.369958 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:32:00.369940    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b3a896d8891d3082f5b0e84ff54e7a02960a50eb8689ecf58c57b413f4e2138\": container with ID starting with 9b3a896d8891d3082f5b0e84ff54e7a02960a50eb8689ecf58c57b413f4e2138 not found: ID does not exist" containerID="9b3a896d8891d3082f5b0e84ff54e7a02960a50eb8689ecf58c57b413f4e2138"
Sep 08 10:32:00.370024 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.369970    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b3a896d8891d3082f5b0e84ff54e7a02960a50eb8689ecf58c57b413f4e2138"} err="failed to get container status \"9b3a896d8891d3082f5b0e84ff54e7a02960a50eb8689ecf58c57b413f4e2138\": rpc error: code = NotFound desc = could not find container \"9b3a896d8891d3082f5b0e84ff54e7a02960a50eb8689ecf58c57b413f4e2138\": container with ID starting with 9b3a896d8891d3082f5b0e84ff54e7a02960a50eb8689ecf58c57b413f4e2138 not found: ID does not exist"
Sep 08 10:32:00.370024 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.369991    2579 scope.go:117] "RemoveContainer" containerID="46642172ebf6a489deb607d2ba5d87e5191f21f2670cb0848668a8d121210084"
Sep 08 10:32:00.370247 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:32:00.370231    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46642172ebf6a489deb607d2ba5d87e5191f21f2670cb0848668a8d121210084\": container with ID starting with 46642172ebf6a489deb607d2ba5d87e5191f21f2670cb0848668a8d121210084 not found: ID does not exist" containerID="46642172ebf6a489deb607d2ba5d87e5191f21f2670cb0848668a8d121210084"
Sep 08 10:32:00.370288 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.370252    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46642172ebf6a489deb607d2ba5d87e5191f21f2670cb0848668a8d121210084"} err="failed to get container status \"46642172ebf6a489deb607d2ba5d87e5191f21f2670cb0848668a8d121210084\": rpc error: code = NotFound desc = could not find container \"46642172ebf6a489deb607d2ba5d87e5191f21f2670cb0848668a8d121210084\": container with ID starting with 46642172ebf6a489deb607d2ba5d87e5191f21f2670cb0848668a8d121210084 not found: ID does not exist"
Sep 08 10:32:00.370288 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.370266    2579 scope.go:117] "RemoveContainer" containerID="f18dbad581dc72567d195332d884918eb6b07ea8562ebda043d964a984c81ff0"
Sep 08 10:32:00.370514 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:32:00.370495    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f18dbad581dc72567d195332d884918eb6b07ea8562ebda043d964a984c81ff0\": container with ID starting with f18dbad581dc72567d195332d884918eb6b07ea8562ebda043d964a984c81ff0 not found: ID does not exist" containerID="f18dbad581dc72567d195332d884918eb6b07ea8562ebda043d964a984c81ff0"
Sep 08 10:32:00.370609 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.370520    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f18dbad581dc72567d195332d884918eb6b07ea8562ebda043d964a984c81ff0"} err="failed to get container status \"f18dbad581dc72567d195332d884918eb6b07ea8562ebda043d964a984c81ff0\": rpc error: code = NotFound desc = could not find container \"f18dbad581dc72567d195332d884918eb6b07ea8562ebda043d964a984c81ff0\": container with ID starting with f18dbad581dc72567d195332d884918eb6b07ea8562ebda043d964a984c81ff0 not found: ID does not exist"
Sep 08 10:32:00.370609 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.370563    2579 scope.go:117] "RemoveContainer" containerID="5237ccab88406e2c5c5bf0c9a79e511aa40541c54c876a15c5139da7829f2f09"
Sep 08 10:32:00.370834 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:32:00.370818    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5237ccab88406e2c5c5bf0c9a79e511aa40541c54c876a15c5139da7829f2f09\": container with ID starting with 5237ccab88406e2c5c5bf0c9a79e511aa40541c54c876a15c5139da7829f2f09 not found: ID does not exist" containerID="5237ccab88406e2c5c5bf0c9a79e511aa40541c54c876a15c5139da7829f2f09"
Sep 08 10:32:00.370873 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.370838    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5237ccab88406e2c5c5bf0c9a79e511aa40541c54c876a15c5139da7829f2f09"} err="failed to get container status \"5237ccab88406e2c5c5bf0c9a79e511aa40541c54c876a15c5139da7829f2f09\": rpc error: code = NotFound desc = could not find container \"5237ccab88406e2c5c5bf0c9a79e511aa40541c54c876a15c5139da7829f2f09\": container with ID starting with 5237ccab88406e2c5c5bf0c9a79e511aa40541c54c876a15c5139da7829f2f09 not found: ID does not exist"
Sep 08 10:32:00.370873 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.370852    2579 scope.go:117] "RemoveContainer" containerID="f1946fe78303d383e45927603083d05d3f3e8c0d2daeedd02d0c3e463e0f67d5"
Sep 08 10:32:00.371072 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.371053    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1946fe78303d383e45927603083d05d3f3e8c0d2daeedd02d0c3e463e0f67d5"} err="failed to get container status \"f1946fe78303d383e45927603083d05d3f3e8c0d2daeedd02d0c3e463e0f67d5\": rpc error: code = NotFound desc = could not find container \"f1946fe78303d383e45927603083d05d3f3e8c0d2daeedd02d0c3e463e0f67d5\": container with ID starting with f1946fe78303d383e45927603083d05d3f3e8c0d2daeedd02d0c3e463e0f67d5 not found: ID does not exist"
Sep 08 10:32:00.371140 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.371073    2579 scope.go:117] "RemoveContainer" containerID="98666cfbce39cad6cf995c0f18a2606693c3b925dabea1c311293fcbaeb5fd0c"
Sep 08 10:32:00.371315 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.371299    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98666cfbce39cad6cf995c0f18a2606693c3b925dabea1c311293fcbaeb5fd0c"} err="failed to get container status \"98666cfbce39cad6cf995c0f18a2606693c3b925dabea1c311293fcbaeb5fd0c\": rpc error: code = NotFound desc = could not find container \"98666cfbce39cad6cf995c0f18a2606693c3b925dabea1c311293fcbaeb5fd0c\": container with ID starting with 98666cfbce39cad6cf995c0f18a2606693c3b925dabea1c311293fcbaeb5fd0c not found: ID does not exist"
Sep 08 10:32:00.371362 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.371315    2579 scope.go:117] "RemoveContainer" containerID="9b3a896d8891d3082f5b0e84ff54e7a02960a50eb8689ecf58c57b413f4e2138"
Sep 08 10:32:00.371563 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.371530    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b3a896d8891d3082f5b0e84ff54e7a02960a50eb8689ecf58c57b413f4e2138"} err="failed to get container status \"9b3a896d8891d3082f5b0e84ff54e7a02960a50eb8689ecf58c57b413f4e2138\": rpc error: code = NotFound desc = could not find container \"9b3a896d8891d3082f5b0e84ff54e7a02960a50eb8689ecf58c57b413f4e2138\": container with ID starting with 9b3a896d8891d3082f5b0e84ff54e7a02960a50eb8689ecf58c57b413f4e2138 not found: ID does not exist"
Sep 08 10:32:00.371609 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.371565    2579 scope.go:117] "RemoveContainer" containerID="46642172ebf6a489deb607d2ba5d87e5191f21f2670cb0848668a8d121210084"
Sep 08 10:32:00.371794 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.371777    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46642172ebf6a489deb607d2ba5d87e5191f21f2670cb0848668a8d121210084"} err="failed to get container status \"46642172ebf6a489deb607d2ba5d87e5191f21f2670cb0848668a8d121210084\": rpc error: code = NotFound desc = could not find container \"46642172ebf6a489deb607d2ba5d87e5191f21f2670cb0848668a8d121210084\": container with ID starting with 46642172ebf6a489deb607d2ba5d87e5191f21f2670cb0848668a8d121210084 not found: ID does not exist"
Sep 08 10:32:00.371845 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.371794    2579 scope.go:117] "RemoveContainer" containerID="f18dbad581dc72567d195332d884918eb6b07ea8562ebda043d964a984c81ff0"
Sep 08 10:32:00.372027 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.372009    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f18dbad581dc72567d195332d884918eb6b07ea8562ebda043d964a984c81ff0"} err="failed to get container status \"f18dbad581dc72567d195332d884918eb6b07ea8562ebda043d964a984c81ff0\": rpc error: code = NotFound desc = could not find container \"f18dbad581dc72567d195332d884918eb6b07ea8562ebda043d964a984c81ff0\": container with ID starting with f18dbad581dc72567d195332d884918eb6b07ea8562ebda043d964a984c81ff0 not found: ID does not exist"
Sep 08 10:32:00.372072 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.372031    2579 scope.go:117] "RemoveContainer" containerID="5237ccab88406e2c5c5bf0c9a79e511aa40541c54c876a15c5139da7829f2f09"
Sep 08 10:32:00.372267 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.372249    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5237ccab88406e2c5c5bf0c9a79e511aa40541c54c876a15c5139da7829f2f09"} err="failed to get container status \"5237ccab88406e2c5c5bf0c9a79e511aa40541c54c876a15c5139da7829f2f09\": rpc error: code = NotFound desc = could not find container \"5237ccab88406e2c5c5bf0c9a79e511aa40541c54c876a15c5139da7829f2f09\": container with ID starting with 5237ccab88406e2c5c5bf0c9a79e511aa40541c54c876a15c5139da7829f2f09 not found: ID does not exist"
Sep 08 10:32:00.832168 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.832126    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e2bdb6a-c320-4a6c-a790-d9dcb577d02d" path="/var/lib/kubelet/pods/2e2bdb6a-c320-4a6c-a790-d9dcb577d02d/volumes"
Sep 08 10:32:00.832936 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:00.832912    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cef55264-5bd8-4db2-911c-edbeeeb99349" path="/var/lib/kubelet/pods/cef55264-5bd8-4db2-911c-edbeeeb99349/volumes"
Sep 08 10:32:12.277124 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:12.277087    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:32:12.379265 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:12.379231    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:32:17.990964 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:17.990923    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:32:18.055757 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:18.055724    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:32:22.966870 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:22.966833    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-hhf8v"]
Sep 08 10:32:22.967235 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:22.967148    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e2bdb6a-c320-4a6c-a790-d9dcb577d02d" containerName="registry"
Sep 08 10:32:22.967235 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:22.967162    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e2bdb6a-c320-4a6c-a790-d9dcb577d02d" containerName="registry"
Sep 08 10:32:22.967235 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:22.967172    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e2bdb6a-c320-4a6c-a790-d9dcb577d02d" containerName="ui"
Sep 08 10:32:22.967235 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:22.967178    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e2bdb6a-c320-4a6c-a790-d9dcb577d02d" containerName="ui"
Sep 08 10:32:22.967235 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:22.967187    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cef55264-5bd8-4db2-911c-edbeeeb99349" containerName="offline"
Sep 08 10:32:22.967235 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:22.967192    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cef55264-5bd8-4db2-911c-edbeeeb99349" containerName="offline"
Sep 08 10:32:22.967235 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:22.967200    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e2bdb6a-c320-4a6c-a790-d9dcb577d02d" containerName="feast-apply"
Sep 08 10:32:22.967235 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:22.967205    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e2bdb6a-c320-4a6c-a790-d9dcb577d02d" containerName="feast-apply"
Sep 08 10:32:22.967235 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:22.967213    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cef55264-5bd8-4db2-911c-edbeeeb99349" containerName="ui"
Sep 08 10:32:22.967235 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:22.967218    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cef55264-5bd8-4db2-911c-edbeeeb99349" containerName="ui"
Sep 08 10:32:22.967235 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:22.967227    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e2bdb6a-c320-4a6c-a790-d9dcb577d02d" containerName="offline"
Sep 08 10:32:22.967235 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:22.967233    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e2bdb6a-c320-4a6c-a790-d9dcb577d02d" containerName="offline"
Sep 08 10:32:22.967235 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:22.967240    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e2bdb6a-c320-4a6c-a790-d9dcb577d02d" containerName="online"
Sep 08 10:32:22.967676 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:22.967245    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e2bdb6a-c320-4a6c-a790-d9dcb577d02d" containerName="online"
Sep 08 10:32:22.967676 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:22.967252    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cef55264-5bd8-4db2-911c-edbeeeb99349" containerName="feast-init"
Sep 08 10:32:22.967676 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:22.967257    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cef55264-5bd8-4db2-911c-edbeeeb99349" containerName="feast-init"
Sep 08 10:32:22.967676 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:22.967263    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cef55264-5bd8-4db2-911c-edbeeeb99349" containerName="feast-apply"
Sep 08 10:32:22.967676 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:22.967268    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cef55264-5bd8-4db2-911c-edbeeeb99349" containerName="feast-apply"
Sep 08 10:32:22.967676 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:22.967276    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cef55264-5bd8-4db2-911c-edbeeeb99349" containerName="online"
Sep 08 10:32:22.967676 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:22.967280    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cef55264-5bd8-4db2-911c-edbeeeb99349" containerName="online"
Sep 08 10:32:22.967676 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:22.967285    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e2bdb6a-c320-4a6c-a790-d9dcb577d02d" containerName="feast-init"
Sep 08 10:32:22.967676 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:22.967290    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e2bdb6a-c320-4a6c-a790-d9dcb577d02d" containerName="feast-init"
Sep 08 10:32:22.967676 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:22.967349    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e2bdb6a-c320-4a6c-a790-d9dcb577d02d" containerName="ui"
Sep 08 10:32:22.967676 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:22.967355    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="cef55264-5bd8-4db2-911c-edbeeeb99349" containerName="online"
Sep 08 10:32:22.967676 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:22.967361    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="cef55264-5bd8-4db2-911c-edbeeeb99349" containerName="ui"
Sep 08 10:32:22.967676 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:22.967370    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e2bdb6a-c320-4a6c-a790-d9dcb577d02d" containerName="registry"
Sep 08 10:32:22.967676 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:22.967375    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e2bdb6a-c320-4a6c-a790-d9dcb577d02d" containerName="online"
Sep 08 10:32:22.967676 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:22.967381    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e2bdb6a-c320-4a6c-a790-d9dcb577d02d" containerName="offline"
Sep 08 10:32:22.967676 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:22.967385    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="cef55264-5bd8-4db2-911c-edbeeeb99349" containerName="offline"
Sep 08 10:32:22.970115 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:22.970098    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-hhf8v"
Sep 08 10:32:22.973011 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:22.972983    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
Sep 08 10:32:22.973160 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:22.973063    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-2h9c4\""
Sep 08 10:32:22.974363 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:22.974342    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
Sep 08 10:32:22.979522 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:22.979500    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-hhf8v"]
Sep 08 10:32:23.015192 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:23.015166    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx9jq\" (UniqueName: \"kubernetes.io/projected/53264085-540d-41f8-945d-220f22a8a537-kube-api-access-qx9jq\") pod \"feast-operator-controller-manager-689b877b4b-hhf8v\" (UID: \"53264085-540d-41f8-945d-220f22a8a537\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-hhf8v"
Sep 08 10:32:23.116473 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:23.116443    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx9jq\" (UniqueName: \"kubernetes.io/projected/53264085-540d-41f8-945d-220f22a8a537-kube-api-access-qx9jq\") pod \"feast-operator-controller-manager-689b877b4b-hhf8v\" (UID: \"53264085-540d-41f8-945d-220f22a8a537\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-hhf8v"
Sep 08 10:32:23.128267 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:23.128235    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx9jq\" (UniqueName: \"kubernetes.io/projected/53264085-540d-41f8-945d-220f22a8a537-kube-api-access-qx9jq\") pod \"feast-operator-controller-manager-689b877b4b-hhf8v\" (UID: \"53264085-540d-41f8-945d-220f22a8a537\") " pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-hhf8v"
Sep 08 10:32:23.280553 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:23.280508    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-hhf8v"
Sep 08 10:32:23.562926 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:23.562838    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-689b877b4b-hhf8v"]
Sep 08 10:32:23.565729 ip-10-0-132-96 kubenswrapper[2579]: W0908 10:32:23.565702    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53264085_540d_41f8_945d_220f22a8a537.slice/crio-fe68a1813ef366c178360cd89f24fa5283f6f349f54cefe00431e124f0a64366 WatchSource:0}: Error finding container fe68a1813ef366c178360cd89f24fa5283f6f349f54cefe00431e124f0a64366: Status 404 returned error can't find the container with id fe68a1813ef366c178360cd89f24fa5283f6f349f54cefe00431e124f0a64366
Sep 08 10:32:23.567733 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:23.567713    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 10:32:24.382098 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:24.382062    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-hhf8v" event={"ID":"53264085-540d-41f8-945d-220f22a8a537","Type":"ContainerStarted","Data":"fe68a1813ef366c178360cd89f24fa5283f6f349f54cefe00431e124f0a64366"}
Sep 08 10:32:26.393552 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:26.393487    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-hhf8v" event={"ID":"53264085-540d-41f8-945d-220f22a8a537","Type":"ContainerStarted","Data":"1d735b1b2348d979eb861391d1d27f825882389586b68263155b347baecffe4b"}
Sep 08 10:32:26.393929 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:26.393673    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-hhf8v"
Sep 08 10:32:26.416379 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:26.416304    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-hhf8v" podStartSLOduration=2.448136679 podStartE2EDuration="4.416291157s" totalImagesPullingTime="1.968154478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:32:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:32:26.414825777 +0000 UTC m=+2060.110424679" watchObservedRunningTime="2026-09-08 10:32:26.416291157 +0000 UTC m=+2060.111890057"
Sep 08 10:32:37.400474 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:37.400401    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-689b877b4b-hhf8v"
Sep 08 10:32:41.267485 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:41.267451    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:32:41.369109 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:41.369052    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:32:43.414911 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:43.414862    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r"]
Sep 08 10:32:43.419802 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:43.419776    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r"
Sep 08 10:32:43.427726 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:43.427706    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Sep 08 10:32:43.428079 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:43.428063    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Sep 08 10:32:43.428237 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:43.428219    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-2nk5z\""
Sep 08 10:32:43.428326 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:43.428304    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Sep 08 10:32:43.428377 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:43.428317    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Sep 08 10:32:43.428984 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:43.428970    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Sep 08 10:32:43.429033 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:43.428984    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Sep 08 10:32:43.442989 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:43.442964    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r"]
Sep 08 10:32:43.460691 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:43.460668    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d7599925-b7b1-4342-8574-14d3c3b0f292-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-n988r\" (UID: \"d7599925-b7b1-4342-8574-14d3c3b0f292\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r"
Sep 08 10:32:43.460809 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:43.460705    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d7599925-b7b1-4342-8574-14d3c3b0f292-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-n988r\" (UID: \"d7599925-b7b1-4342-8574-14d3c3b0f292\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r"
Sep 08 10:32:43.460809 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:43.460727    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d7599925-b7b1-4342-8574-14d3c3b0f292-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-n988r\" (UID: \"d7599925-b7b1-4342-8574-14d3c3b0f292\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r"
Sep 08 10:32:43.460893 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:43.460820    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d7599925-b7b1-4342-8574-14d3c3b0f292-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-n988r\" (UID: \"d7599925-b7b1-4342-8574-14d3c3b0f292\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r"
Sep 08 10:32:43.460893 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:43.460876    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stlgq\" (UniqueName: \"kubernetes.io/projected/d7599925-b7b1-4342-8574-14d3c3b0f292-kube-api-access-stlgq\") pod \"feast-simple-feast-setup-57576b8fcf-n988r\" (UID: \"d7599925-b7b1-4342-8574-14d3c3b0f292\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r"
Sep 08 10:32:43.460970 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:43.460931    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d7599925-b7b1-4342-8574-14d3c3b0f292-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-n988r\" (UID: \"d7599925-b7b1-4342-8574-14d3c3b0f292\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r"
Sep 08 10:32:43.561279 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:43.561238    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stlgq\" (UniqueName: \"kubernetes.io/projected/d7599925-b7b1-4342-8574-14d3c3b0f292-kube-api-access-stlgq\") pod \"feast-simple-feast-setup-57576b8fcf-n988r\" (UID: \"d7599925-b7b1-4342-8574-14d3c3b0f292\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r"
Sep 08 10:32:43.561279 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:43.561281    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d7599925-b7b1-4342-8574-14d3c3b0f292-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-n988r\" (UID: \"d7599925-b7b1-4342-8574-14d3c3b0f292\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r"
Sep 08 10:32:43.561492 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:43.561317    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d7599925-b7b1-4342-8574-14d3c3b0f292-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-n988r\" (UID: \"d7599925-b7b1-4342-8574-14d3c3b0f292\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r"
Sep 08 10:32:43.561492 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:43.561342    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d7599925-b7b1-4342-8574-14d3c3b0f292-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-n988r\" (UID: \"d7599925-b7b1-4342-8574-14d3c3b0f292\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r"
Sep 08 10:32:43.561492 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:43.561367    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d7599925-b7b1-4342-8574-14d3c3b0f292-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-n988r\" (UID: \"d7599925-b7b1-4342-8574-14d3c3b0f292\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r"
Sep 08 10:32:43.561492 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:43.561415    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d7599925-b7b1-4342-8574-14d3c3b0f292-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-n988r\" (UID: \"d7599925-b7b1-4342-8574-14d3c3b0f292\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r"
Sep 08 10:32:43.561763 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:32:43.561515    2579 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
Sep 08 10:32:43.561763 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:32:43.561637    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d7599925-b7b1-4342-8574-14d3c3b0f292-registry-tls podName:d7599925-b7b1-4342-8574-14d3c3b0f292 nodeName:}" failed. No retries permitted until 2026-09-08 10:32:44.061616591 +0000 UTC m=+2077.757215469 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/d7599925-b7b1-4342-8574-14d3c3b0f292-registry-tls") pod "feast-simple-feast-setup-57576b8fcf-n988r" (UID: "d7599925-b7b1-4342-8574-14d3c3b0f292") : secret "feast-simple-feast-setup-registry-tls" not found
Sep 08 10:32:43.561885 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:43.561759    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d7599925-b7b1-4342-8574-14d3c3b0f292-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-n988r\" (UID: \"d7599925-b7b1-4342-8574-14d3c3b0f292\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r"
Sep 08 10:32:43.564068 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:43.564046    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d7599925-b7b1-4342-8574-14d3c3b0f292-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-n988r\" (UID: \"d7599925-b7b1-4342-8574-14d3c3b0f292\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r"
Sep 08 10:32:43.564180 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:43.564083    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d7599925-b7b1-4342-8574-14d3c3b0f292-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-n988r\" (UID: \"d7599925-b7b1-4342-8574-14d3c3b0f292\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r"
Sep 08 10:32:43.564223 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:43.564209    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d7599925-b7b1-4342-8574-14d3c3b0f292-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-n988r\" (UID: \"d7599925-b7b1-4342-8574-14d3c3b0f292\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r"
Sep 08 10:32:43.573330 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:43.573304    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stlgq\" (UniqueName: \"kubernetes.io/projected/d7599925-b7b1-4342-8574-14d3c3b0f292-kube-api-access-stlgq\") pod \"feast-simple-feast-setup-57576b8fcf-n988r\" (UID: \"d7599925-b7b1-4342-8574-14d3c3b0f292\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r"
Sep 08 10:32:44.064767 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:44.064734    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d7599925-b7b1-4342-8574-14d3c3b0f292-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-n988r\" (UID: \"d7599925-b7b1-4342-8574-14d3c3b0f292\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r"
Sep 08 10:32:44.067332 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:44.067311    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d7599925-b7b1-4342-8574-14d3c3b0f292-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-n988r\" (UID: \"d7599925-b7b1-4342-8574-14d3c3b0f292\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r"
Sep 08 10:32:44.105435 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:44.105408    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:32:44.198222 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:44.198191    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:32:44.346268 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:44.346205    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r"
Sep 08 10:32:44.641322 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:44.641243    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r"]
Sep 08 10:32:44.644087 ip-10-0-132-96 kubenswrapper[2579]: W0908 10:32:44.644058    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd7599925_b7b1_4342_8574_14d3c3b0f292.slice/crio-022e490224c13993527347f36c2d908fe68fdfad4d7d5c613b72e2a814d70fd3 WatchSource:0}: Error finding container 022e490224c13993527347f36c2d908fe68fdfad4d7d5c613b72e2a814d70fd3: Status 404 returned error can't find the container with id 022e490224c13993527347f36c2d908fe68fdfad4d7d5c613b72e2a814d70fd3
Sep 08 10:32:45.471201 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:45.471162    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r" event={"ID":"d7599925-b7b1-4342-8574-14d3c3b0f292","Type":"ContainerStarted","Data":"7896601f4bd8c0ade2c85e9229bcb31aaf1952a7fd196b6c732df15cd45c8a19"}
Sep 08 10:32:45.471347 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:45.471215    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r" event={"ID":"d7599925-b7b1-4342-8574-14d3c3b0f292","Type":"ContainerStarted","Data":"022e490224c13993527347f36c2d908fe68fdfad4d7d5c613b72e2a814d70fd3"}
Sep 08 10:32:50.494282 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:50.494245    2579 generic.go:356] "Generic (PLEG): container finished" podID="d7599925-b7b1-4342-8574-14d3c3b0f292" containerID="7896601f4bd8c0ade2c85e9229bcb31aaf1952a7fd196b6c732df15cd45c8a19" exitCode=0
Sep 08 10:32:50.494282 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:50.494283    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r" event={"ID":"d7599925-b7b1-4342-8574-14d3c3b0f292","Type":"ContainerDied","Data":"7896601f4bd8c0ade2c85e9229bcb31aaf1952a7fd196b6c732df15cd45c8a19"}
Sep 08 10:32:51.501468 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:51.501427    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r" event={"ID":"d7599925-b7b1-4342-8574-14d3c3b0f292","Type":"ContainerStarted","Data":"7e9162d2b63da67b5bb78121efb2b9def215e5126dddc142849273b8083e04f3"}
Sep 08 10:32:56.523144 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:56.523108    2579 generic.go:356] "Generic (PLEG): container finished" podID="d7599925-b7b1-4342-8574-14d3c3b0f292" containerID="7e9162d2b63da67b5bb78121efb2b9def215e5126dddc142849273b8083e04f3" exitCode=0
Sep 08 10:32:56.523494 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:56.523162    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r" event={"ID":"d7599925-b7b1-4342-8574-14d3c3b0f292","Type":"ContainerDied","Data":"7e9162d2b63da67b5bb78121efb2b9def215e5126dddc142849273b8083e04f3"}
Sep 08 10:32:57.533701 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:57.533653    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r" event={"ID":"d7599925-b7b1-4342-8574-14d3c3b0f292","Type":"ContainerStarted","Data":"38358551e3fa855bf0f02dcd53df47894f026bb01b069d1fb2858241f8d409b6"}
Sep 08 10:32:57.534194 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:57.533725    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r" event={"ID":"d7599925-b7b1-4342-8574-14d3c3b0f292","Type":"ContainerStarted","Data":"3aaea10fd7f7fae753f73841d3e41cbc2b66b66c0554bc53ed8a4c7b5954b81e"}
Sep 08 10:32:57.534194 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:57.533750    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r" event={"ID":"d7599925-b7b1-4342-8574-14d3c3b0f292","Type":"ContainerStarted","Data":"7b4e8ce54354bbb3755a1baba8693c28bef788d69251d3bba1a7e664943fb709"}
Sep 08 10:32:57.534194 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:57.533768    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r" event={"ID":"d7599925-b7b1-4342-8574-14d3c3b0f292","Type":"ContainerStarted","Data":"ad853eca114b549c7181d20071a2b0fa0024ca3f3280b1e8722e66ab085e01ba"}
Sep 08 10:32:57.560836 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:57.560758    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r" podStartSLOduration=14.560736933 podStartE2EDuration="14.560736933s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:32:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:32:57.560223795 +0000 UTC m=+2091.255822696" watchObservedRunningTime="2026-09-08 10:32:57.560736933 +0000 UTC m=+2091.256336021"
Sep 08 10:32:59.347464 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:59.346477    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r"
Sep 08 10:32:59.347464 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:59.346563    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r"
Sep 08 10:32:59.347464 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:59.346584    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r"
Sep 08 10:32:59.347464 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:59.346603    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r"
Sep 08 10:32:59.348819 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:59.348777    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r" podUID="d7599925-b7b1-4342-8574-14d3c3b0f292" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.42:8816: connect: connection refused"
Sep 08 10:32:59.348944 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:59.348815    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r" podUID="d7599925-b7b1-4342-8574-14d3c3b0f292" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.42:6571: connect: connection refused"
Sep 08 10:32:59.348944 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:59.348866    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r" podUID="d7599925-b7b1-4342-8574-14d3c3b0f292" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.42:8443: connect: connection refused"
Sep 08 10:32:59.348944 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:32:59.348830    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r" podUID="d7599925-b7b1-4342-8574-14d3c3b0f292" containerName="online" probeResult="failure" output="Get \"https://10.133.0.42:6567/health\": dial tcp 10.133.0.42:6567: connect: connection refused"
Sep 08 10:33:02.346733 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:33:02.346679    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r" podUID="d7599925-b7b1-4342-8574-14d3c3b0f292" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.42:6571: connect: connection refused"
Sep 08 10:33:02.347237 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:33:02.346753    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r" podUID="d7599925-b7b1-4342-8574-14d3c3b0f292" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.42:8816: connect: connection refused"
Sep 08 10:33:02.347237 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:33:02.346693    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r" podUID="d7599925-b7b1-4342-8574-14d3c3b0f292" containerName="online" probeResult="failure" output="Get \"https://10.133.0.42:6567/health\": dial tcp 10.133.0.42:6567: connect: connection refused"
Sep 08 10:33:02.347237 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:33:02.346685    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r" podUID="d7599925-b7b1-4342-8574-14d3c3b0f292" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.42:8443: connect: connection refused"
Sep 08 10:33:04.346643 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:33:04.346603    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r"
Sep 08 10:33:04.347011 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:33:04.346659    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r"
Sep 08 10:33:04.347011 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:33:04.346672    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r"
Sep 08 10:33:04.347011 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:33:04.346683    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r"
Sep 08 10:33:05.347449 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:33:05.347415    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r"
Sep 08 10:33:05.347864 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:33:05.347592    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r"
Sep 08 10:33:05.347974 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:33:05.347953    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r"
Sep 08 10:33:05.348326 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:33:05.348304    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r"
Sep 08 10:33:05.348442 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:33:05.348426    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r"
Sep 08 10:33:05.348508 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:33:05.348480    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r"
Sep 08 10:33:05.352950 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:33:05.352932    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r"
Sep 08 10:33:05.581411 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:33:05.581385    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r"
Sep 08 10:34:08.196832 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:08.196792    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:34:08.205570 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:08.205511    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r"]
Sep 08 10:34:08.205980 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:08.205790    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r" podUID="d7599925-b7b1-4342-8574-14d3c3b0f292" containerName="registry" containerID="cri-o://ad853eca114b549c7181d20071a2b0fa0024ca3f3280b1e8722e66ab085e01ba" gracePeriod=30
Sep 08 10:34:08.205980 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:08.205825    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r" podUID="d7599925-b7b1-4342-8574-14d3c3b0f292" containerName="offline" containerID="cri-o://3aaea10fd7f7fae753f73841d3e41cbc2b66b66c0554bc53ed8a4c7b5954b81e" gracePeriod=30
Sep 08 10:34:08.205980 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:08.205840    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r" podUID="d7599925-b7b1-4342-8574-14d3c3b0f292" containerName="online" containerID="cri-o://7b4e8ce54354bbb3755a1baba8693c28bef788d69251d3bba1a7e664943fb709" gracePeriod=30
Sep 08 10:34:08.205980 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:08.205900    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r" podUID="d7599925-b7b1-4342-8574-14d3c3b0f292" containerName="ui" containerID="cri-o://38358551e3fa855bf0f02dcd53df47894f026bb01b069d1fb2858241f8d409b6" gracePeriod=30
Sep 08 10:34:08.688442 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:08.688406    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf"]
Sep 08 10:34:08.692243 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:08.692221    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf"
Sep 08 10:34:08.695933 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:08.695909    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-dmmpz\""
Sep 08 10:34:08.715373 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:08.715342    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf"]
Sep 08 10:34:08.851229 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:08.851195    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/883961d7-a8b9-4611-bccd-641a6b82048f-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-fswdf\" (UID: \"883961d7-a8b9-4611-bccd-641a6b82048f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf"
Sep 08 10:34:08.851361 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:08.851266    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/883961d7-a8b9-4611-bccd-641a6b82048f-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-fswdf\" (UID: \"883961d7-a8b9-4611-bccd-641a6b82048f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf"
Sep 08 10:34:08.851361 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:08.851323    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/883961d7-a8b9-4611-bccd-641a6b82048f-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-fswdf\" (UID: \"883961d7-a8b9-4611-bccd-641a6b82048f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf"
Sep 08 10:34:08.851528 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:08.851395    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/883961d7-a8b9-4611-bccd-641a6b82048f-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-fswdf\" (UID: \"883961d7-a8b9-4611-bccd-641a6b82048f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf"
Sep 08 10:34:08.851528 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:08.851485    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/883961d7-a8b9-4611-bccd-641a6b82048f-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-fswdf\" (UID: \"883961d7-a8b9-4611-bccd-641a6b82048f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf"
Sep 08 10:34:08.851641 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:08.851522    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlwpz\" (UniqueName: \"kubernetes.io/projected/883961d7-a8b9-4611-bccd-641a6b82048f-kube-api-access-qlwpz\") pod \"feast-simple-feast-setup-57576b8fcf-fswdf\" (UID: \"883961d7-a8b9-4611-bccd-641a6b82048f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf"
Sep 08 10:34:08.952432 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:08.952326    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/883961d7-a8b9-4611-bccd-641a6b82048f-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-fswdf\" (UID: \"883961d7-a8b9-4611-bccd-641a6b82048f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf"
Sep 08 10:34:08.952432 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:08.952375    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlwpz\" (UniqueName: \"kubernetes.io/projected/883961d7-a8b9-4611-bccd-641a6b82048f-kube-api-access-qlwpz\") pod \"feast-simple-feast-setup-57576b8fcf-fswdf\" (UID: \"883961d7-a8b9-4611-bccd-641a6b82048f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf"
Sep 08 10:34:08.952697 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:34:08.952496    2579 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Sep 08 10:34:08.952697 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:34:08.952614    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/883961d7-a8b9-4611-bccd-641a6b82048f-ui-tls podName:883961d7-a8b9-4611-bccd-641a6b82048f nodeName:}" failed. No retries permitted until 2026-09-08 10:34:09.452591256 +0000 UTC m=+2163.148190148 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/883961d7-a8b9-4611-bccd-641a6b82048f-ui-tls") pod "feast-simple-feast-setup-57576b8fcf-fswdf" (UID: "883961d7-a8b9-4611-bccd-641a6b82048f") : secret "feast-simple-feast-setup-ui-tls" not found
Sep 08 10:34:08.952697 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:08.952504    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/883961d7-a8b9-4611-bccd-641a6b82048f-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-fswdf\" (UID: \"883961d7-a8b9-4611-bccd-641a6b82048f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf"
Sep 08 10:34:08.952867 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:08.952713    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/883961d7-a8b9-4611-bccd-641a6b82048f-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-fswdf\" (UID: \"883961d7-a8b9-4611-bccd-641a6b82048f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf"
Sep 08 10:34:08.952867 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:08.952773    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/883961d7-a8b9-4611-bccd-641a6b82048f-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-fswdf\" (UID: \"883961d7-a8b9-4611-bccd-641a6b82048f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf"
Sep 08 10:34:08.952867 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:08.952823    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/883961d7-a8b9-4611-bccd-641a6b82048f-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-fswdf\" (UID: \"883961d7-a8b9-4611-bccd-641a6b82048f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf"
Sep 08 10:34:08.953098 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:08.953078    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/883961d7-a8b9-4611-bccd-641a6b82048f-feast-data\") pod \"feast-simple-feast-setup-57576b8fcf-fswdf\" (UID: \"883961d7-a8b9-4611-bccd-641a6b82048f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf"
Sep 08 10:34:08.955150 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:08.955122    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/883961d7-a8b9-4611-bccd-641a6b82048f-registry-tls\") pod \"feast-simple-feast-setup-57576b8fcf-fswdf\" (UID: \"883961d7-a8b9-4611-bccd-641a6b82048f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf"
Sep 08 10:34:08.955863 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:08.955841    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/883961d7-a8b9-4611-bccd-641a6b82048f-online-tls\") pod \"feast-simple-feast-setup-57576b8fcf-fswdf\" (UID: \"883961d7-a8b9-4611-bccd-641a6b82048f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf"
Sep 08 10:34:08.955948 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:08.955841    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/883961d7-a8b9-4611-bccd-641a6b82048f-offline-tls\") pod \"feast-simple-feast-setup-57576b8fcf-fswdf\" (UID: \"883961d7-a8b9-4611-bccd-641a6b82048f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf"
Sep 08 10:34:08.965129 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:08.965108    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlwpz\" (UniqueName: \"kubernetes.io/projected/883961d7-a8b9-4611-bccd-641a6b82048f-kube-api-access-qlwpz\") pod \"feast-simple-feast-setup-57576b8fcf-fswdf\" (UID: \"883961d7-a8b9-4611-bccd-641a6b82048f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf"
Sep 08 10:34:09.457217 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:09.457175    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/883961d7-a8b9-4611-bccd-641a6b82048f-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-fswdf\" (UID: \"883961d7-a8b9-4611-bccd-641a6b82048f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf"
Sep 08 10:34:09.459750 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:09.459732    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/883961d7-a8b9-4611-bccd-641a6b82048f-ui-tls\") pod \"feast-simple-feast-setup-57576b8fcf-fswdf\" (UID: \"883961d7-a8b9-4611-bccd-641a6b82048f\") " pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf"
Sep 08 10:34:09.602074 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:09.602045    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf"
Sep 08 10:34:09.611605 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:09.611573    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:34:09.841843 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:09.841811    2579 generic.go:356] "Generic (PLEG): container finished" podID="d7599925-b7b1-4342-8574-14d3c3b0f292" containerID="38358551e3fa855bf0f02dcd53df47894f026bb01b069d1fb2858241f8d409b6" exitCode=0
Sep 08 10:34:09.841843 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:09.841837    2579 generic.go:356] "Generic (PLEG): container finished" podID="d7599925-b7b1-4342-8574-14d3c3b0f292" containerID="7b4e8ce54354bbb3755a1baba8693c28bef788d69251d3bba1a7e664943fb709" exitCode=0
Sep 08 10:34:09.842027 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:09.841880    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r" event={"ID":"d7599925-b7b1-4342-8574-14d3c3b0f292","Type":"ContainerDied","Data":"38358551e3fa855bf0f02dcd53df47894f026bb01b069d1fb2858241f8d409b6"}
Sep 08 10:34:09.842027 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:09.841926    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r" event={"ID":"d7599925-b7b1-4342-8574-14d3c3b0f292","Type":"ContainerDied","Data":"7b4e8ce54354bbb3755a1baba8693c28bef788d69251d3bba1a7e664943fb709"}
Sep 08 10:34:09.895653 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:09.895625    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf"]
Sep 08 10:34:09.896656 ip-10-0-132-96 kubenswrapper[2579]: W0908 10:34:09.896631    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod883961d7_a8b9_4611_bccd_641a6b82048f.slice/crio-ca6f6d8b4eb4ad8efd649a29edf0c8bf67bc98296f1ed1a965a1da1f4a6c2283 WatchSource:0}: Error finding container ca6f6d8b4eb4ad8efd649a29edf0c8bf67bc98296f1ed1a965a1da1f4a6c2283: Status 404 returned error can't find the container with id ca6f6d8b4eb4ad8efd649a29edf0c8bf67bc98296f1ed1a965a1da1f4a6c2283
Sep 08 10:34:10.847660 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:10.847627    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf" event={"ID":"883961d7-a8b9-4611-bccd-641a6b82048f","Type":"ContainerStarted","Data":"ee18bdcf04fedafec7ad7e911572c4880c23a38a31abec2fd06e046b6a42b703"}
Sep 08 10:34:10.848022 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:10.847670    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf" event={"ID":"883961d7-a8b9-4611-bccd-641a6b82048f","Type":"ContainerStarted","Data":"ca6f6d8b4eb4ad8efd649a29edf0c8bf67bc98296f1ed1a965a1da1f4a6c2283"}
Sep 08 10:34:14.866885 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:14.866852    2579 generic.go:356] "Generic (PLEG): container finished" podID="883961d7-a8b9-4611-bccd-641a6b82048f" containerID="ee18bdcf04fedafec7ad7e911572c4880c23a38a31abec2fd06e046b6a42b703" exitCode=0
Sep 08 10:34:14.867280 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:14.866934    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf" event={"ID":"883961d7-a8b9-4611-bccd-641a6b82048f","Type":"ContainerDied","Data":"ee18bdcf04fedafec7ad7e911572c4880c23a38a31abec2fd06e046b6a42b703"}
Sep 08 10:34:15.348944 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:15.348886    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r" podUID="d7599925-b7b1-4342-8574-14d3c3b0f292" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.42:8443: connect: connection refused"
Sep 08 10:34:15.579185 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:15.579145    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r" podUID="d7599925-b7b1-4342-8574-14d3c3b0f292" containerName="online" probeResult="failure" output="Get \"https://10.133.0.42:6567/health\": dial tcp 10.133.0.42:6567: connect: connection refused"
Sep 08 10:34:15.873486 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:15.873454    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf" event={"ID":"883961d7-a8b9-4611-bccd-641a6b82048f","Type":"ContainerStarted","Data":"edb66845a64d6c99b12b7420a093043c36478c6b089d21e54878ad77b7966c86"}
Sep 08 10:34:16.298356 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:16.298317    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:34:16.371946 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:16.371908    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:34:20.896780 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:20.896699    2579 generic.go:356] "Generic (PLEG): container finished" podID="883961d7-a8b9-4611-bccd-641a6b82048f" containerID="edb66845a64d6c99b12b7420a093043c36478c6b089d21e54878ad77b7966c86" exitCode=0
Sep 08 10:34:20.896780 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:20.896770    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf" event={"ID":"883961d7-a8b9-4611-bccd-641a6b82048f","Type":"ContainerDied","Data":"edb66845a64d6c99b12b7420a093043c36478c6b089d21e54878ad77b7966c86"}
Sep 08 10:34:21.908579 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:21.908511    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf" event={"ID":"883961d7-a8b9-4611-bccd-641a6b82048f","Type":"ContainerStarted","Data":"2e0cf19991eb2f4d762f105824dc733c01447fda5bf0d57eb7059dc47fdf72cf"}
Sep 08 10:34:21.909057 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:21.908605    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf" event={"ID":"883961d7-a8b9-4611-bccd-641a6b82048f","Type":"ContainerStarted","Data":"7d8da3479de185a5d1188c4a03c16f6ce982837ccc203c5e84265a3b4522b187"}
Sep 08 10:34:21.909057 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:21.908628    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf" event={"ID":"883961d7-a8b9-4611-bccd-641a6b82048f","Type":"ContainerStarted","Data":"33ff18d382a47237c33eb61721de008886485712f2a588e5e294763127564630"}
Sep 08 10:34:21.909057 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:21.908645    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf" event={"ID":"883961d7-a8b9-4611-bccd-641a6b82048f","Type":"ContainerStarted","Data":"e306a744c1324532e7d982aec839867001ba69b2aa9bb826b3e32dcb9e13405b"}
Sep 08 10:34:21.940821 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:21.940729    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf" podStartSLOduration=13.940706246 podStartE2EDuration="13.940706246s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:34:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:34:21.938463764 +0000 UTC m=+2175.634062679" watchObservedRunningTime="2026-09-08 10:34:21.940706246 +0000 UTC m=+2175.636305147"
Sep 08 10:34:24.603233 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:24.603094    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf"
Sep 08 10:34:24.603233 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:24.603154    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf"
Sep 08 10:34:24.603233 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:24.603176    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf"
Sep 08 10:34:24.603233 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:24.603193    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf"
Sep 08 10:34:24.605316 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:24.605281    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf" podUID="883961d7-a8b9-4611-bccd-641a6b82048f" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.43:8816: connect: connection refused"
Sep 08 10:34:24.605572 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:24.605303    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf" podUID="883961d7-a8b9-4611-bccd-641a6b82048f" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.43:8443: connect: connection refused"
Sep 08 10:34:24.605668 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:24.605340    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf" podUID="883961d7-a8b9-4611-bccd-641a6b82048f" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.43:6571: connect: connection refused"
Sep 08 10:34:24.605668 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:24.605349    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf" podUID="883961d7-a8b9-4611-bccd-641a6b82048f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.43:6567/health\": dial tcp 10.133.0.43:6567: connect: connection refused"
Sep 08 10:34:25.348922 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:25.348858    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r" podUID="d7599925-b7b1-4342-8574-14d3c3b0f292" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.42:8443: connect: connection refused"
Sep 08 10:34:25.579140 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:25.579096    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r" podUID="d7599925-b7b1-4342-8574-14d3c3b0f292" containerName="online" probeResult="failure" output="Get \"https://10.133.0.42:6567/health\": dial tcp 10.133.0.42:6567: connect: connection refused"
Sep 08 10:34:27.603413 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:27.603354    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf" podUID="883961d7-a8b9-4611-bccd-641a6b82048f" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.43:8816: connect: connection refused"
Sep 08 10:34:27.603955 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:27.603354    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf" podUID="883961d7-a8b9-4611-bccd-641a6b82048f" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.43:6571: connect: connection refused"
Sep 08 10:34:27.603955 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:27.603360    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf" podUID="883961d7-a8b9-4611-bccd-641a6b82048f" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.43:8443: connect: connection refused"
Sep 08 10:34:27.604206 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:27.604171    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf" podUID="883961d7-a8b9-4611-bccd-641a6b82048f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.43:6567/health\": dial tcp 10.133.0.43:6567: connect: connection refused"
Sep 08 10:34:29.602931 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:29.602894    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf"
Sep 08 10:34:29.603304 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:29.602945    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf"
Sep 08 10:34:29.603304 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:29.602961    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf"
Sep 08 10:34:29.603304 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:29.602979    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf"
Sep 08 10:34:30.603752 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:30.603720    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf"
Sep 08 10:34:30.604208 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:30.603846    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf"
Sep 08 10:34:30.604208 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:30.604103    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf"
Sep 08 10:34:30.608872 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:30.608848    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf"
Sep 08 10:34:30.968796 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:30.968693    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf"
Sep 08 10:34:30.968796 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:30.968777    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf"
Sep 08 10:34:30.969023 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:30.968943    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf"
Sep 08 10:34:30.971415 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:30.971394    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf"
Sep 08 10:34:35.348898 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:35.348851    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r" podUID="d7599925-b7b1-4342-8574-14d3c3b0f292" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.42:8443: connect: connection refused"
Sep 08 10:34:35.349410 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:35.348996    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r"
Sep 08 10:34:35.578694 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:35.578656    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r" podUID="d7599925-b7b1-4342-8574-14d3c3b0f292" containerName="online" probeResult="failure" output="Get \"https://10.133.0.42:6567/health\": dial tcp 10.133.0.42:6567: connect: connection refused"
Sep 08 10:34:35.578871 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:35.578758    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r"
Sep 08 10:34:38.853992 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:38.853968    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r"
Sep 08 10:34:38.900362 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:38.900313    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d7599925-b7b1-4342-8574-14d3c3b0f292-ui-tls\") pod \"d7599925-b7b1-4342-8574-14d3c3b0f292\" (UID: \"d7599925-b7b1-4342-8574-14d3c3b0f292\") "
Sep 08 10:34:38.900563 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:38.900398    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d7599925-b7b1-4342-8574-14d3c3b0f292-registry-tls\") pod \"d7599925-b7b1-4342-8574-14d3c3b0f292\" (UID: \"d7599925-b7b1-4342-8574-14d3c3b0f292\") "
Sep 08 10:34:38.900563 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:38.900480    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d7599925-b7b1-4342-8574-14d3c3b0f292-offline-tls\") pod \"d7599925-b7b1-4342-8574-14d3c3b0f292\" (UID: \"d7599925-b7b1-4342-8574-14d3c3b0f292\") "
Sep 08 10:34:38.900563 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:38.900529    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d7599925-b7b1-4342-8574-14d3c3b0f292-online-tls\") pod \"d7599925-b7b1-4342-8574-14d3c3b0f292\" (UID: \"d7599925-b7b1-4342-8574-14d3c3b0f292\") "
Sep 08 10:34:38.900748 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:38.900593    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d7599925-b7b1-4342-8574-14d3c3b0f292-feast-data\") pod \"d7599925-b7b1-4342-8574-14d3c3b0f292\" (UID: \"d7599925-b7b1-4342-8574-14d3c3b0f292\") "
Sep 08 10:34:38.900748 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:38.900674    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-stlgq\" (UniqueName: \"kubernetes.io/projected/d7599925-b7b1-4342-8574-14d3c3b0f292-kube-api-access-stlgq\") pod \"d7599925-b7b1-4342-8574-14d3c3b0f292\" (UID: \"d7599925-b7b1-4342-8574-14d3c3b0f292\") "
Sep 08 10:34:38.901644 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:38.901612    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7599925-b7b1-4342-8574-14d3c3b0f292-feast-data" (OuterVolumeSpecName: "feast-data") pod "d7599925-b7b1-4342-8574-14d3c3b0f292" (UID: "d7599925-b7b1-4342-8574-14d3c3b0f292"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:34:38.903162 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:38.903119    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7599925-b7b1-4342-8574-14d3c3b0f292-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "d7599925-b7b1-4342-8574-14d3c3b0f292" (UID: "d7599925-b7b1-4342-8574-14d3c3b0f292"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:34:38.903277 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:38.903189    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7599925-b7b1-4342-8574-14d3c3b0f292-online-tls" (OuterVolumeSpecName: "online-tls") pod "d7599925-b7b1-4342-8574-14d3c3b0f292" (UID: "d7599925-b7b1-4342-8574-14d3c3b0f292"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:34:38.903418 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:38.903402    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7599925-b7b1-4342-8574-14d3c3b0f292-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "d7599925-b7b1-4342-8574-14d3c3b0f292" (UID: "d7599925-b7b1-4342-8574-14d3c3b0f292"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:34:38.903481 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:38.903458    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7599925-b7b1-4342-8574-14d3c3b0f292-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d7599925-b7b1-4342-8574-14d3c3b0f292" (UID: "d7599925-b7b1-4342-8574-14d3c3b0f292"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:34:38.903561 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:38.903494    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7599925-b7b1-4342-8574-14d3c3b0f292-kube-api-access-stlgq" (OuterVolumeSpecName: "kube-api-access-stlgq") pod "d7599925-b7b1-4342-8574-14d3c3b0f292" (UID: "d7599925-b7b1-4342-8574-14d3c3b0f292"). InnerVolumeSpecName "kube-api-access-stlgq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:34:39.001666 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:39.001594    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-stlgq\" (UniqueName: \"kubernetes.io/projected/d7599925-b7b1-4342-8574-14d3c3b0f292-kube-api-access-stlgq\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:34:39.001666 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:39.001617    2579 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d7599925-b7b1-4342-8574-14d3c3b0f292-ui-tls\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:34:39.001666 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:39.001631    2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/d7599925-b7b1-4342-8574-14d3c3b0f292-registry-tls\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:34:39.001666 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:39.001643    2579 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d7599925-b7b1-4342-8574-14d3c3b0f292-offline-tls\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:34:39.001666 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:39.001650    2579 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d7599925-b7b1-4342-8574-14d3c3b0f292-online-tls\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:34:39.001666 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:39.001657    2579 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d7599925-b7b1-4342-8574-14d3c3b0f292-feast-data\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:34:39.004067 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:39.004036    2579 generic.go:356] "Generic (PLEG): container finished" podID="d7599925-b7b1-4342-8574-14d3c3b0f292" containerID="3aaea10fd7f7fae753f73841d3e41cbc2b66b66c0554bc53ed8a4c7b5954b81e" exitCode=137
Sep 08 10:34:39.004067 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:39.004067    2579 generic.go:356] "Generic (PLEG): container finished" podID="d7599925-b7b1-4342-8574-14d3c3b0f292" containerID="ad853eca114b549c7181d20071a2b0fa0024ca3f3280b1e8722e66ab085e01ba" exitCode=137
Sep 08 10:34:39.004203 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:39.004090    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r" event={"ID":"d7599925-b7b1-4342-8574-14d3c3b0f292","Type":"ContainerDied","Data":"3aaea10fd7f7fae753f73841d3e41cbc2b66b66c0554bc53ed8a4c7b5954b81e"}
Sep 08 10:34:39.004203 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:39.004122    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r"
Sep 08 10:34:39.004203 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:39.004133    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r" event={"ID":"d7599925-b7b1-4342-8574-14d3c3b0f292","Type":"ContainerDied","Data":"ad853eca114b549c7181d20071a2b0fa0024ca3f3280b1e8722e66ab085e01ba"}
Sep 08 10:34:39.004203 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:39.004153    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r" event={"ID":"d7599925-b7b1-4342-8574-14d3c3b0f292","Type":"ContainerDied","Data":"022e490224c13993527347f36c2d908fe68fdfad4d7d5c613b72e2a814d70fd3"}
Sep 08 10:34:39.004203 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:39.004176    2579 scope.go:117] "RemoveContainer" containerID="38358551e3fa855bf0f02dcd53df47894f026bb01b069d1fb2858241f8d409b6"
Sep 08 10:34:39.012743 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:39.012725    2579 scope.go:117] "RemoveContainer" containerID="3aaea10fd7f7fae753f73841d3e41cbc2b66b66c0554bc53ed8a4c7b5954b81e"
Sep 08 10:34:39.020723 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:39.020705    2579 scope.go:117] "RemoveContainer" containerID="7b4e8ce54354bbb3755a1baba8693c28bef788d69251d3bba1a7e664943fb709"
Sep 08 10:34:39.027058 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:39.027034    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r"]
Sep 08 10:34:39.028710 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:39.028679    2579 scope.go:117] "RemoveContainer" containerID="ad853eca114b549c7181d20071a2b0fa0024ca3f3280b1e8722e66ab085e01ba"
Sep 08 10:34:39.031020 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:39.031000    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-n988r"]
Sep 08 10:34:39.038775 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:39.038753    2579 scope.go:117] "RemoveContainer" containerID="7e9162d2b63da67b5bb78121efb2b9def215e5126dddc142849273b8083e04f3"
Sep 08 10:34:39.046282 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:39.046258    2579 scope.go:117] "RemoveContainer" containerID="7896601f4bd8c0ade2c85e9229bcb31aaf1952a7fd196b6c732df15cd45c8a19"
Sep 08 10:34:39.053631 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:39.053615    2579 scope.go:117] "RemoveContainer" containerID="38358551e3fa855bf0f02dcd53df47894f026bb01b069d1fb2858241f8d409b6"
Sep 08 10:34:39.053892 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:34:39.053875    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38358551e3fa855bf0f02dcd53df47894f026bb01b069d1fb2858241f8d409b6\": container with ID starting with 38358551e3fa855bf0f02dcd53df47894f026bb01b069d1fb2858241f8d409b6 not found: ID does not exist" containerID="38358551e3fa855bf0f02dcd53df47894f026bb01b069d1fb2858241f8d409b6"
Sep 08 10:34:39.053939 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:39.053899    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38358551e3fa855bf0f02dcd53df47894f026bb01b069d1fb2858241f8d409b6"} err="failed to get container status \"38358551e3fa855bf0f02dcd53df47894f026bb01b069d1fb2858241f8d409b6\": rpc error: code = NotFound desc = could not find container \"38358551e3fa855bf0f02dcd53df47894f026bb01b069d1fb2858241f8d409b6\": container with ID starting with 38358551e3fa855bf0f02dcd53df47894f026bb01b069d1fb2858241f8d409b6 not found: ID does not exist"
Sep 08 10:34:39.053939 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:39.053916    2579 scope.go:117] "RemoveContainer" containerID="3aaea10fd7f7fae753f73841d3e41cbc2b66b66c0554bc53ed8a4c7b5954b81e"
Sep 08 10:34:39.054151 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:34:39.054136    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3aaea10fd7f7fae753f73841d3e41cbc2b66b66c0554bc53ed8a4c7b5954b81e\": container with ID starting with 3aaea10fd7f7fae753f73841d3e41cbc2b66b66c0554bc53ed8a4c7b5954b81e not found: ID does not exist" containerID="3aaea10fd7f7fae753f73841d3e41cbc2b66b66c0554bc53ed8a4c7b5954b81e"
Sep 08 10:34:39.054197 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:39.054155    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3aaea10fd7f7fae753f73841d3e41cbc2b66b66c0554bc53ed8a4c7b5954b81e"} err="failed to get container status \"3aaea10fd7f7fae753f73841d3e41cbc2b66b66c0554bc53ed8a4c7b5954b81e\": rpc error: code = NotFound desc = could not find container \"3aaea10fd7f7fae753f73841d3e41cbc2b66b66c0554bc53ed8a4c7b5954b81e\": container with ID starting with 3aaea10fd7f7fae753f73841d3e41cbc2b66b66c0554bc53ed8a4c7b5954b81e not found: ID does not exist"
Sep 08 10:34:39.054197 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:39.054169    2579 scope.go:117] "RemoveContainer" containerID="7b4e8ce54354bbb3755a1baba8693c28bef788d69251d3bba1a7e664943fb709"
Sep 08 10:34:39.054397 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:34:39.054379    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b4e8ce54354bbb3755a1baba8693c28bef788d69251d3bba1a7e664943fb709\": container with ID starting with 7b4e8ce54354bbb3755a1baba8693c28bef788d69251d3bba1a7e664943fb709 not found: ID does not exist" containerID="7b4e8ce54354bbb3755a1baba8693c28bef788d69251d3bba1a7e664943fb709"
Sep 08 10:34:39.054455 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:39.054402    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b4e8ce54354bbb3755a1baba8693c28bef788d69251d3bba1a7e664943fb709"} err="failed to get container status \"7b4e8ce54354bbb3755a1baba8693c28bef788d69251d3bba1a7e664943fb709\": rpc error: code = NotFound desc = could not find container \"7b4e8ce54354bbb3755a1baba8693c28bef788d69251d3bba1a7e664943fb709\": container with ID starting with 7b4e8ce54354bbb3755a1baba8693c28bef788d69251d3bba1a7e664943fb709 not found: ID does not exist"
Sep 08 10:34:39.054455 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:39.054418    2579 scope.go:117] "RemoveContainer" containerID="ad853eca114b549c7181d20071a2b0fa0024ca3f3280b1e8722e66ab085e01ba"
Sep 08 10:34:39.054701 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:34:39.054683    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad853eca114b549c7181d20071a2b0fa0024ca3f3280b1e8722e66ab085e01ba\": container with ID starting with ad853eca114b549c7181d20071a2b0fa0024ca3f3280b1e8722e66ab085e01ba not found: ID does not exist" containerID="ad853eca114b549c7181d20071a2b0fa0024ca3f3280b1e8722e66ab085e01ba"
Sep 08 10:34:39.054769 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:39.054705    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad853eca114b549c7181d20071a2b0fa0024ca3f3280b1e8722e66ab085e01ba"} err="failed to get container status \"ad853eca114b549c7181d20071a2b0fa0024ca3f3280b1e8722e66ab085e01ba\": rpc error: code = NotFound desc = could not find container \"ad853eca114b549c7181d20071a2b0fa0024ca3f3280b1e8722e66ab085e01ba\": container with ID starting with ad853eca114b549c7181d20071a2b0fa0024ca3f3280b1e8722e66ab085e01ba not found: ID does not exist"
Sep 08 10:34:39.054769 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:39.054716    2579 scope.go:117] "RemoveContainer" containerID="7e9162d2b63da67b5bb78121efb2b9def215e5126dddc142849273b8083e04f3"
Sep 08 10:34:39.054932 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:34:39.054917    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e9162d2b63da67b5bb78121efb2b9def215e5126dddc142849273b8083e04f3\": container with ID starting with 7e9162d2b63da67b5bb78121efb2b9def215e5126dddc142849273b8083e04f3 not found: ID does not exist" containerID="7e9162d2b63da67b5bb78121efb2b9def215e5126dddc142849273b8083e04f3"
Sep 08 10:34:39.054976 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:39.054938    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e9162d2b63da67b5bb78121efb2b9def215e5126dddc142849273b8083e04f3"} err="failed to get container status \"7e9162d2b63da67b5bb78121efb2b9def215e5126dddc142849273b8083e04f3\": rpc error: code = NotFound desc = could not find container \"7e9162d2b63da67b5bb78121efb2b9def215e5126dddc142849273b8083e04f3\": container with ID starting with 7e9162d2b63da67b5bb78121efb2b9def215e5126dddc142849273b8083e04f3 not found: ID does not exist"
Sep 08 10:34:39.054976 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:39.054962    2579 scope.go:117] "RemoveContainer" containerID="7896601f4bd8c0ade2c85e9229bcb31aaf1952a7fd196b6c732df15cd45c8a19"
Sep 08 10:34:39.055206 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:34:39.055185    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7896601f4bd8c0ade2c85e9229bcb31aaf1952a7fd196b6c732df15cd45c8a19\": container with ID starting with 7896601f4bd8c0ade2c85e9229bcb31aaf1952a7fd196b6c732df15cd45c8a19 not found: ID does not exist" containerID="7896601f4bd8c0ade2c85e9229bcb31aaf1952a7fd196b6c732df15cd45c8a19"
Sep 08 10:34:39.055258 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:39.055208    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7896601f4bd8c0ade2c85e9229bcb31aaf1952a7fd196b6c732df15cd45c8a19"} err="failed to get container status \"7896601f4bd8c0ade2c85e9229bcb31aaf1952a7fd196b6c732df15cd45c8a19\": rpc error: code = NotFound desc = could not find container \"7896601f4bd8c0ade2c85e9229bcb31aaf1952a7fd196b6c732df15cd45c8a19\": container with ID starting with 7896601f4bd8c0ade2c85e9229bcb31aaf1952a7fd196b6c732df15cd45c8a19 not found: ID does not exist"
Sep 08 10:34:39.055258 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:39.055219    2579 scope.go:117] "RemoveContainer" containerID="38358551e3fa855bf0f02dcd53df47894f026bb01b069d1fb2858241f8d409b6"
Sep 08 10:34:39.055451 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:39.055430    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38358551e3fa855bf0f02dcd53df47894f026bb01b069d1fb2858241f8d409b6"} err="failed to get container status \"38358551e3fa855bf0f02dcd53df47894f026bb01b069d1fb2858241f8d409b6\": rpc error: code = NotFound desc = could not find container \"38358551e3fa855bf0f02dcd53df47894f026bb01b069d1fb2858241f8d409b6\": container with ID starting with 38358551e3fa855bf0f02dcd53df47894f026bb01b069d1fb2858241f8d409b6 not found: ID does not exist"
Sep 08 10:34:39.055499 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:39.055451    2579 scope.go:117] "RemoveContainer" containerID="3aaea10fd7f7fae753f73841d3e41cbc2b66b66c0554bc53ed8a4c7b5954b81e"
Sep 08 10:34:39.055756 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:39.055739    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3aaea10fd7f7fae753f73841d3e41cbc2b66b66c0554bc53ed8a4c7b5954b81e"} err="failed to get container status \"3aaea10fd7f7fae753f73841d3e41cbc2b66b66c0554bc53ed8a4c7b5954b81e\": rpc error: code = NotFound desc = could not find container \"3aaea10fd7f7fae753f73841d3e41cbc2b66b66c0554bc53ed8a4c7b5954b81e\": container with ID starting with 3aaea10fd7f7fae753f73841d3e41cbc2b66b66c0554bc53ed8a4c7b5954b81e not found: ID does not exist"
Sep 08 10:34:39.055756 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:39.055756    2579 scope.go:117] "RemoveContainer" containerID="7b4e8ce54354bbb3755a1baba8693c28bef788d69251d3bba1a7e664943fb709"
Sep 08 10:34:39.056006 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:39.055986    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b4e8ce54354bbb3755a1baba8693c28bef788d69251d3bba1a7e664943fb709"} err="failed to get container status \"7b4e8ce54354bbb3755a1baba8693c28bef788d69251d3bba1a7e664943fb709\": rpc error: code = NotFound desc = could not find container \"7b4e8ce54354bbb3755a1baba8693c28bef788d69251d3bba1a7e664943fb709\": container with ID starting with 7b4e8ce54354bbb3755a1baba8693c28bef788d69251d3bba1a7e664943fb709 not found: ID does not exist"
Sep 08 10:34:39.056062 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:39.056006    2579 scope.go:117] "RemoveContainer" containerID="ad853eca114b549c7181d20071a2b0fa0024ca3f3280b1e8722e66ab085e01ba"
Sep 08 10:34:39.056224 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:39.056206    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad853eca114b549c7181d20071a2b0fa0024ca3f3280b1e8722e66ab085e01ba"} err="failed to get container status \"ad853eca114b549c7181d20071a2b0fa0024ca3f3280b1e8722e66ab085e01ba\": rpc error: code = NotFound desc = could not find container \"ad853eca114b549c7181d20071a2b0fa0024ca3f3280b1e8722e66ab085e01ba\": container with ID starting with ad853eca114b549c7181d20071a2b0fa0024ca3f3280b1e8722e66ab085e01ba not found: ID does not exist"
Sep 08 10:34:39.056271 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:39.056224    2579 scope.go:117] "RemoveContainer" containerID="7e9162d2b63da67b5bb78121efb2b9def215e5126dddc142849273b8083e04f3"
Sep 08 10:34:39.056477 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:39.056462    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e9162d2b63da67b5bb78121efb2b9def215e5126dddc142849273b8083e04f3"} err="failed to get container status \"7e9162d2b63da67b5bb78121efb2b9def215e5126dddc142849273b8083e04f3\": rpc error: code = NotFound desc = could not find container \"7e9162d2b63da67b5bb78121efb2b9def215e5126dddc142849273b8083e04f3\": container with ID starting with 7e9162d2b63da67b5bb78121efb2b9def215e5126dddc142849273b8083e04f3 not found: ID does not exist"
Sep 08 10:34:39.056568 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:39.056478    2579 scope.go:117] "RemoveContainer" containerID="7896601f4bd8c0ade2c85e9229bcb31aaf1952a7fd196b6c732df15cd45c8a19"
Sep 08 10:34:39.056713 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:39.056695    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7896601f4bd8c0ade2c85e9229bcb31aaf1952a7fd196b6c732df15cd45c8a19"} err="failed to get container status \"7896601f4bd8c0ade2c85e9229bcb31aaf1952a7fd196b6c732df15cd45c8a19\": rpc error: code = NotFound desc = could not find container \"7896601f4bd8c0ade2c85e9229bcb31aaf1952a7fd196b6c732df15cd45c8a19\": container with ID starting with 7896601f4bd8c0ade2c85e9229bcb31aaf1952a7fd196b6c732df15cd45c8a19 not found: ID does not exist"
Sep 08 10:34:40.831830 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:34:40.831797    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7599925-b7b1-4342-8574-14d3c3b0f292" path="/var/lib/kubelet/pods/d7599925-b7b1-4342-8574-14d3c3b0f292/volumes"
Sep 08 10:35:32.718881 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:32.718800    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:35:32.818523 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:32.818480    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:35:33.108305 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:33.108269    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:35:33.206282 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:33.206248    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:35:33.224394 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:33.224367    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf"]
Sep 08 10:35:33.224870 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:33.224853    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7599925-b7b1-4342-8574-14d3c3b0f292" containerName="feast-apply"
Sep 08 10:35:33.224943 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:33.224873    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7599925-b7b1-4342-8574-14d3c3b0f292" containerName="feast-apply"
Sep 08 10:35:33.224943 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:33.224894    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7599925-b7b1-4342-8574-14d3c3b0f292" containerName="registry"
Sep 08 10:35:33.224943 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:33.224902    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7599925-b7b1-4342-8574-14d3c3b0f292" containerName="registry"
Sep 08 10:35:33.224943 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:33.224914    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7599925-b7b1-4342-8574-14d3c3b0f292" containerName="online"
Sep 08 10:35:33.224943 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:33.224922    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7599925-b7b1-4342-8574-14d3c3b0f292" containerName="online"
Sep 08 10:35:33.224943 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:33.224932    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7599925-b7b1-4342-8574-14d3c3b0f292" containerName="ui"
Sep 08 10:35:33.224943 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:33.224942    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7599925-b7b1-4342-8574-14d3c3b0f292" containerName="ui"
Sep 08 10:35:33.225204 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:33.224960    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7599925-b7b1-4342-8574-14d3c3b0f292" containerName="feast-init"
Sep 08 10:35:33.225204 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:33.224967    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7599925-b7b1-4342-8574-14d3c3b0f292" containerName="feast-init"
Sep 08 10:35:33.225204 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:33.224976    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7599925-b7b1-4342-8574-14d3c3b0f292" containerName="offline"
Sep 08 10:35:33.225204 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:33.224982    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7599925-b7b1-4342-8574-14d3c3b0f292" containerName="offline"
Sep 08 10:35:33.225204 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:33.225047    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7599925-b7b1-4342-8574-14d3c3b0f292" containerName="registry"
Sep 08 10:35:33.225204 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:33.225059    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7599925-b7b1-4342-8574-14d3c3b0f292" containerName="offline"
Sep 08 10:35:33.225204 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:33.225068    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7599925-b7b1-4342-8574-14d3c3b0f292" containerName="ui"
Sep 08 10:35:33.225204 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:33.225074    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7599925-b7b1-4342-8574-14d3c3b0f292" containerName="online"
Sep 08 10:35:33.228676 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:33.228656    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf"
Sep 08 10:35:33.231629 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:33.231605    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Sep 08 10:35:33.231742 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:33.231605    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Sep 08 10:35:33.231742 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:33.231682    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Sep 08 10:35:33.231742 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:33.231714    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Sep 08 10:35:33.231917 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:33.231838    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-gmffm\""
Sep 08 10:35:33.231917 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:33.231840    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Sep 08 10:35:33.232152 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:33.232135    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Sep 08 10:35:33.244100 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:33.244078    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf"]
Sep 08 10:35:33.329336 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:33.329290    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9g52h\" (UniqueName: \"kubernetes.io/projected/021d1216-c519-4cc2-8529-68e0f5bd35bb-kube-api-access-9g52h\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-mdmtf\" (UID: \"021d1216-c519-4cc2-8529-68e0f5bd35bb\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf"
Sep 08 10:35:33.329336 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:33.329342    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/021d1216-c519-4cc2-8529-68e0f5bd35bb-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-mdmtf\" (UID: \"021d1216-c519-4cc2-8529-68e0f5bd35bb\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf"
Sep 08 10:35:33.329588 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:33.329365    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/021d1216-c519-4cc2-8529-68e0f5bd35bb-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-mdmtf\" (UID: \"021d1216-c519-4cc2-8529-68e0f5bd35bb\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf"
Sep 08 10:35:33.329588 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:33.329428    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/021d1216-c519-4cc2-8529-68e0f5bd35bb-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-mdmtf\" (UID: \"021d1216-c519-4cc2-8529-68e0f5bd35bb\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf"
Sep 08 10:35:33.329588 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:33.329472    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/021d1216-c519-4cc2-8529-68e0f5bd35bb-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-mdmtf\" (UID: \"021d1216-c519-4cc2-8529-68e0f5bd35bb\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf"
Sep 08 10:35:33.329588 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:33.329488    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/021d1216-c519-4cc2-8529-68e0f5bd35bb-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-mdmtf\" (UID: \"021d1216-c519-4cc2-8529-68e0f5bd35bb\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf"
Sep 08 10:35:33.430970 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:33.430887    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/021d1216-c519-4cc2-8529-68e0f5bd35bb-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-mdmtf\" (UID: \"021d1216-c519-4cc2-8529-68e0f5bd35bb\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf"
Sep 08 10:35:33.430970 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:33.430931    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/021d1216-c519-4cc2-8529-68e0f5bd35bb-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-mdmtf\" (UID: \"021d1216-c519-4cc2-8529-68e0f5bd35bb\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf"
Sep 08 10:35:33.430970 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:33.430968    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/021d1216-c519-4cc2-8529-68e0f5bd35bb-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-mdmtf\" (UID: \"021d1216-c519-4cc2-8529-68e0f5bd35bb\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf"
Sep 08 10:35:33.431228 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:33.431021    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9g52h\" (UniqueName: \"kubernetes.io/projected/021d1216-c519-4cc2-8529-68e0f5bd35bb-kube-api-access-9g52h\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-mdmtf\" (UID: \"021d1216-c519-4cc2-8529-68e0f5bd35bb\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf"
Sep 08 10:35:33.431228 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:33.431049    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/021d1216-c519-4cc2-8529-68e0f5bd35bb-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-mdmtf\" (UID: \"021d1216-c519-4cc2-8529-68e0f5bd35bb\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf"
Sep 08 10:35:33.431228 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:35:33.431047    2579 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found
Sep 08 10:35:33.431228 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:35:33.431144    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/021d1216-c519-4cc2-8529-68e0f5bd35bb-ui-tls podName:021d1216-c519-4cc2-8529-68e0f5bd35bb nodeName:}" failed. No retries permitted until 2026-09-08 10:35:33.931119997 +0000 UTC m=+2247.626718895 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/021d1216-c519-4cc2-8529-68e0f5bd35bb-ui-tls") pod "feast-simple-feast-remote-setup-c5d49d8c6-mdmtf" (UID: "021d1216-c519-4cc2-8529-68e0f5bd35bb") : secret "feast-simple-feast-remote-setup-ui-tls" not found
Sep 08 10:35:33.431228 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:33.431186    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/021d1216-c519-4cc2-8529-68e0f5bd35bb-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-mdmtf\" (UID: \"021d1216-c519-4cc2-8529-68e0f5bd35bb\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf"
Sep 08 10:35:33.431503 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:33.431440    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/021d1216-c519-4cc2-8529-68e0f5bd35bb-feast-data\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-mdmtf\" (UID: \"021d1216-c519-4cc2-8529-68e0f5bd35bb\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf"
Sep 08 10:35:33.431904 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:33.431881    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/021d1216-c519-4cc2-8529-68e0f5bd35bb-registry-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-mdmtf\" (UID: \"021d1216-c519-4cc2-8529-68e0f5bd35bb\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf"
Sep 08 10:35:33.433648 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:33.433627    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/021d1216-c519-4cc2-8529-68e0f5bd35bb-online-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-mdmtf\" (UID: \"021d1216-c519-4cc2-8529-68e0f5bd35bb\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf"
Sep 08 10:35:33.433747 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:33.433672    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/021d1216-c519-4cc2-8529-68e0f5bd35bb-offline-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-mdmtf\" (UID: \"021d1216-c519-4cc2-8529-68e0f5bd35bb\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf"
Sep 08 10:35:33.442106 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:33.442075    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g52h\" (UniqueName: \"kubernetes.io/projected/021d1216-c519-4cc2-8529-68e0f5bd35bb-kube-api-access-9g52h\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-mdmtf\" (UID: \"021d1216-c519-4cc2-8529-68e0f5bd35bb\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf"
Sep 08 10:35:33.475018 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:33.474992    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:35:33.577149 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:33.577118    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:35:33.935441 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:33.935402    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/021d1216-c519-4cc2-8529-68e0f5bd35bb-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-mdmtf\" (UID: \"021d1216-c519-4cc2-8529-68e0f5bd35bb\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf"
Sep 08 10:35:33.938100 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:33.938077    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/021d1216-c519-4cc2-8529-68e0f5bd35bb-ui-tls\") pod \"feast-simple-feast-remote-setup-c5d49d8c6-mdmtf\" (UID: \"021d1216-c519-4cc2-8529-68e0f5bd35bb\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf"
Sep 08 10:35:34.138032 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:34.137988    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf"
Sep 08 10:35:34.414596 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:34.414571    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf"]
Sep 08 10:35:34.416315 ip-10-0-132-96 kubenswrapper[2579]: W0908 10:35:34.416285    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod021d1216_c519_4cc2_8529_68e0f5bd35bb.slice/crio-989c6244758773b365fcdd2b12016366a7a0699d6d86e5bc372af2ed37fa5cb9 WatchSource:0}: Error finding container 989c6244758773b365fcdd2b12016366a7a0699d6d86e5bc372af2ed37fa5cb9: Status 404 returned error can't find the container with id 989c6244758773b365fcdd2b12016366a7a0699d6d86e5bc372af2ed37fa5cb9
Sep 08 10:35:35.237501 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:35.237459    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf" event={"ID":"021d1216-c519-4cc2-8529-68e0f5bd35bb","Type":"ContainerStarted","Data":"5de04482b158d10929ba3cd75a7efe4852470b1bf5910417e020f827ab5e65ef"}
Sep 08 10:35:35.238060 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:35.237515    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf" event={"ID":"021d1216-c519-4cc2-8529-68e0f5bd35bb","Type":"ContainerStarted","Data":"989c6244758773b365fcdd2b12016366a7a0699d6d86e5bc372af2ed37fa5cb9"}
Sep 08 10:35:40.260746 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:40.260712    2579 generic.go:356] "Generic (PLEG): container finished" podID="021d1216-c519-4cc2-8529-68e0f5bd35bb" containerID="5de04482b158d10929ba3cd75a7efe4852470b1bf5910417e020f827ab5e65ef" exitCode=0
Sep 08 10:35:40.261231 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:40.260795    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf" event={"ID":"021d1216-c519-4cc2-8529-68e0f5bd35bb","Type":"ContainerDied","Data":"5de04482b158d10929ba3cd75a7efe4852470b1bf5910417e020f827ab5e65ef"}
Sep 08 10:35:41.266994 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:35:41.266959    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf" event={"ID":"021d1216-c519-4cc2-8529-68e0f5bd35bb","Type":"ContainerStarted","Data":"16dc8fe46574ec8fa1f0a01ac16e2ab1faf92c4b3a6225b282c2e6ffd69f2953"}
Sep 08 10:36:04.372348 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:36:04.372306    2579 generic.go:356] "Generic (PLEG): container finished" podID="021d1216-c519-4cc2-8529-68e0f5bd35bb" containerID="16dc8fe46574ec8fa1f0a01ac16e2ab1faf92c4b3a6225b282c2e6ffd69f2953" exitCode=0
Sep 08 10:36:04.372765 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:36:04.372378    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf" event={"ID":"021d1216-c519-4cc2-8529-68e0f5bd35bb","Type":"ContainerDied","Data":"16dc8fe46574ec8fa1f0a01ac16e2ab1faf92c4b3a6225b282c2e6ffd69f2953"}
Sep 08 10:36:05.381532 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:36:05.381489    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf" event={"ID":"021d1216-c519-4cc2-8529-68e0f5bd35bb","Type":"ContainerStarted","Data":"db07750db3118c951fc27cbe9007129b980bfdfae14358f454d3bb6ea02fa6bf"}
Sep 08 10:36:05.381962 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:36:05.381578    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf" event={"ID":"021d1216-c519-4cc2-8529-68e0f5bd35bb","Type":"ContainerStarted","Data":"96855aee456be0d3f4e00c8e42c07fbf96d1d1bed317cfed4752b45877ed5968"}
Sep 08 10:36:05.381962 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:36:05.381599    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf" event={"ID":"021d1216-c519-4cc2-8529-68e0f5bd35bb","Type":"ContainerStarted","Data":"dcdf9ec1ddc1ada90f300fb9679695b56a4d23727bcdc8ce19ebb68f85b857f0"}
Sep 08 10:36:05.406478 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:36:05.406423    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf" podStartSLOduration=32.406396638 podStartE2EDuration="32.406396638s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:35:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:36:05.405007911 +0000 UTC m=+2279.100606812" watchObservedRunningTime="2026-09-08 10:36:05.406396638 +0000 UTC m=+2279.101995543"
Sep 08 10:36:07.139046 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:36:07.138380    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf"
Sep 08 10:36:07.139574 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:36:07.139095    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf"
Sep 08 10:36:07.139574 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:36:07.139122    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf"
Sep 08 10:36:07.140564 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:36:07.140498    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf" podUID="021d1216-c519-4cc2-8529-68e0f5bd35bb" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.44:8443: connect: connection refused"
Sep 08 10:36:07.140564 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:36:07.140515    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf" podUID="021d1216-c519-4cc2-8529-68e0f5bd35bb" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.44:8816: connect: connection refused"
Sep 08 10:36:07.140786 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:36:07.140590    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf" podUID="021d1216-c519-4cc2-8529-68e0f5bd35bb" containerName="online" probeResult="failure" output="Get \"https://10.133.0.44:6567/health\": dial tcp 10.133.0.44:6567: connect: connection refused"
Sep 08 10:36:10.139071 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:36:10.139024    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf" podUID="021d1216-c519-4cc2-8529-68e0f5bd35bb" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.44:8816: connect: connection refused"
Sep 08 10:36:10.139568 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:36:10.139049    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf" podUID="021d1216-c519-4cc2-8529-68e0f5bd35bb" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.44:8443: connect: connection refused"
Sep 08 10:36:10.139568 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:36:10.139094    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf" podUID="021d1216-c519-4cc2-8529-68e0f5bd35bb" containerName="online" probeResult="failure" output="Get \"https://10.133.0.44:6567/health\": dial tcp 10.133.0.44:6567: connect: connection refused"
Sep 08 10:36:13.138906 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:36:13.138874    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf"
Sep 08 10:36:13.139454 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:36:13.139431    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf"
Sep 08 10:36:13.139582 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:36:13.139474    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf"
Sep 08 10:36:13.139684 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:36:13.139670    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf"
Sep 08 10:36:13.425426 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:36:13.425344    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf"
Sep 08 10:36:13.425954 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:36:13.425934    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf"
Sep 08 10:36:14.138908 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:36:14.138859    2579 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf" podUID="021d1216-c519-4cc2-8529-68e0f5bd35bb" containerName="online" probeResult="failure" output="Get \"https://10.133.0.44:6567/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Sep 08 10:36:14.139112 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:36:14.138930    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf"
Sep 08 10:36:16.892088 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:36:16.892059    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf"
Sep 08 10:36:17.759583 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:36:17.759529    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf"
Sep 08 10:36:49.245390 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:36:49.245352    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:36:52.949271 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:36:52.949233    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:37:15.142697 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:15.142653    2579 prober.go:120] "Probe failed" probeType="Liveness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf" podUID="021d1216-c519-4cc2-8529-68e0f5bd35bb" containerName="online" probeResult="failure" output="Get \"https://10.133.0.44:6567/health\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Sep 08 10:37:19.206050 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:19.206005    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf"]
Sep 08 10:37:19.206510 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:19.206317    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf" podUID="021d1216-c519-4cc2-8529-68e0f5bd35bb" containerName="online" containerID="cri-o://dcdf9ec1ddc1ada90f300fb9679695b56a4d23727bcdc8ce19ebb68f85b857f0" gracePeriod=30
Sep 08 10:37:19.206510 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:19.206391    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf" podUID="021d1216-c519-4cc2-8529-68e0f5bd35bb" containerName="ui" containerID="cri-o://db07750db3118c951fc27cbe9007129b980bfdfae14358f454d3bb6ea02fa6bf" gracePeriod=30
Sep 08 10:37:19.206658 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:19.206405    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf" podUID="021d1216-c519-4cc2-8529-68e0f5bd35bb" containerName="offline" containerID="cri-o://96855aee456be0d3f4e00c8e42c07fbf96d1d1bed317cfed4752b45877ed5968" gracePeriod=30
Sep 08 10:37:19.221796 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:19.221772    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:37:19.291135 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:19.291083    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:37:19.363186 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:19.363150    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf"]
Sep 08 10:37:19.363468 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:19.363439    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf" podUID="883961d7-a8b9-4611-bccd-641a6b82048f" containerName="registry" containerID="cri-o://e306a744c1324532e7d982aec839867001ba69b2aa9bb826b3e32dcb9e13405b" gracePeriod=30
Sep 08 10:37:19.363709 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:19.363565    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf" podUID="883961d7-a8b9-4611-bccd-641a6b82048f" containerName="offline" containerID="cri-o://7d8da3479de185a5d1188c4a03c16f6ce982837ccc203c5e84265a3b4522b187" gracePeriod=30
Sep 08 10:37:19.363709 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:19.363605    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf" podUID="883961d7-a8b9-4611-bccd-641a6b82048f" containerName="online" containerID="cri-o://33ff18d382a47237c33eb61721de008886485712f2a588e5e294763127564630" gracePeriod=30
Sep 08 10:37:19.363908 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:19.363616    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf" podUID="883961d7-a8b9-4611-bccd-641a6b82048f" containerName="ui" containerID="cri-o://2e0cf19991eb2f4d762f105824dc733c01447fda5bf0d57eb7059dc47fdf72cf" gracePeriod=30
Sep 08 10:37:19.379062 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:19.379018    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:37:19.478999 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:19.478904    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:37:20.716678 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:20.716647    2579 generic.go:356] "Generic (PLEG): container finished" podID="021d1216-c519-4cc2-8529-68e0f5bd35bb" containerID="db07750db3118c951fc27cbe9007129b980bfdfae14358f454d3bb6ea02fa6bf" exitCode=0
Sep 08 10:37:20.716678 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:20.716674    2579 generic.go:356] "Generic (PLEG): container finished" podID="021d1216-c519-4cc2-8529-68e0f5bd35bb" containerID="dcdf9ec1ddc1ada90f300fb9679695b56a4d23727bcdc8ce19ebb68f85b857f0" exitCode=0
Sep 08 10:37:20.717168 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:20.716726    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf" event={"ID":"021d1216-c519-4cc2-8529-68e0f5bd35bb","Type":"ContainerDied","Data":"db07750db3118c951fc27cbe9007129b980bfdfae14358f454d3bb6ea02fa6bf"}
Sep 08 10:37:20.717168 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:20.716784    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf" event={"ID":"021d1216-c519-4cc2-8529-68e0f5bd35bb","Type":"ContainerDied","Data":"dcdf9ec1ddc1ada90f300fb9679695b56a4d23727bcdc8ce19ebb68f85b857f0"}
Sep 08 10:37:20.719624 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:20.719602    2579 generic.go:356] "Generic (PLEG): container finished" podID="883961d7-a8b9-4611-bccd-641a6b82048f" containerID="2e0cf19991eb2f4d762f105824dc733c01447fda5bf0d57eb7059dc47fdf72cf" exitCode=0
Sep 08 10:37:20.719624 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:20.719622    2579 generic.go:356] "Generic (PLEG): container finished" podID="883961d7-a8b9-4611-bccd-641a6b82048f" containerID="33ff18d382a47237c33eb61721de008886485712f2a588e5e294763127564630" exitCode=0
Sep 08 10:37:20.719769 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:20.719639    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf" event={"ID":"883961d7-a8b9-4611-bccd-641a6b82048f","Type":"ContainerDied","Data":"2e0cf19991eb2f4d762f105824dc733c01447fda5bf0d57eb7059dc47fdf72cf"}
Sep 08 10:37:20.719769 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:20.719663    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf" event={"ID":"883961d7-a8b9-4611-bccd-641a6b82048f","Type":"ContainerDied","Data":"33ff18d382a47237c33eb61721de008886485712f2a588e5e294763127564630"}
Sep 08 10:37:20.969306 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:20.969214    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf" podUID="883961d7-a8b9-4611-bccd-641a6b82048f" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.43:8443: connect: connection refused"
Sep 08 10:37:20.969306 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:20.969290    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf" podUID="883961d7-a8b9-4611-bccd-641a6b82048f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.43:6567/health\": dial tcp 10.133.0.43:6567: connect: connection refused"
Sep 08 10:37:23.425950 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:23.425906    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf" podUID="021d1216-c519-4cc2-8529-68e0f5bd35bb" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.44:8443: connect: connection refused"
Sep 08 10:37:24.513386 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:24.513347    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:37:26.893014 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:26.892975    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf" podUID="021d1216-c519-4cc2-8529-68e0f5bd35bb" containerName="online" probeResult="failure" output="Get \"https://10.133.0.44:6567/health\": dial tcp 10.133.0.44:6567: connect: connection refused"
Sep 08 10:37:30.968347 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:30.968292    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf" podUID="883961d7-a8b9-4611-bccd-641a6b82048f" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.43:8443: connect: connection refused"
Sep 08 10:37:30.968347 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:30.968318    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf" podUID="883961d7-a8b9-4611-bccd-641a6b82048f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.43:6567/health\": dial tcp 10.133.0.43:6567: connect: connection refused"
Sep 08 10:37:33.425443 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:33.425395    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf" podUID="021d1216-c519-4cc2-8529-68e0f5bd35bb" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.44:8443: connect: connection refused"
Sep 08 10:37:36.892947 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:36.892906    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf" podUID="021d1216-c519-4cc2-8529-68e0f5bd35bb" containerName="online" probeResult="failure" output="Get \"https://10.133.0.44:6567/health\": dial tcp 10.133.0.44:6567: connect: connection refused"
Sep 08 10:37:40.968480 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:40.968439    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf" podUID="883961d7-a8b9-4611-bccd-641a6b82048f" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.43:8443: connect: connection refused"
Sep 08 10:37:40.968968 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:40.968500    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf" podUID="883961d7-a8b9-4611-bccd-641a6b82048f" containerName="online" probeResult="failure" output="Get \"https://10.133.0.43:6567/health\": dial tcp 10.133.0.43:6567: connect: connection refused"
Sep 08 10:37:40.968968 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:40.968593    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf"
Sep 08 10:37:40.968968 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:40.968879    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf"
Sep 08 10:37:43.425626 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:43.425584    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf" podUID="021d1216-c519-4cc2-8529-68e0f5bd35bb" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.44:8443: connect: connection refused"
Sep 08 10:37:43.426003 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:43.425698    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf"
Sep 08 10:37:46.892710 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:46.892666    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf" podUID="021d1216-c519-4cc2-8529-68e0f5bd35bb" containerName="online" probeResult="failure" output="Get \"https://10.133.0.44:6567/health\": dial tcp 10.133.0.44:6567: connect: connection refused"
Sep 08 10:37:46.893081 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:46.892821    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf"
Sep 08 10:37:49.841106 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:49.841076    2579 generic.go:356] "Generic (PLEG): container finished" podID="021d1216-c519-4cc2-8529-68e0f5bd35bb" containerID="96855aee456be0d3f4e00c8e42c07fbf96d1d1bed317cfed4752b45877ed5968" exitCode=137
Sep 08 10:37:49.841522 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:49.841115    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf" event={"ID":"021d1216-c519-4cc2-8529-68e0f5bd35bb","Type":"ContainerDied","Data":"96855aee456be0d3f4e00c8e42c07fbf96d1d1bed317cfed4752b45877ed5968"}
Sep 08 10:37:49.844572 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:49.844527    2579 generic.go:356] "Generic (PLEG): container finished" podID="883961d7-a8b9-4611-bccd-641a6b82048f" containerID="7d8da3479de185a5d1188c4a03c16f6ce982837ccc203c5e84265a3b4522b187" exitCode=137
Sep 08 10:37:49.844572 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:49.844571    2579 generic.go:356] "Generic (PLEG): container finished" podID="883961d7-a8b9-4611-bccd-641a6b82048f" containerID="e306a744c1324532e7d982aec839867001ba69b2aa9bb826b3e32dcb9e13405b" exitCode=137
Sep 08 10:37:49.844729 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:49.844571    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf" event={"ID":"883961d7-a8b9-4611-bccd-641a6b82048f","Type":"ContainerDied","Data":"7d8da3479de185a5d1188c4a03c16f6ce982837ccc203c5e84265a3b4522b187"}
Sep 08 10:37:49.844729 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:49.844604    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf" event={"ID":"883961d7-a8b9-4611-bccd-641a6b82048f","Type":"ContainerDied","Data":"e306a744c1324532e7d982aec839867001ba69b2aa9bb826b3e32dcb9e13405b"}
Sep 08 10:37:49.860417 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:49.860399    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf"
Sep 08 10:37:50.003014 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.002992    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf"
Sep 08 10:37:50.054873 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.054848    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9g52h\" (UniqueName: \"kubernetes.io/projected/021d1216-c519-4cc2-8529-68e0f5bd35bb-kube-api-access-9g52h\") pod \"021d1216-c519-4cc2-8529-68e0f5bd35bb\" (UID: \"021d1216-c519-4cc2-8529-68e0f5bd35bb\") "
Sep 08 10:37:50.054995 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.054912    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/021d1216-c519-4cc2-8529-68e0f5bd35bb-offline-tls\") pod \"021d1216-c519-4cc2-8529-68e0f5bd35bb\" (UID: \"021d1216-c519-4cc2-8529-68e0f5bd35bb\") "
Sep 08 10:37:50.054995 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.054929    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/021d1216-c519-4cc2-8529-68e0f5bd35bb-feast-data\") pod \"021d1216-c519-4cc2-8529-68e0f5bd35bb\" (UID: \"021d1216-c519-4cc2-8529-68e0f5bd35bb\") "
Sep 08 10:37:50.054995 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.054974    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/021d1216-c519-4cc2-8529-68e0f5bd35bb-registry-tls\") pod \"021d1216-c519-4cc2-8529-68e0f5bd35bb\" (UID: \"021d1216-c519-4cc2-8529-68e0f5bd35bb\") "
Sep 08 10:37:50.055162 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.054992    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/021d1216-c519-4cc2-8529-68e0f5bd35bb-online-tls\") pod \"021d1216-c519-4cc2-8529-68e0f5bd35bb\" (UID: \"021d1216-c519-4cc2-8529-68e0f5bd35bb\") "
Sep 08 10:37:50.055162 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.055019    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/021d1216-c519-4cc2-8529-68e0f5bd35bb-ui-tls\") pod \"021d1216-c519-4cc2-8529-68e0f5bd35bb\" (UID: \"021d1216-c519-4cc2-8529-68e0f5bd35bb\") "
Sep 08 10:37:50.055352 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.055324    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/021d1216-c519-4cc2-8529-68e0f5bd35bb-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "021d1216-c519-4cc2-8529-68e0f5bd35bb" (UID: "021d1216-c519-4cc2-8529-68e0f5bd35bb"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:37:50.055476 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.055454    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/021d1216-c519-4cc2-8529-68e0f5bd35bb-feast-data" (OuterVolumeSpecName: "feast-data") pod "021d1216-c519-4cc2-8529-68e0f5bd35bb" (UID: "021d1216-c519-4cc2-8529-68e0f5bd35bb"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:37:50.057219 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.057193    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/021d1216-c519-4cc2-8529-68e0f5bd35bb-kube-api-access-9g52h" (OuterVolumeSpecName: "kube-api-access-9g52h") pod "021d1216-c519-4cc2-8529-68e0f5bd35bb" (UID: "021d1216-c519-4cc2-8529-68e0f5bd35bb"). InnerVolumeSpecName "kube-api-access-9g52h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:37:50.057305 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.057268    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/021d1216-c519-4cc2-8529-68e0f5bd35bb-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "021d1216-c519-4cc2-8529-68e0f5bd35bb" (UID: "021d1216-c519-4cc2-8529-68e0f5bd35bb"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:37:50.057593 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.057575    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/021d1216-c519-4cc2-8529-68e0f5bd35bb-online-tls" (OuterVolumeSpecName: "online-tls") pod "021d1216-c519-4cc2-8529-68e0f5bd35bb" (UID: "021d1216-c519-4cc2-8529-68e0f5bd35bb"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:37:50.057659 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.057600    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/021d1216-c519-4cc2-8529-68e0f5bd35bb-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "021d1216-c519-4cc2-8529-68e0f5bd35bb" (UID: "021d1216-c519-4cc2-8529-68e0f5bd35bb"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:37:50.155917 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.155890    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/883961d7-a8b9-4611-bccd-641a6b82048f-ui-tls\") pod \"883961d7-a8b9-4611-bccd-641a6b82048f\" (UID: \"883961d7-a8b9-4611-bccd-641a6b82048f\") "
Sep 08 10:37:50.156050 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.155936    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/883961d7-a8b9-4611-bccd-641a6b82048f-registry-tls\") pod \"883961d7-a8b9-4611-bccd-641a6b82048f\" (UID: \"883961d7-a8b9-4611-bccd-641a6b82048f\") "
Sep 08 10:37:50.156050 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.155965    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/883961d7-a8b9-4611-bccd-641a6b82048f-feast-data\") pod \"883961d7-a8b9-4611-bccd-641a6b82048f\" (UID: \"883961d7-a8b9-4611-bccd-641a6b82048f\") "
Sep 08 10:37:50.156050 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.155998    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/883961d7-a8b9-4611-bccd-641a6b82048f-online-tls\") pod \"883961d7-a8b9-4611-bccd-641a6b82048f\" (UID: \"883961d7-a8b9-4611-bccd-641a6b82048f\") "
Sep 08 10:37:50.156050 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.156034    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/883961d7-a8b9-4611-bccd-641a6b82048f-offline-tls\") pod \"883961d7-a8b9-4611-bccd-641a6b82048f\" (UID: \"883961d7-a8b9-4611-bccd-641a6b82048f\") "
Sep 08 10:37:50.156258 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.156070    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qlwpz\" (UniqueName: \"kubernetes.io/projected/883961d7-a8b9-4611-bccd-641a6b82048f-kube-api-access-qlwpz\") pod \"883961d7-a8b9-4611-bccd-641a6b82048f\" (UID: \"883961d7-a8b9-4611-bccd-641a6b82048f\") "
Sep 08 10:37:50.156314 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.156296    2579 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/021d1216-c519-4cc2-8529-68e0f5bd35bb-offline-tls\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:37:50.156374 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.156312    2579 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/021d1216-c519-4cc2-8529-68e0f5bd35bb-feast-data\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:37:50.156374 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.156326    2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/021d1216-c519-4cc2-8529-68e0f5bd35bb-registry-tls\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:37:50.156374 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.156341    2579 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/021d1216-c519-4cc2-8529-68e0f5bd35bb-online-tls\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:37:50.156374 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.156353    2579 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/021d1216-c519-4cc2-8529-68e0f5bd35bb-ui-tls\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:37:50.156374 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.156366    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9g52h\" (UniqueName: \"kubernetes.io/projected/021d1216-c519-4cc2-8529-68e0f5bd35bb-kube-api-access-9g52h\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:37:50.156647 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.156516    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/883961d7-a8b9-4611-bccd-641a6b82048f-feast-data" (OuterVolumeSpecName: "feast-data") pod "883961d7-a8b9-4611-bccd-641a6b82048f" (UID: "883961d7-a8b9-4611-bccd-641a6b82048f"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:37:50.158044 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.158018    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/883961d7-a8b9-4611-bccd-641a6b82048f-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "883961d7-a8b9-4611-bccd-641a6b82048f" (UID: "883961d7-a8b9-4611-bccd-641a6b82048f"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:37:50.158135 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.158055    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/883961d7-a8b9-4611-bccd-641a6b82048f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "883961d7-a8b9-4611-bccd-641a6b82048f" (UID: "883961d7-a8b9-4611-bccd-641a6b82048f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:37:50.158183 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.158167    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/883961d7-a8b9-4611-bccd-641a6b82048f-kube-api-access-qlwpz" (OuterVolumeSpecName: "kube-api-access-qlwpz") pod "883961d7-a8b9-4611-bccd-641a6b82048f" (UID: "883961d7-a8b9-4611-bccd-641a6b82048f"). InnerVolumeSpecName "kube-api-access-qlwpz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:37:50.158640 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.158618    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/883961d7-a8b9-4611-bccd-641a6b82048f-online-tls" (OuterVolumeSpecName: "online-tls") pod "883961d7-a8b9-4611-bccd-641a6b82048f" (UID: "883961d7-a8b9-4611-bccd-641a6b82048f"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:37:50.158729 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.158649    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/883961d7-a8b9-4611-bccd-641a6b82048f-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "883961d7-a8b9-4611-bccd-641a6b82048f" (UID: "883961d7-a8b9-4611-bccd-641a6b82048f"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:37:50.256737 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.256674    2579 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/883961d7-a8b9-4611-bccd-641a6b82048f-ui-tls\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:37:50.256737 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.256697    2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/883961d7-a8b9-4611-bccd-641a6b82048f-registry-tls\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:37:50.256737 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.256707    2579 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/883961d7-a8b9-4611-bccd-641a6b82048f-feast-data\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:37:50.256737 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.256714    2579 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/883961d7-a8b9-4611-bccd-641a6b82048f-online-tls\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:37:50.256737 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.256722    2579 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/883961d7-a8b9-4611-bccd-641a6b82048f-offline-tls\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:37:50.256737 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.256729    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qlwpz\" (UniqueName: \"kubernetes.io/projected/883961d7-a8b9-4611-bccd-641a6b82048f-kube-api-access-qlwpz\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:37:50.851522 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.851492    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf" event={"ID":"021d1216-c519-4cc2-8529-68e0f5bd35bb","Type":"ContainerDied","Data":"989c6244758773b365fcdd2b12016366a7a0699d6d86e5bc372af2ed37fa5cb9"}
Sep 08 10:37:50.851926 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.851524    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf"
Sep 08 10:37:50.851926 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.851563    2579 scope.go:117] "RemoveContainer" containerID="db07750db3118c951fc27cbe9007129b980bfdfae14358f454d3bb6ea02fa6bf"
Sep 08 10:37:50.855159 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.855133    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf" event={"ID":"883961d7-a8b9-4611-bccd-641a6b82048f","Type":"ContainerDied","Data":"ca6f6d8b4eb4ad8efd649a29edf0c8bf67bc98296f1ed1a965a1da1f4a6c2283"}
Sep 08 10:37:50.855251 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.855191    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf"
Sep 08 10:37:50.861935 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.861917    2579 scope.go:117] "RemoveContainer" containerID="96855aee456be0d3f4e00c8e42c07fbf96d1d1bed317cfed4752b45877ed5968"
Sep 08 10:37:50.869777 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.869730    2579 scope.go:117] "RemoveContainer" containerID="dcdf9ec1ddc1ada90f300fb9679695b56a4d23727bcdc8ce19ebb68f85b857f0"
Sep 08 10:37:50.872267 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.872236    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf"]
Sep 08 10:37:50.876674 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.876647    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-c5d49d8c6-mdmtf"]
Sep 08 10:37:50.878883 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.878863    2579 scope.go:117] "RemoveContainer" containerID="16dc8fe46574ec8fa1f0a01ac16e2ab1faf92c4b3a6225b282c2e6ffd69f2953"
Sep 08 10:37:50.888653 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.888629    2579 scope.go:117] "RemoveContainer" containerID="5de04482b158d10929ba3cd75a7efe4852470b1bf5910417e020f827ab5e65ef"
Sep 08 10:37:50.889854 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.889835    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf"]
Sep 08 10:37:50.893288 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.893270    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-57576b8fcf-fswdf"]
Sep 08 10:37:50.897759 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.897741    2579 scope.go:117] "RemoveContainer" containerID="2e0cf19991eb2f4d762f105824dc733c01447fda5bf0d57eb7059dc47fdf72cf"
Sep 08 10:37:50.904760 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.904745    2579 scope.go:117] "RemoveContainer" containerID="7d8da3479de185a5d1188c4a03c16f6ce982837ccc203c5e84265a3b4522b187"
Sep 08 10:37:50.912175 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.912156    2579 scope.go:117] "RemoveContainer" containerID="33ff18d382a47237c33eb61721de008886485712f2a588e5e294763127564630"
Sep 08 10:37:50.919262 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.919235    2579 scope.go:117] "RemoveContainer" containerID="e306a744c1324532e7d982aec839867001ba69b2aa9bb826b3e32dcb9e13405b"
Sep 08 10:37:50.926253 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.926233    2579 scope.go:117] "RemoveContainer" containerID="edb66845a64d6c99b12b7420a093043c36478c6b089d21e54878ad77b7966c86"
Sep 08 10:37:50.933313 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:50.933294    2579 scope.go:117] "RemoveContainer" containerID="ee18bdcf04fedafec7ad7e911572c4880c23a38a31abec2fd06e046b6a42b703"
Sep 08 10:37:52.832063 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:52.832030    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="021d1216-c519-4cc2-8529-68e0f5bd35bb" path="/var/lib/kubelet/pods/021d1216-c519-4cc2-8529-68e0f5bd35bb/volumes"
Sep 08 10:37:52.832574 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:37:52.832560    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="883961d7-a8b9-4611-bccd-641a6b82048f" path="/var/lib/kubelet/pods/883961d7-a8b9-4611-bccd-641a6b82048f/volumes"
Sep 08 10:38:02.135306 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:02.135272    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:38:02.244437 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:02.244399    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:38:07.792591 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:07.792525    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:38:08.031863 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:08.031826    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:38:08.156389 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:08.156311    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-q6jxs/must-gather-gpksf"]
Sep 08 10:38:08.156669 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:08.156656    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="021d1216-c519-4cc2-8529-68e0f5bd35bb" containerName="offline"
Sep 08 10:38:08.156729 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:08.156670    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="021d1216-c519-4cc2-8529-68e0f5bd35bb" containerName="offline"
Sep 08 10:38:08.156729 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:08.156681    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="883961d7-a8b9-4611-bccd-641a6b82048f" containerName="feast-init"
Sep 08 10:38:08.156729 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:08.156687    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="883961d7-a8b9-4611-bccd-641a6b82048f" containerName="feast-init"
Sep 08 10:38:08.156729 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:08.156696    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="883961d7-a8b9-4611-bccd-641a6b82048f" containerName="online"
Sep 08 10:38:08.156729 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:08.156701    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="883961d7-a8b9-4611-bccd-641a6b82048f" containerName="online"
Sep 08 10:38:08.156729 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:08.156709    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="021d1216-c519-4cc2-8529-68e0f5bd35bb" containerName="online"
Sep 08 10:38:08.156729 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:08.156713    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="021d1216-c519-4cc2-8529-68e0f5bd35bb" containerName="online"
Sep 08 10:38:08.156729 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:08.156721    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="883961d7-a8b9-4611-bccd-641a6b82048f" containerName="registry"
Sep 08 10:38:08.156729 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:08.156726    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="883961d7-a8b9-4611-bccd-641a6b82048f" containerName="registry"
Sep 08 10:38:08.156997 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:08.156735    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="021d1216-c519-4cc2-8529-68e0f5bd35bb" containerName="feast-init"
Sep 08 10:38:08.156997 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:08.156740    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="021d1216-c519-4cc2-8529-68e0f5bd35bb" containerName="feast-init"
Sep 08 10:38:08.156997 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:08.156745    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="883961d7-a8b9-4611-bccd-641a6b82048f" containerName="feast-apply"
Sep 08 10:38:08.156997 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:08.156750    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="883961d7-a8b9-4611-bccd-641a6b82048f" containerName="feast-apply"
Sep 08 10:38:08.156997 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:08.156756    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="883961d7-a8b9-4611-bccd-641a6b82048f" containerName="offline"
Sep 08 10:38:08.156997 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:08.156762    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="883961d7-a8b9-4611-bccd-641a6b82048f" containerName="offline"
Sep 08 10:38:08.156997 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:08.156768    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="021d1216-c519-4cc2-8529-68e0f5bd35bb" containerName="feast-apply"
Sep 08 10:38:08.156997 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:08.156773    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="021d1216-c519-4cc2-8529-68e0f5bd35bb" containerName="feast-apply"
Sep 08 10:38:08.156997 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:08.156778    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="021d1216-c519-4cc2-8529-68e0f5bd35bb" containerName="ui"
Sep 08 10:38:08.156997 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:08.156783    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="021d1216-c519-4cc2-8529-68e0f5bd35bb" containerName="ui"
Sep 08 10:38:08.156997 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:08.156790    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="883961d7-a8b9-4611-bccd-641a6b82048f" containerName="ui"
Sep 08 10:38:08.156997 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:08.156795    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="883961d7-a8b9-4611-bccd-641a6b82048f" containerName="ui"
Sep 08 10:38:08.156997 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:08.156843    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="883961d7-a8b9-4611-bccd-641a6b82048f" containerName="ui"
Sep 08 10:38:08.156997 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:08.156851    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="021d1216-c519-4cc2-8529-68e0f5bd35bb" containerName="ui"
Sep 08 10:38:08.156997 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:08.156856    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="883961d7-a8b9-4611-bccd-641a6b82048f" containerName="online"
Sep 08 10:38:08.156997 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:08.156861    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="883961d7-a8b9-4611-bccd-641a6b82048f" containerName="offline"
Sep 08 10:38:08.156997 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:08.156868    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="021d1216-c519-4cc2-8529-68e0f5bd35bb" containerName="offline"
Sep 08 10:38:08.156997 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:08.156874    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="883961d7-a8b9-4611-bccd-641a6b82048f" containerName="registry"
Sep 08 10:38:08.156997 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:08.156878    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="021d1216-c519-4cc2-8529-68e0f5bd35bb" containerName="online"
Sep 08 10:38:08.161810 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:08.161794    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q6jxs/must-gather-gpksf"
Sep 08 10:38:08.164270 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:08.164246    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q6jxs\"/\"kube-root-ca.crt\""
Sep 08 10:38:08.164270 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:08.164262    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q6jxs\"/\"openshift-service-ca.crt\""
Sep 08 10:38:08.167953 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:08.167932    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q6jxs/must-gather-gpksf"]
Sep 08 10:38:08.180106 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:08.180059    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:38:08.185416 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:08.185391    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvh68\" (UniqueName: \"kubernetes.io/projected/413814ae-85d2-45c9-a231-6fa8e432c7a6-kube-api-access-nvh68\") pod \"must-gather-gpksf\" (UID: \"413814ae-85d2-45c9-a231-6fa8e432c7a6\") " pod="openshift-must-gather-q6jxs/must-gather-gpksf"
Sep 08 10:38:08.185497 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:08.185436    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/413814ae-85d2-45c9-a231-6fa8e432c7a6-must-gather-output\") pod \"must-gather-gpksf\" (UID: \"413814ae-85d2-45c9-a231-6fa8e432c7a6\") " pod="openshift-must-gather-q6jxs/must-gather-gpksf"
Sep 08 10:38:08.279887 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:08.279864    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:38:08.285831 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:08.285813    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/413814ae-85d2-45c9-a231-6fa8e432c7a6-must-gather-output\") pod \"must-gather-gpksf\" (UID: \"413814ae-85d2-45c9-a231-6fa8e432c7a6\") " pod="openshift-must-gather-q6jxs/must-gather-gpksf"
Sep 08 10:38:08.285900 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:08.285867    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvh68\" (UniqueName: \"kubernetes.io/projected/413814ae-85d2-45c9-a231-6fa8e432c7a6-kube-api-access-nvh68\") pod \"must-gather-gpksf\" (UID: \"413814ae-85d2-45c9-a231-6fa8e432c7a6\") " pod="openshift-must-gather-q6jxs/must-gather-gpksf"
Sep 08 10:38:08.286113 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:08.286097    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/413814ae-85d2-45c9-a231-6fa8e432c7a6-must-gather-output\") pod \"must-gather-gpksf\" (UID: \"413814ae-85d2-45c9-a231-6fa8e432c7a6\") " pod="openshift-must-gather-q6jxs/must-gather-gpksf"
Sep 08 10:38:08.294138 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:08.294109    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvh68\" (UniqueName: \"kubernetes.io/projected/413814ae-85d2-45c9-a231-6fa8e432c7a6-kube-api-access-nvh68\") pod \"must-gather-gpksf\" (UID: \"413814ae-85d2-45c9-a231-6fa8e432c7a6\") " pod="openshift-must-gather-q6jxs/must-gather-gpksf"
Sep 08 10:38:08.485301 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:08.485209    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q6jxs/must-gather-gpksf"
Sep 08 10:38:08.756641 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:08.756595    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q6jxs/must-gather-gpksf"]
Sep 08 10:38:08.758796 ip-10-0-132-96 kubenswrapper[2579]: W0908 10:38:08.758769    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod413814ae_85d2_45c9_a231_6fa8e432c7a6.slice/crio-9f0148b417584c7525cd6812ef648cf5d79386d37318d38d599f148906eaae1a WatchSource:0}: Error finding container 9f0148b417584c7525cd6812ef648cf5d79386d37318d38d599f148906eaae1a: Status 404 returned error can't find the container with id 9f0148b417584c7525cd6812ef648cf5d79386d37318d38d599f148906eaae1a
Sep 08 10:38:08.760583 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:08.760566    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 10:38:08.933807 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:08.933776    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q6jxs/must-gather-gpksf" event={"ID":"413814ae-85d2-45c9-a231-6fa8e432c7a6","Type":"ContainerStarted","Data":"9f0148b417584c7525cd6812ef648cf5d79386d37318d38d599f148906eaae1a"}
Sep 08 10:38:15.970366 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:15.970333    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q6jxs/must-gather-gpksf" event={"ID":"413814ae-85d2-45c9-a231-6fa8e432c7a6","Type":"ContainerStarted","Data":"c9f51bca2cc16a28985a21fed840aea0b5d0c41fea8cb73503ac4d91efbd4b93"}
Sep 08 10:38:15.970848 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:15.970375    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q6jxs/must-gather-gpksf" event={"ID":"413814ae-85d2-45c9-a231-6fa8e432c7a6","Type":"ContainerStarted","Data":"43e7d278bf530cfb6ed29e4b8a3879fd22849c4bdd710a8fd17a1d33497fc1fc"}
Sep 08 10:38:15.987402 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:15.987350    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-q6jxs/must-gather-gpksf" podStartSLOduration=1.856479335 podStartE2EDuration="7.987333162s" totalImagesPullingTime="6.130853827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:38:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:38:15.985999088 +0000 UTC m=+2409.681597988" watchObservedRunningTime="2026-09-08 10:38:15.987333162 +0000 UTC m=+2409.682932119"
Sep 08 10:38:25.012225 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:25.012185    2579 generic.go:356] "Generic (PLEG): container finished" podID="413814ae-85d2-45c9-a231-6fa8e432c7a6" containerID="43e7d278bf530cfb6ed29e4b8a3879fd22849c4bdd710a8fd17a1d33497fc1fc" exitCode=0
Sep 08 10:38:25.012652 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:25.012262    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q6jxs/must-gather-gpksf" event={"ID":"413814ae-85d2-45c9-a231-6fa8e432c7a6","Type":"ContainerDied","Data":"43e7d278bf530cfb6ed29e4b8a3879fd22849c4bdd710a8fd17a1d33497fc1fc"}
Sep 08 10:38:25.012652 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:25.012581    2579 scope.go:117] "RemoveContainer" containerID="43e7d278bf530cfb6ed29e4b8a3879fd22849c4bdd710a8fd17a1d33497fc1fc"
Sep 08 10:38:25.411931 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:25.411892    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-q6jxs_must-gather-gpksf_413814ae-85d2-45c9-a231-6fa8e432c7a6/gather/0.log"
Sep 08 10:38:25.747293 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:25.747198    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:38:25.907666 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:25.907632    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:38:26.025116 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:26.025090    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:38:28.743165 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:28.743084    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-j4t5c_3ce5d383-ffe7-47c5-8960-4553f5dfd4c4/global-pull-secret-syncer/0.log"
Sep 08 10:38:28.849974 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:28.849938    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log"
Sep 08 10:38:28.939595 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:28.939567    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-96.ec2.internal_39c5e68f9a1e6fb3d5599c7ac75713d7/haproxy/0.log"
Sep 08 10:38:30.720698 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:30.720661    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-q6jxs/must-gather-gpksf"]
Sep 08 10:38:30.721128 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:30.720878    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-q6jxs/must-gather-gpksf" podUID="413814ae-85d2-45c9-a231-6fa8e432c7a6" containerName="copy" containerID="cri-o://c9f51bca2cc16a28985a21fed840aea0b5d0c41fea8cb73503ac4d91efbd4b93" gracePeriod=2
Sep 08 10:38:30.723605 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:38:30.723569    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-gpksf\" is forbidden: User \"system:node:ip-10-0-132-96.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-q6jxs\": no relationship found between node 'ip-10-0-132-96.ec2.internal' and this object" podUID="413814ae-85d2-45c9-a231-6fa8e432c7a6" pod="openshift-must-gather-q6jxs/must-gather-gpksf"
Sep 08 10:38:30.725395 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:30.725146    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-q6jxs/must-gather-gpksf"]
Sep 08 10:38:30.942675 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:30.942650    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-q6jxs_must-gather-gpksf_413814ae-85d2-45c9-a231-6fa8e432c7a6/copy/0.log"
Sep 08 10:38:30.944156 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:30.944139    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q6jxs/must-gather-gpksf"
Sep 08 10:38:31.037454 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:31.037430    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-q6jxs_must-gather-gpksf_413814ae-85d2-45c9-a231-6fa8e432c7a6/copy/0.log"
Sep 08 10:38:31.037834 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:31.037811    2579 generic.go:356] "Generic (PLEG): container finished" podID="413814ae-85d2-45c9-a231-6fa8e432c7a6" containerID="c9f51bca2cc16a28985a21fed840aea0b5d0c41fea8cb73503ac4d91efbd4b93" exitCode=143
Sep 08 10:38:31.037891 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:31.037859    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q6jxs/must-gather-gpksf"
Sep 08 10:38:31.037935 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:31.037901    2579 scope.go:117] "RemoveContainer" containerID="c9f51bca2cc16a28985a21fed840aea0b5d0c41fea8cb73503ac4d91efbd4b93"
Sep 08 10:38:31.045490 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:31.045474    2579 scope.go:117] "RemoveContainer" containerID="43e7d278bf530cfb6ed29e4b8a3879fd22849c4bdd710a8fd17a1d33497fc1fc"
Sep 08 10:38:31.057329 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:31.057311    2579 scope.go:117] "RemoveContainer" containerID="c9f51bca2cc16a28985a21fed840aea0b5d0c41fea8cb73503ac4d91efbd4b93"
Sep 08 10:38:31.057605 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:38:31.057587    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9f51bca2cc16a28985a21fed840aea0b5d0c41fea8cb73503ac4d91efbd4b93\": container with ID starting with c9f51bca2cc16a28985a21fed840aea0b5d0c41fea8cb73503ac4d91efbd4b93 not found: ID does not exist" containerID="c9f51bca2cc16a28985a21fed840aea0b5d0c41fea8cb73503ac4d91efbd4b93"
Sep 08 10:38:31.057662 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:31.057614    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9f51bca2cc16a28985a21fed840aea0b5d0c41fea8cb73503ac4d91efbd4b93"} err="failed to get container status \"c9f51bca2cc16a28985a21fed840aea0b5d0c41fea8cb73503ac4d91efbd4b93\": rpc error: code = NotFound desc = could not find container \"c9f51bca2cc16a28985a21fed840aea0b5d0c41fea8cb73503ac4d91efbd4b93\": container with ID starting with c9f51bca2cc16a28985a21fed840aea0b5d0c41fea8cb73503ac4d91efbd4b93 not found: ID does not exist"
Sep 08 10:38:31.057662 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:31.057631    2579 scope.go:117] "RemoveContainer" containerID="43e7d278bf530cfb6ed29e4b8a3879fd22849c4bdd710a8fd17a1d33497fc1fc"
Sep 08 10:38:31.057880 ip-10-0-132-96 kubenswrapper[2579]: E0908 10:38:31.057866    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"43e7d278bf530cfb6ed29e4b8a3879fd22849c4bdd710a8fd17a1d33497fc1fc\": container with ID starting with 43e7d278bf530cfb6ed29e4b8a3879fd22849c4bdd710a8fd17a1d33497fc1fc not found: ID does not exist" containerID="43e7d278bf530cfb6ed29e4b8a3879fd22849c4bdd710a8fd17a1d33497fc1fc"
Sep 08 10:38:31.057927 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:31.057885    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"43e7d278bf530cfb6ed29e4b8a3879fd22849c4bdd710a8fd17a1d33497fc1fc"} err="failed to get container status \"43e7d278bf530cfb6ed29e4b8a3879fd22849c4bdd710a8fd17a1d33497fc1fc\": rpc error: code = NotFound desc = could not find container \"43e7d278bf530cfb6ed29e4b8a3879fd22849c4bdd710a8fd17a1d33497fc1fc\": container with ID starting with 43e7d278bf530cfb6ed29e4b8a3879fd22849c4bdd710a8fd17a1d33497fc1fc not found: ID does not exist"
Sep 08 10:38:31.082212 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:31.082188    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/413814ae-85d2-45c9-a231-6fa8e432c7a6-must-gather-output\") pod \"413814ae-85d2-45c9-a231-6fa8e432c7a6\" (UID: \"413814ae-85d2-45c9-a231-6fa8e432c7a6\") "
Sep 08 10:38:31.082307 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:31.082241    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nvh68\" (UniqueName: \"kubernetes.io/projected/413814ae-85d2-45c9-a231-6fa8e432c7a6-kube-api-access-nvh68\") pod \"413814ae-85d2-45c9-a231-6fa8e432c7a6\" (UID: \"413814ae-85d2-45c9-a231-6fa8e432c7a6\") "
Sep 08 10:38:31.082616 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:31.082584    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/413814ae-85d2-45c9-a231-6fa8e432c7a6-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "413814ae-85d2-45c9-a231-6fa8e432c7a6" (UID: "413814ae-85d2-45c9-a231-6fa8e432c7a6"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:38:31.084357 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:31.084339    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/413814ae-85d2-45c9-a231-6fa8e432c7a6-kube-api-access-nvh68" (OuterVolumeSpecName: "kube-api-access-nvh68") pod "413814ae-85d2-45c9-a231-6fa8e432c7a6" (UID: "413814ae-85d2-45c9-a231-6fa8e432c7a6"). InnerVolumeSpecName "kube-api-access-nvh68". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:38:31.183509 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:31.183475    2579 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/413814ae-85d2-45c9-a231-6fa8e432c7a6-must-gather-output\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:38:31.183509 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:31.183504    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nvh68\" (UniqueName: \"kubernetes.io/projected/413814ae-85d2-45c9-a231-6fa8e432c7a6-kube-api-access-nvh68\") on node \"ip-10-0-132-96.ec2.internal\" DevicePath \"\""
Sep 08 10:38:31.400900 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:31.400868    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:38:31.463438 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:31.463411    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8l4t6_8256cd1d-5778-4897-91b2-8a45f97f69dd/konnectivity-agent/0.log" limit=1024
Sep 08 10:38:32.831867 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:32.831837    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="413814ae-85d2-45c9-a231-6fa8e432c7a6" path="/var/lib/kubelet/pods/413814ae-85d2-45c9-a231-6fa8e432c7a6/volumes"
Sep 08 10:38:33.072459 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:33.072398    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-9j9l6_e5b6c74f-f7d5-498f-819b-774611df756f/kube-state-metrics/0.log"
Sep 08 10:38:33.095464 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:33.095391    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-9j9l6_e5b6c74f-f7d5-498f-819b-774611df756f/kube-rbac-proxy-main/0.log"
Sep 08 10:38:33.120714 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:33.120663    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-9j9l6_e5b6c74f-f7d5-498f-819b-774611df756f/kube-rbac-proxy-self/0.log"
Sep 08 10:38:33.158396 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:33.158371    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-595bdb6d6-xpshs_8b4376f5-2a08-4626-afdc-651fae8159e3/metrics-server/0.log"
Sep 08 10:38:33.389523 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:33.389440    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pws49_ae8d0e32-e1b2-42d6-9bcd-e34035c43977/node-exporter/0.log"
Sep 08 10:38:33.411718 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:33.411684    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pws49_ae8d0e32-e1b2-42d6-9bcd-e34035c43977/kube-rbac-proxy/0.log"
Sep 08 10:38:33.434976 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:33.434948    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-pws49_ae8d0e32-e1b2-42d6-9bcd-e34035c43977/init-textfile/0.log"
Sep 08 10:38:33.468957 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:33.468929    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-t25pb_ea2bf78c-a59f-4206-b2e3-769f6b81347f/kube-rbac-proxy-main/0.log"
Sep 08 10:38:33.507815 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:33.507790    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-t25pb_ea2bf78c-a59f-4206-b2e3-769f6b81347f/kube-rbac-proxy-self/0.log"
Sep 08 10:38:33.535503 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:33.535475    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-t25pb_ea2bf78c-a59f-4206-b2e3-769f6b81347f/openshift-state-metrics/0.log"
Sep 08 10:38:33.802830 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:33.802804    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-47dpb_9b5bcb3b-856b-484a-b3c9-b4477ccb3299/prometheus-operator/0.log"
Sep 08 10:38:33.825820 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:33.825797    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-6f4946db56-47dpb_9b5bcb3b-856b-484a-b3c9-b4477ccb3299/kube-rbac-proxy/0.log"
Sep 08 10:38:33.861048 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:33.861018    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-rmmms_4edd76d7-d6d3-42b2-9058-cc576b9e4971/prometheus-operator-admission-webhook/0.log"
Sep 08 10:38:33.897039 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:33.897014    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-54c568ff7-vjch4_675b01df-1cbb-468a-8098-d5a0e32fd0c7/telemeter-client/0.log"
Sep 08 10:38:33.925001 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:33.924936    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-54c568ff7-vjch4_675b01df-1cbb-468a-8098-d5a0e32fd0c7/reload/0.log"
Sep 08 10:38:33.948738 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:33.948712    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-54c568ff7-vjch4_675b01df-1cbb-468a-8098-d5a0e32fd0c7/kube-rbac-proxy/0.log"
Sep 08 10:38:33.983431 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:33.983408    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68c8ff8794-bvptf_f157192f-2fa4-486c-b1e2-645848557a0a/thanos-query/0.log"
Sep 08 10:38:34.007450 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:34.007423    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68c8ff8794-bvptf_f157192f-2fa4-486c-b1e2-645848557a0a/kube-rbac-proxy-web/0.log"
Sep 08 10:38:34.038530 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:34.038510    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68c8ff8794-bvptf_f157192f-2fa4-486c-b1e2-645848557a0a/kube-rbac-proxy/0.log"
Sep 08 10:38:34.069137 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:34.069117    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68c8ff8794-bvptf_f157192f-2fa4-486c-b1e2-645848557a0a/prom-label-proxy/0.log"
Sep 08 10:38:34.095755 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:34.095733    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68c8ff8794-bvptf_f157192f-2fa4-486c-b1e2-645848557a0a/kube-rbac-proxy-rules/0.log"
Sep 08 10:38:34.122406 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:34.122390    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-68c8ff8794-bvptf_f157192f-2fa4-486c-b1e2-645848557a0a/kube-rbac-proxy-metrics/0.log"
Sep 08 10:38:35.907814 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:35.907777    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ft9rp/perf-node-gather-daemonset-fl2mg"]
Sep 08 10:38:35.908304 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:35.908284    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="413814ae-85d2-45c9-a231-6fa8e432c7a6" containerName="gather"
Sep 08 10:38:35.908381 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:35.908308    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="413814ae-85d2-45c9-a231-6fa8e432c7a6" containerName="gather"
Sep 08 10:38:35.908381 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:35.908328    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="413814ae-85d2-45c9-a231-6fa8e432c7a6" containerName="copy"
Sep 08 10:38:35.908381 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:35.908336    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="413814ae-85d2-45c9-a231-6fa8e432c7a6" containerName="copy"
Sep 08 10:38:35.908555 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:35.908433    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="413814ae-85d2-45c9-a231-6fa8e432c7a6" containerName="copy"
Sep 08 10:38:35.908555 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:35.908446    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="413814ae-85d2-45c9-a231-6fa8e432c7a6" containerName="gather"
Sep 08 10:38:35.910846 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:35.910824    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ft9rp/perf-node-gather-daemonset-fl2mg"
Sep 08 10:38:35.913303 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:35.913281    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ft9rp\"/\"default-dockercfg-scptx\""
Sep 08 10:38:35.913404 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:35.913318    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ft9rp\"/\"openshift-service-ca.crt\""
Sep 08 10:38:35.914505 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:35.914490    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ft9rp\"/\"kube-root-ca.crt\""
Sep 08 10:38:35.919791 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:35.919768    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ft9rp/perf-node-gather-daemonset-fl2mg"]
Sep 08 10:38:36.019771 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:36.019741    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6c68549f78-wqvn9_98cfcd3d-a887-4e3f-9b6f-fc6bd1bcd1ee/console/0.log"
Sep 08 10:38:36.021296 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:36.021277    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d48j2\" (UniqueName: \"kubernetes.io/projected/bda41c1e-8a96-4f84-8c15-3b952e3b409b-kube-api-access-d48j2\") pod \"perf-node-gather-daemonset-fl2mg\" (UID: \"bda41c1e-8a96-4f84-8c15-3b952e3b409b\") " pod="openshift-must-gather-ft9rp/perf-node-gather-daemonset-fl2mg"
Sep 08 10:38:36.021364 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:36.021318    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bda41c1e-8a96-4f84-8c15-3b952e3b409b-lib-modules\") pod \"perf-node-gather-daemonset-fl2mg\" (UID: \"bda41c1e-8a96-4f84-8c15-3b952e3b409b\") " pod="openshift-must-gather-ft9rp/perf-node-gather-daemonset-fl2mg"
Sep 08 10:38:36.021364 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:36.021361    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bda41c1e-8a96-4f84-8c15-3b952e3b409b-sys\") pod \"perf-node-gather-daemonset-fl2mg\" (UID: \"bda41c1e-8a96-4f84-8c15-3b952e3b409b\") " pod="openshift-must-gather-ft9rp/perf-node-gather-daemonset-fl2mg"
Sep 08 10:38:36.021458 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:36.021385    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bda41c1e-8a96-4f84-8c15-3b952e3b409b-proc\") pod \"perf-node-gather-daemonset-fl2mg\" (UID: \"bda41c1e-8a96-4f84-8c15-3b952e3b409b\") " pod="openshift-must-gather-ft9rp/perf-node-gather-daemonset-fl2mg"
Sep 08 10:38:36.021458 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:36.021411    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bda41c1e-8a96-4f84-8c15-3b952e3b409b-podres\") pod \"perf-node-gather-daemonset-fl2mg\" (UID: \"bda41c1e-8a96-4f84-8c15-3b952e3b409b\") " pod="openshift-must-gather-ft9rp/perf-node-gather-daemonset-fl2mg"
Sep 08 10:38:36.057934 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:36.057910    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-ndfx2_e3dcea29-6e18-4218-ba86-a06ccb4544ca/download-server/0.log"
Sep 08 10:38:36.122225 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:36.122200    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bda41c1e-8a96-4f84-8c15-3b952e3b409b-podres\") pod \"perf-node-gather-daemonset-fl2mg\" (UID: \"bda41c1e-8a96-4f84-8c15-3b952e3b409b\") " pod="openshift-must-gather-ft9rp/perf-node-gather-daemonset-fl2mg"
Sep 08 10:38:36.122350 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:36.122232    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d48j2\" (UniqueName: \"kubernetes.io/projected/bda41c1e-8a96-4f84-8c15-3b952e3b409b-kube-api-access-d48j2\") pod \"perf-node-gather-daemonset-fl2mg\" (UID: \"bda41c1e-8a96-4f84-8c15-3b952e3b409b\") " pod="openshift-must-gather-ft9rp/perf-node-gather-daemonset-fl2mg"
Sep 08 10:38:36.122350 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:36.122263    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bda41c1e-8a96-4f84-8c15-3b952e3b409b-lib-modules\") pod \"perf-node-gather-daemonset-fl2mg\" (UID: \"bda41c1e-8a96-4f84-8c15-3b952e3b409b\") " pod="openshift-must-gather-ft9rp/perf-node-gather-daemonset-fl2mg"
Sep 08 10:38:36.122350 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:36.122301    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bda41c1e-8a96-4f84-8c15-3b952e3b409b-sys\") pod \"perf-node-gather-daemonset-fl2mg\" (UID: \"bda41c1e-8a96-4f84-8c15-3b952e3b409b\") " pod="openshift-must-gather-ft9rp/perf-node-gather-daemonset-fl2mg"
Sep 08 10:38:36.122350 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:36.122338    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bda41c1e-8a96-4f84-8c15-3b952e3b409b-proc\") pod \"perf-node-gather-daemonset-fl2mg\" (UID: \"bda41c1e-8a96-4f84-8c15-3b952e3b409b\") " pod="openshift-must-gather-ft9rp/perf-node-gather-daemonset-fl2mg"
Sep 08 10:38:36.122522 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:36.122383    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bda41c1e-8a96-4f84-8c15-3b952e3b409b-podres\") pod \"perf-node-gather-daemonset-fl2mg\" (UID: \"bda41c1e-8a96-4f84-8c15-3b952e3b409b\") " pod="openshift-must-gather-ft9rp/perf-node-gather-daemonset-fl2mg"
Sep 08 10:38:36.122522 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:36.122405    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bda41c1e-8a96-4f84-8c15-3b952e3b409b-sys\") pod \"perf-node-gather-daemonset-fl2mg\" (UID: \"bda41c1e-8a96-4f84-8c15-3b952e3b409b\") " pod="openshift-must-gather-ft9rp/perf-node-gather-daemonset-fl2mg"
Sep 08 10:38:36.122522 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:36.122414    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bda41c1e-8a96-4f84-8c15-3b952e3b409b-proc\") pod \"perf-node-gather-daemonset-fl2mg\" (UID: \"bda41c1e-8a96-4f84-8c15-3b952e3b409b\") " pod="openshift-must-gather-ft9rp/perf-node-gather-daemonset-fl2mg"
Sep 08 10:38:36.122522 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:36.122431    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bda41c1e-8a96-4f84-8c15-3b952e3b409b-lib-modules\") pod \"perf-node-gather-daemonset-fl2mg\" (UID: \"bda41c1e-8a96-4f84-8c15-3b952e3b409b\") " pod="openshift-must-gather-ft9rp/perf-node-gather-daemonset-fl2mg"
Sep 08 10:38:36.131616 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:36.131597    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d48j2\" (UniqueName: \"kubernetes.io/projected/bda41c1e-8a96-4f84-8c15-3b952e3b409b-kube-api-access-d48j2\") pod \"perf-node-gather-daemonset-fl2mg\" (UID: \"bda41c1e-8a96-4f84-8c15-3b952e3b409b\") " pod="openshift-must-gather-ft9rp/perf-node-gather-daemonset-fl2mg"
Sep 08 10:38:36.220923 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:36.220858    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ft9rp/perf-node-gather-daemonset-fl2mg"
Sep 08 10:38:36.490396 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:36.490307    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ft9rp/perf-node-gather-daemonset-fl2mg"]
Sep 08 10:38:36.493340 ip-10-0-132-96 kubenswrapper[2579]: W0908 10:38:36.493308    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbda41c1e_8a96_4f84_8c15_3b952e3b409b.slice/crio-a6d9ca4ce30908a2e90d585adb96b55255d6ea0ef73ddc6e26a04f2dd93048a3 WatchSource:0}: Error finding container a6d9ca4ce30908a2e90d585adb96b55255d6ea0ef73ddc6e26a04f2dd93048a3: Status 404 returned error can't find the container with id a6d9ca4ce30908a2e90d585adb96b55255d6ea0ef73ddc6e26a04f2dd93048a3
Sep 08 10:38:37.065034 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:37.065002    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ft9rp/perf-node-gather-daemonset-fl2mg" event={"ID":"bda41c1e-8a96-4f84-8c15-3b952e3b409b","Type":"ContainerStarted","Data":"a3c0b4d9cd2dfb0f996f9fed74b49f437515ba5d9457a8f7f8e8891913830057"}
Sep 08 10:38:37.065408 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:37.065057    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ft9rp/perf-node-gather-daemonset-fl2mg" event={"ID":"bda41c1e-8a96-4f84-8c15-3b952e3b409b","Type":"ContainerStarted","Data":"a6d9ca4ce30908a2e90d585adb96b55255d6ea0ef73ddc6e26a04f2dd93048a3"}
Sep 08 10:38:37.065408 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:37.065145    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ft9rp/perf-node-gather-daemonset-fl2mg"
Sep 08 10:38:37.081881 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:37.081825    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-ft9rp/perf-node-gather-daemonset-fl2mg" podStartSLOduration=2.081810561 podStartE2EDuration="2.081810561s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:38:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:38:37.080723778 +0000 UTC m=+2430.776322683" watchObservedRunningTime="2026-09-08 10:38:37.081810561 +0000 UTC m=+2430.777409461"
Sep 08 10:38:37.419236 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:37.419138    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w56bl_e35db162-1476-43d4-a08f-b95ca644a417/dns/0.log"
Sep 08 10:38:37.440893 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:37.440869    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w56bl_e35db162-1476-43d4-a08f-b95ca644a417/kube-rbac-proxy/0.log"
Sep 08 10:38:37.515786 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:37.515754    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wdvlk_313cffc0-94c1-466a-8a57-750151daa9ea/dns-node-resolver/0.log"
Sep 08 10:38:37.926270 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:37.926240    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2zsx5_4a41ec82-3e27-4c50-b580-861230051e27/node-ca/0.log"
Sep 08 10:38:38.949517 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:38.949484    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cn8g6_21f0eabe-633e-42f3-8d52-409164a38bc1/serve-healthcheck-canary/0.log"
Sep 08 10:38:39.361142 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:39.361110    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2kdk4_e333d509-2175-41f6-9d0f-ebfa94b37e43/kube-rbac-proxy/0.log"
Sep 08 10:38:39.390681 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:39.390656    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2kdk4_e333d509-2175-41f6-9d0f-ebfa94b37e43/exporter/0.log"
Sep 08 10:38:39.416074 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:39.416045    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-2kdk4_e333d509-2175-41f6-9d0f-ebfa94b37e43/extractor/0.log"
Sep 08 10:38:43.078253 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:43.078226    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ft9rp/perf-node-gather-daemonset-fl2mg"
Sep 08 10:38:43.630854 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:43.630826    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-94xm8_4c75e142-262c-49b8-89ee-154156d7bd5c/migrator/0.log"
Sep 08 10:38:43.663965 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:43.663934    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-94xm8_4c75e142-262c-49b8-89ee-154156d7bd5c/graceful-termination/0.log"
Sep 08 10:38:43.988669 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:43.988572    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-wdqrw_e4d77eca-04c2-456f-b337-e33b3d1981aa/kube-storage-version-migrator-operator/1.log"
Sep 08 10:38:43.990309 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:43.990287    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-wdqrw_e4d77eca-04c2-456f-b337-e33b3d1981aa/kube-storage-version-migrator-operator/0.log"
Sep 08 10:38:44.773910 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:44.773875    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-85r8m_03e3282b-d719-4d88-ac22-72691939bdac/kube-multus/0.log"
Sep 08 10:38:45.042297 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:45.042206    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dcfdx_1425c284-4dee-4ed4-a65f-8c1dc7283c8f/kube-multus-additional-cni-plugins/0.log"
Sep 08 10:38:45.066204 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:45.066173    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dcfdx_1425c284-4dee-4ed4-a65f-8c1dc7283c8f/egress-router-binary-copy/0.log"
Sep 08 10:38:45.089352 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:45.089323    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dcfdx_1425c284-4dee-4ed4-a65f-8c1dc7283c8f/cni-plugins/0.log"
Sep 08 10:38:45.112428 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:45.112401    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dcfdx_1425c284-4dee-4ed4-a65f-8c1dc7283c8f/bond-cni-plugin/0.log"
Sep 08 10:38:45.135193 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:45.135159    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dcfdx_1425c284-4dee-4ed4-a65f-8c1dc7283c8f/routeoverride-cni/0.log"
Sep 08 10:38:45.158292 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:45.158263    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dcfdx_1425c284-4dee-4ed4-a65f-8c1dc7283c8f/whereabouts-cni-bincopy/0.log"
Sep 08 10:38:45.181903 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:45.181875    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dcfdx_1425c284-4dee-4ed4-a65f-8c1dc7283c8f/whereabouts-cni/0.log"
Sep 08 10:38:45.471642 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:45.471531    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-b5m55_3868a1c3-46c6-4940-92ed-e460b77d7cfc/network-metrics-daemon/0.log"
Sep 08 10:38:45.495674 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:45.495652    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-b5m55_3868a1c3-46c6-4940-92ed-e460b77d7cfc/kube-rbac-proxy/0.log"
Sep 08 10:38:46.665813 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:46.665784    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kz86g_0c248488-2449-4ff6-a079-8b466acd152e/ovn-controller/0.log"
Sep 08 10:38:46.685117 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:46.685090    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kz86g_0c248488-2449-4ff6-a079-8b466acd152e/ovn-acl-logging/0.log"
Sep 08 10:38:46.717693 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:46.717659    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kz86g_0c248488-2449-4ff6-a079-8b466acd152e/kube-rbac-proxy-node/0.log"
Sep 08 10:38:46.744319 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:46.744295    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kz86g_0c248488-2449-4ff6-a079-8b466acd152e/kube-rbac-proxy-ovn-metrics/0.log"
Sep 08 10:38:46.763518 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:46.763494    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kz86g_0c248488-2449-4ff6-a079-8b466acd152e/northd/0.log"
Sep 08 10:38:46.787782 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:46.787765    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kz86g_0c248488-2449-4ff6-a079-8b466acd152e/nbdb/0.log"
Sep 08 10:38:46.812399 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:46.812373    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kz86g_0c248488-2449-4ff6-a079-8b466acd152e/sbdb/0.log"
Sep 08 10:38:46.870729 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:46.870701    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-kz86g_0c248488-2449-4ff6-a079-8b466acd152e/ovnkube-controller/0.log"
Sep 08 10:38:48.222044 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:48.222017    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-8lnsn_6829ca1d-d62e-446a-a557-43217aba9a6f/network-check-target-container/0.log"
Sep 08 10:38:49.128472 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:49.128442    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-pjsr4_1fa9f2a5-3fe1-439f-ac9d-c17fbb4a1e8e/iptables-alerter/0.log"
Sep 08 10:38:49.813123 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:49.813095    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-l52p6_90152f2b-6780-4ce9-8938-aedd788ac94c/tuned/0.log"
Sep 08 10:38:51.596893 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:51.596857    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-7cdcfcf76c-nf99n_d816c15e-c5d3-4149-a6da-3288c3d632e4/cluster-samples-operator/0.log"
Sep 08 10:38:51.615894 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:51.615865    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-7cdcfcf76c-nf99n_d816c15e-c5d3-4149-a6da-3288c3d632e4/cluster-samples-operator-watch/0.log"
Sep 08 10:38:52.532015 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:52.531973    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-859f94c4b-dxh7f_e9472cec-3760-4eca-9c6f-7f0e449c1445/service-ca-operator/1.log"
Sep 08 10:38:52.533615 ip-10-0-132-96 kubenswrapper[2579]: I0908 10:38:52.533593    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-859f94c4b-dxh7f_e9472cec-3760-4eca-9c6f-7f0e449c1445/service-ca-operator/0.log"