Jul 28 16:50:10.399271 ip-10-0-128-92 systemd[1]: Starting Kubernetes Kubelet...
Jul 28 16:50:10.796767 ip-10-0-128-92 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 16:50:10.796767 ip-10-0-128-92 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 28 16:50:10.796767 ip-10-0-128-92 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 16:50:10.796767 ip-10-0-128-92 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 28 16:50:10.796767 ip-10-0-128-92 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 16:50:10.797554 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.796793    2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 28 16:50:10.803437 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803413    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 16:50:10.803437 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803437    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 16:50:10.803437 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803441    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 16:50:10.803543 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803444    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 16:50:10.803543 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803447    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 16:50:10.803543 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803450    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 16:50:10.803543 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803453    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 16:50:10.803543 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803456    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 16:50:10.803543 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803458    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 16:50:10.803543 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803462    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 16:50:10.803543 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803464    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 16:50:10.803543 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803467    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 16:50:10.803543 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803469    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 16:50:10.803543 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803472    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 16:50:10.803543 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803474    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 16:50:10.803543 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803477    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 16:50:10.803543 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803480    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 16:50:10.803543 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803485    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 16:50:10.803543 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803489    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 16:50:10.803543 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803492    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 16:50:10.803543 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803495    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 16:50:10.803543 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803504    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 16:50:10.803543 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803508    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 16:50:10.804030 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803510    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 16:50:10.804030 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803513    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 16:50:10.804030 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803517    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 16:50:10.804030 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803521    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 16:50:10.804030 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803524    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 16:50:10.804030 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803527    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 16:50:10.804030 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803529    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 16:50:10.804030 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803533    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 16:50:10.804030 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803535    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 16:50:10.804030 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803538    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 16:50:10.804030 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803541    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 16:50:10.804030 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803543    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 16:50:10.804030 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803546    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 16:50:10.804030 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803549    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 16:50:10.804030 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803552    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 16:50:10.804030 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803555    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 16:50:10.804030 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803558    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 16:50:10.804030 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803560    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 16:50:10.804030 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803563    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 16:50:10.804490 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803565    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 16:50:10.804490 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803568    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 16:50:10.804490 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803570    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 16:50:10.804490 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803573    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 16:50:10.804490 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803575    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 16:50:10.804490 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803579    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 16:50:10.804490 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803581    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 16:50:10.804490 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803584    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 16:50:10.804490 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803586    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 16:50:10.804490 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803589    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 16:50:10.804490 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803592    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 16:50:10.804490 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803594    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 16:50:10.804490 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803597    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 16:50:10.804490 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803600    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 16:50:10.804490 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803603    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 16:50:10.804490 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803606    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 16:50:10.804490 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803608    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 16:50:10.804490 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803613    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 16:50:10.804490 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803616    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 16:50:10.805003 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803619    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 16:50:10.805003 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803622    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 16:50:10.805003 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803624    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 16:50:10.805003 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803627    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 16:50:10.805003 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803629    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 16:50:10.805003 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803632    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 16:50:10.805003 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803634    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 16:50:10.805003 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803637    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 16:50:10.805003 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803639    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 16:50:10.805003 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803642    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 16:50:10.805003 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803651    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 16:50:10.805003 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803654    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 16:50:10.805003 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803656    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 16:50:10.805003 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803659    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 16:50:10.805003 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803662    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 16:50:10.805003 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803664    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 16:50:10.805003 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803667    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 16:50:10.805003 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803669    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 16:50:10.805003 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803672    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 16:50:10.805003 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803675    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 16:50:10.805485 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803677    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 16:50:10.805485 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803680    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 16:50:10.805485 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803682    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 16:50:10.805485 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803686    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 16:50:10.805485 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803689    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 16:50:10.805485 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803691    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 16:50:10.805485 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803694    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 16:50:10.805485 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803698    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 16:50:10.805485 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803701    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 16:50:10.805485 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803704    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 16:50:10.805485 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803706    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 16:50:10.805485 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803709    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 16:50:10.805485 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803711    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 16:50:10.805485 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803714    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 16:50:10.805485 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803716    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 16:50:10.805485 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803719    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 16:50:10.805485 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803721    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 16:50:10.805485 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.803724    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 16:50:10.805485 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804519    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 16:50:10.805485 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804525    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 16:50:10.805998 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804528    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 16:50:10.805998 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804531    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 16:50:10.805998 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804533    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 16:50:10.805998 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804538    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 16:50:10.805998 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804542    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 16:50:10.805998 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804544    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 16:50:10.805998 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804547    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 16:50:10.805998 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804550    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 16:50:10.805998 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804552    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 16:50:10.805998 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804556    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 16:50:10.805998 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804560    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 16:50:10.805998 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804562    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 16:50:10.805998 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804565    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 16:50:10.805998 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804567    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 16:50:10.805998 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804570    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 16:50:10.805998 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804572    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 16:50:10.805998 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804575    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 16:50:10.805998 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804578    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 16:50:10.805998 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804581    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 16:50:10.805998 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804584    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 16:50:10.806506 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804587    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 16:50:10.806506 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804589    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 16:50:10.806506 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804592    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 16:50:10.806506 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804595    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 16:50:10.806506 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804599    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 16:50:10.806506 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804602    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 16:50:10.806506 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804605    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 16:50:10.806506 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804608    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 16:50:10.806506 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804610    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 16:50:10.806506 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804613    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 16:50:10.806506 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804615    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 16:50:10.806506 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804618    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 16:50:10.806506 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804620    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 16:50:10.806506 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804623    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 16:50:10.806506 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804625    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 16:50:10.806506 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804628    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 16:50:10.806506 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804631    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 16:50:10.806506 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804633    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 16:50:10.806506 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804636    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 16:50:10.806990 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804638    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 16:50:10.806990 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804641    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 16:50:10.806990 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804643    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 16:50:10.806990 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804645    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 16:50:10.806990 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804648    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 16:50:10.806990 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804651    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 16:50:10.806990 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804653    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 16:50:10.806990 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804656    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 16:50:10.806990 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804658    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 16:50:10.806990 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804661    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 16:50:10.806990 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804663    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 16:50:10.806990 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804666    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 16:50:10.806990 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804669    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 16:50:10.806990 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804671    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 16:50:10.806990 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804674    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 16:50:10.806990 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804676    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 16:50:10.806990 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804679    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 16:50:10.806990 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804681    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 16:50:10.806990 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804684    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 16:50:10.806990 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804686    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 16:50:10.807472 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804689    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 16:50:10.807472 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804692    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 16:50:10.807472 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804695    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 16:50:10.807472 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804697    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 16:50:10.807472 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804700    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 16:50:10.807472 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804702    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 16:50:10.807472 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804704    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 16:50:10.807472 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804707    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 16:50:10.807472 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804709    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 16:50:10.807472 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804712    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 16:50:10.807472 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804715    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 16:50:10.807472 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804717    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 16:50:10.807472 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804719    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 16:50:10.807472 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804722    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 16:50:10.807472 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804724    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 16:50:10.807472 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804726    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 16:50:10.807472 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804729    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 16:50:10.807472 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804732    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 16:50:10.807472 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804735    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 16:50:10.807472 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804737    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 16:50:10.807987 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804739    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 16:50:10.807987 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804742    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 16:50:10.807987 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804744    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 16:50:10.807987 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804747    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 16:50:10.807987 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804750    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 16:50:10.807987 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804752    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 16:50:10.807987 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804755    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 16:50:10.807987 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804758    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 16:50:10.807987 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804762    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 16:50:10.807987 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804765    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 16:50:10.807987 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804767    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 16:50:10.807987 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804770    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 16:50:10.807987 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804772    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 16:50:10.807987 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804775    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 16:50:10.807987 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804777    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 16:50:10.807987 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804780    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 16:50:10.807987 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804783    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 16:50:10.807987 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.804785    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 16:50:10.807987 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805233    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 16:50:10.807987 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805239    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 16:50:10.808466 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805245    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 16:50:10.808466 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805249    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 16:50:10.808466 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805254    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 16:50:10.808466 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805257    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 16:50:10.808466 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805260    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 16:50:10.808466 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805263    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 16:50:10.808466 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805266    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 16:50:10.808466 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805268    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 16:50:10.808466 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805271    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 16:50:10.808466 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805273    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 16:50:10.808466 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805275    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 16:50:10.808466 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805278    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 16:50:10.808466 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805280    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 16:50:10.808466 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805283    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 16:50:10.808466 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805285    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 16:50:10.808466 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805288    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 16:50:10.808466 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805290    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 16:50:10.808466 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805293    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 16:50:10.808466 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805295    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 16:50:10.808466 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805298    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 16:50:10.809011 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805301    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 16:50:10.809011 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805303    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 16:50:10.809011 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805306    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 16:50:10.809011 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805308    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 16:50:10.809011 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805310    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 16:50:10.809011 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805313    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 16:50:10.809011 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805316    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 16:50:10.809011 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805318    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 16:50:10.809011 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805321    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 16:50:10.809011 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805323    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 16:50:10.809011 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805326    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 16:50:10.809011 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805329    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 16:50:10.809011 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805335    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 16:50:10.809011 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805337    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 16:50:10.809011 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805340    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 16:50:10.809011 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805343    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 16:50:10.809011 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805345    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 16:50:10.809011 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805348    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 16:50:10.809011 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805350    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 16:50:10.809011 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805353    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 16:50:10.809590 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805355    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 16:50:10.809590 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805359    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 16:50:10.809590 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805361    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 16:50:10.809590 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805363    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 16:50:10.809590 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805366    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 16:50:10.809590 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805368    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 16:50:10.809590 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805371    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 16:50:10.809590 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805373    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 16:50:10.809590 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805377    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 16:50:10.809590 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805381    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 16:50:10.809590 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805384    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 16:50:10.809590 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805386    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 16:50:10.809590 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805389    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 16:50:10.809590 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805392    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 16:50:10.809590 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805394    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 16:50:10.809590 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805397    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 16:50:10.809590 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805399    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 16:50:10.809590 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805402    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 16:50:10.809590 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805404    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 16:50:10.810067 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805407    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 16:50:10.810067 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805409    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 16:50:10.810067 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805412    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 16:50:10.810067 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805414    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 16:50:10.810067 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805417    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 16:50:10.810067 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805421    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 16:50:10.810067 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805423    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 16:50:10.810067 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805425    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 16:50:10.810067 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805428    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 16:50:10.810067 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805431    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 16:50:10.810067 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805434    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 16:50:10.810067 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805436    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 16:50:10.810067 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805438    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 16:50:10.810067 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805441    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 16:50:10.810067 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805443    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 16:50:10.810067 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805446    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 16:50:10.810067 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805448    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 16:50:10.810067 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805452    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 16:50:10.810067 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805455    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 16:50:10.810521 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805458    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 16:50:10.810521 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805461    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 16:50:10.810521 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805464    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 16:50:10.810521 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805467    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 16:50:10.810521 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805470    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 16:50:10.810521 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805473    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 16:50:10.810521 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805475    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 16:50:10.810521 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805478    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 16:50:10.810521 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805480    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 16:50:10.810521 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805483    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 16:50:10.810521 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805485    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 16:50:10.810521 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805488    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 16:50:10.810521 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805491    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 16:50:10.810521 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805493    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 16:50:10.810521 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805496    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 16:50:10.810521 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805499    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 16:50:10.810521 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805502    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 16:50:10.810521 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805504    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 16:50:10.810521 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.805509    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 16:50:10.810521 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805580    2561 flags.go:64] FLAG: --address="0.0.0.0"
Jul 28 16:50:10.810521 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805592    2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 28 16:50:10.811040 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805599    2561 flags.go:64] FLAG: --anonymous-auth="true"
Jul 28 16:50:10.811040 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805603    2561 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 28 16:50:10.811040 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805608    2561 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 28 16:50:10.811040 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805611    2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 28 16:50:10.811040 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805615    2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 28 16:50:10.811040 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805620    2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 28 16:50:10.811040 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805623    2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 28 16:50:10.811040 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805625    2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 28 16:50:10.811040 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805629    2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 28 16:50:10.811040 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805632    2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 28 16:50:10.811040 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805635    2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 28 16:50:10.811040 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805638    2561 flags.go:64] FLAG: --cgroup-root=""
Jul 28 16:50:10.811040 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805640    2561 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 28 16:50:10.811040 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805644    2561 flags.go:64] FLAG: --client-ca-file=""
Jul 28 16:50:10.811040 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805647    2561 flags.go:64] FLAG: --cloud-provider="external"
Jul 28 16:50:10.811040 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805650    2561 flags.go:64] FLAG: --cluster-dns="[]"
Jul 28 16:50:10.811040 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805655    2561 flags.go:64] FLAG: --cluster-domain=""
Jul 28 16:50:10.811040 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805658    2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 28 16:50:10.811040 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805661    2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 28 16:50:10.811040 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805664    2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 28 16:50:10.811040 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805667    2561 flags.go:64] FLAG: --container-log-max-files="5"
Jul 28 16:50:10.811040 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805670    2561 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 28 16:50:10.811040 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805673    2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 28 16:50:10.811597 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805676    2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 28 16:50:10.811597 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805679    2561 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 28 16:50:10.811597 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805682    2561 flags.go:64] FLAG: --contention-profiling="false"
Jul 28 16:50:10.811597 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805685    2561 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 28 16:50:10.811597 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805688    2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 28 16:50:10.811597 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805691    2561 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 28 16:50:10.811597 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805694    2561 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 28 16:50:10.811597 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805698    2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 28 16:50:10.811597 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805701    2561 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 28 16:50:10.811597 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805703    2561 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 28 16:50:10.811597 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805706    2561 flags.go:64] FLAG: --enable-load-reader="false"
Jul 28 16:50:10.811597 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805710    2561 flags.go:64] FLAG: --enable-server="true"
Jul 28 16:50:10.811597 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805714    2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 28 16:50:10.811597 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805718    2561 flags.go:64] FLAG: --event-burst="100"
Jul 28 16:50:10.811597 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805721    2561 flags.go:64] FLAG: --event-qps="50"
Jul 28 16:50:10.811597 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805724    2561 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 28 16:50:10.811597 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805727    2561 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 28 16:50:10.811597 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805730    2561 flags.go:64] FLAG: --eviction-hard=""
Jul 28 16:50:10.811597 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805733    2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 28 16:50:10.811597 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805736    2561 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 28 16:50:10.811597 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805739    2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 28 16:50:10.811597 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805742    2561 flags.go:64] FLAG: --eviction-soft=""
Jul 28 16:50:10.811597 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805745    2561 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 28 16:50:10.811597 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805748    2561 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 28 16:50:10.811597 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805751    2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 28 16:50:10.812222 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805754    2561 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 28 16:50:10.812222 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805757    2561 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 28 16:50:10.812222 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805759    2561 flags.go:64] FLAG: --fail-swap-on="true"
Jul 28 16:50:10.812222 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805762    2561 flags.go:64] FLAG: --feature-gates=""
Jul 28 16:50:10.812222 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805766    2561 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 28 16:50:10.812222 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805769    2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 28 16:50:10.812222 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805772    2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 28 16:50:10.812222 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805775    2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 28 16:50:10.812222 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805778    2561 flags.go:64] FLAG: --healthz-port="10248"
Jul 28 16:50:10.812222 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805781    2561 flags.go:64] FLAG: --help="false"
Jul 28 16:50:10.812222 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805783    2561 flags.go:64] FLAG: --hostname-override="ip-10-0-128-92.ec2.internal"
Jul 28 16:50:10.812222 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805786    2561 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 28 16:50:10.812222 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805789    2561 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 28 16:50:10.812222 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805792    2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 28 16:50:10.812222 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805796    2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 28 16:50:10.812222 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805799    2561 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 28 16:50:10.812222 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805802    2561 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 28 16:50:10.812222 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805805    2561 flags.go:64] FLAG: --image-service-endpoint=""
Jul 28 16:50:10.812222 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805807    2561 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 28 16:50:10.812222 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805810    2561 flags.go:64] FLAG: --kube-api-burst="100"
Jul 28 16:50:10.812222 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805813    2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 28 16:50:10.812222 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805819    2561 flags.go:64] FLAG: --kube-api-qps="50"
Jul 28 16:50:10.812222 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805822    2561 flags.go:64] FLAG: --kube-reserved=""
Jul 28 16:50:10.812222 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805825    2561 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 28 16:50:10.812806 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805828    2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 28 16:50:10.812806 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805831    2561 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 28 16:50:10.812806 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805833    2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 28 16:50:10.812806 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805836    2561 flags.go:64] FLAG: --lock-file=""
Jul 28 16:50:10.812806 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805838    2561 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 28 16:50:10.812806 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805841    2561 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 28 16:50:10.812806 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805844    2561 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 28 16:50:10.812806 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805849    2561 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 28 16:50:10.812806 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805852    2561 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 28 16:50:10.812806 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805855    2561 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 28 16:50:10.812806 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805858    2561 flags.go:64] FLAG: --logging-format="text"
Jul 28 16:50:10.812806 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805860    2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 28 16:50:10.812806 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805864    2561 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 28 16:50:10.812806 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805866    2561 flags.go:64] FLAG: --manifest-url=""
Jul 28 16:50:10.812806 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805870    2561 flags.go:64] FLAG: --manifest-url-header=""
Jul 28 16:50:10.812806 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805874    2561 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 28 16:50:10.812806 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805877    2561 flags.go:64] FLAG: --max-open-files="1000000"
Jul 28 16:50:10.812806 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805881    2561 flags.go:64] FLAG: --max-pods="110"
Jul 28 16:50:10.812806 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805884    2561 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 28 16:50:10.812806 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805887    2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 28 16:50:10.812806 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805890    2561 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 28 16:50:10.812806 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805893    2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 28 16:50:10.812806 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805896    2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 28 16:50:10.812806 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805899    2561 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 28 16:50:10.812806 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805902    2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 28 16:50:10.813503 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805909    2561 flags.go:64] FLAG: --node-status-max-images="50"
Jul 28 16:50:10.813503 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805912    2561 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 28 16:50:10.813503 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805915    2561 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 28 16:50:10.813503 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805918    2561 flags.go:64] FLAG: --pod-cidr=""
Jul 28 16:50:10.813503 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805922    2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 28 16:50:10.813503 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805928    2561 flags.go:64] FLAG: --pod-manifest-path=""
Jul 28 16:50:10.813503 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805945    2561 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 28 16:50:10.813503 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805948    2561 flags.go:64] FLAG: --pods-per-core="0"
Jul 28 16:50:10.813503 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805951    2561 flags.go:64] FLAG: --port="10250"
Jul 28 16:50:10.813503 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805954    2561 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 28 16:50:10.813503 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805957    2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e4a82d415fea8d7a"
Jul 28 16:50:10.813503 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805960    2561 flags.go:64] FLAG: --qos-reserved=""
Jul 28 16:50:10.813503 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805963    2561 flags.go:64] FLAG: --read-only-port="10255"
Jul 28 16:50:10.813503 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805966    2561 flags.go:64] FLAG: --register-node="true"
Jul 28 16:50:10.813503 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805968    2561 flags.go:64] FLAG: --register-with-taints=""
Jul 28 16:50:10.813503 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805972    2561 flags.go:64] FLAG: --registry-burst="10"
Jul 28 16:50:10.813503 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805975    2561 flags.go:64] FLAG: --registry-qps="5"
Jul 28 16:50:10.813503 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805978    2561 flags.go:64] FLAG: --reserved-cpus=""
Jul 28 16:50:10.813503 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805980    2561 flags.go:64] FLAG: --reserved-memory=""
Jul 28 16:50:10.813503 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805984    2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 28 16:50:10.813503 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805987    2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 28 16:50:10.813503 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805990    2561 flags.go:64] FLAG: --rotate-certificates="false"
Jul 28 16:50:10.813503 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805994    2561 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 28 16:50:10.813503 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805997    2561 flags.go:64] FLAG: --runonce="false"
Jul 28 16:50:10.813503 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.805999    2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 28 16:50:10.814139 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.806003    2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 28 16:50:10.814139 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.806006    2561 flags.go:64] FLAG: --seccomp-default="false"
Jul 28 16:50:10.814139 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.806009    2561 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 28 16:50:10.814139 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.806012    2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 28 16:50:10.814139 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.806015    2561 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 28 16:50:10.814139 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.806018    2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 28 16:50:10.814139 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.806021    2561 flags.go:64] FLAG: --storage-driver-password="root"
Jul 28 16:50:10.814139 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.806023    2561 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 28 16:50:10.814139 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.806026    2561 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 28 16:50:10.814139 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.806029    2561 flags.go:64] FLAG: --storage-driver-user="root"
Jul 28 16:50:10.814139 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.806032    2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 28 16:50:10.814139 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.806034    2561 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 28 16:50:10.814139 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.806039    2561 flags.go:64] FLAG: --system-cgroups=""
Jul 28 16:50:10.814139 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.806042    2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 28 16:50:10.814139 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.806047    2561 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 28 16:50:10.814139 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.806050    2561 flags.go:64] FLAG: --tls-cert-file=""
Jul 28 16:50:10.814139 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.806053    2561 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 28 16:50:10.814139 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.806057    2561 flags.go:64] FLAG: --tls-min-version=""
Jul 28 16:50:10.814139 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.806060    2561 flags.go:64] FLAG: --tls-private-key-file=""
Jul 28 16:50:10.814139 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.806063    2561 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 28 16:50:10.814139 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.806065    2561 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 28 16:50:10.814139 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.806068    2561 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 28 16:50:10.814139 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.806071    2561 flags.go:64] FLAG: --v="2"
Jul 28 16:50:10.814139 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.806075    2561 flags.go:64] FLAG: --version="false"
Jul 28 16:50:10.814139 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.806079    2561 flags.go:64] FLAG: --vmodule=""
Jul 28 16:50:10.814748 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.806083    2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 28 16:50:10.814748 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.806087    2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 28 16:50:10.814748 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806207    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 16:50:10.814748 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806210    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 16:50:10.814748 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806216    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 16:50:10.814748 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806220    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 16:50:10.814748 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806223    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 16:50:10.814748 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806226    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 16:50:10.814748 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806229    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 16:50:10.814748 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806231    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 16:50:10.814748 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806234    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 16:50:10.814748 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806237    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 16:50:10.814748 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806240    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 16:50:10.814748 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806242    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 16:50:10.814748 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806245    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 16:50:10.814748 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806248    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 16:50:10.814748 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806250    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 16:50:10.814748 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806253    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 16:50:10.814748 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806256    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 16:50:10.815234 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806260    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 16:50:10.815234 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806263    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 16:50:10.815234 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806266    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 16:50:10.815234 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806268    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 16:50:10.815234 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806271    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 16:50:10.815234 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806273    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 16:50:10.815234 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806276    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 16:50:10.815234 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806278    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 16:50:10.815234 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806281    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 16:50:10.815234 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806283    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 16:50:10.815234 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806286    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 16:50:10.815234 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806288    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 16:50:10.815234 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806291    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 16:50:10.815234 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806293    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 16:50:10.815234 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806296    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 16:50:10.815234 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806299    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 16:50:10.815234 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806301    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 16:50:10.815234 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806305    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 16:50:10.815234 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806308    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 16:50:10.815234 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806311    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 16:50:10.815719 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806314    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 16:50:10.815719 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806316    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 16:50:10.815719 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806319    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 16:50:10.815719 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806321    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 16:50:10.815719 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806324    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 16:50:10.815719 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806326    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 16:50:10.815719 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806329    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 16:50:10.815719 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806332    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 16:50:10.815719 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806334    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 16:50:10.815719 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806337    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 16:50:10.815719 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806339    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 16:50:10.815719 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806342    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 16:50:10.815719 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806345    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 16:50:10.815719 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806348    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 16:50:10.815719 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806351    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 16:50:10.815719 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806354    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 16:50:10.815719 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806356    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 16:50:10.815719 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806359    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 16:50:10.815719 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806361    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 16:50:10.816198 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806364    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 16:50:10.816198 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806367    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 16:50:10.816198 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806370    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 16:50:10.816198 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806372    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 16:50:10.816198 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806375    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 16:50:10.816198 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806377    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 16:50:10.816198 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806380    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 16:50:10.816198 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806382    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 16:50:10.816198 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806385    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 16:50:10.816198 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806389    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 16:50:10.816198 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806393    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 16:50:10.816198 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806396    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 16:50:10.816198 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806399    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 16:50:10.816198 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806402    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 16:50:10.816198 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806405    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 16:50:10.816198 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806407    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 16:50:10.816198 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806410    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 16:50:10.816198 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806412    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 16:50:10.816198 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806415    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 16:50:10.816656 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806418    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 16:50:10.816656 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806421    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 16:50:10.816656 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806423    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 16:50:10.816656 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806425    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 16:50:10.816656 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806428    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 16:50:10.816656 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806430    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 16:50:10.816656 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806434    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 16:50:10.816656 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806436    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 16:50:10.816656 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806439    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 16:50:10.816656 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806442    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 16:50:10.816656 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806445    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 16:50:10.816656 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806447    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 16:50:10.816656 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806450    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 16:50:10.816656 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806452    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 16:50:10.816656 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806455    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 16:50:10.816656 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806457    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 16:50:10.816656 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806460    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 16:50:10.816656 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806463    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 16:50:10.816656 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806465    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 16:50:10.816656 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806468    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 16:50:10.817169 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806470    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 16:50:10.817169 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806473    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 16:50:10.817169 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806476    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 16:50:10.817169 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.806481    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 16:50:10.817169 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.806955    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 16:50:10.817169 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.815245    2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 28 16:50:10.817169 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.815264    2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 28 16:50:10.817169 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.815283    2561 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 28 16:50:10.817169 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.815289    2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 28 16:50:10.817169 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815354    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 16:50:10.817169 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815360    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 16:50:10.817169 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815363    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 16:50:10.817169 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815366    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 16:50:10.817169 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815369    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 16:50:10.817169 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815372    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 16:50:10.817555 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815375    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 16:50:10.817555 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815378    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 16:50:10.817555 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815380    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 16:50:10.817555 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815383    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 16:50:10.817555 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815386    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 16:50:10.817555 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815388    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 16:50:10.817555 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815391    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 16:50:10.817555 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815394    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 16:50:10.817555 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815396    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 16:50:10.817555 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815399    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 16:50:10.817555 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815401    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 16:50:10.817555 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815404    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 16:50:10.817555 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815406    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 16:50:10.817555 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815408    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 16:50:10.817555 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815411    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 16:50:10.817555 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815413    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 16:50:10.817555 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815416    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 16:50:10.817555 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815418    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 16:50:10.817555 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815420    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 16:50:10.817555 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815423    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 16:50:10.818061 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815425    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 16:50:10.818061 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815428    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 16:50:10.818061 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815430    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 16:50:10.818061 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815437    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 16:50:10.818061 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815439    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 16:50:10.818061 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815442    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 16:50:10.818061 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815444    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 16:50:10.818061 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815447    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 16:50:10.818061 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815449    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 16:50:10.818061 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815452    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 16:50:10.818061 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815455    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 16:50:10.818061 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815457    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 16:50:10.818061 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815460    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 16:50:10.818061 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815463    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 16:50:10.818061 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815467    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 16:50:10.818061 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815471    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 16:50:10.818061 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815474    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 16:50:10.818061 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815477    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 16:50:10.818061 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815480    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 16:50:10.818522 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815482    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 16:50:10.818522 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815485    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 16:50:10.818522 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815487    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 16:50:10.818522 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815490    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 16:50:10.818522 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815492    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 16:50:10.818522 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815495    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 16:50:10.818522 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815497    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 16:50:10.818522 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815500    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 16:50:10.818522 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815502    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 16:50:10.818522 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815505    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 16:50:10.818522 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815507    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 16:50:10.818522 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815510    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 16:50:10.818522 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815512    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 16:50:10.818522 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815515    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 16:50:10.818522 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815517    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 16:50:10.818522 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815520    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 16:50:10.818522 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815523    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 16:50:10.818522 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815526    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 16:50:10.818522 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815529    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 16:50:10.819030 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815531    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 16:50:10.819030 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815535    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 16:50:10.819030 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815539    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 16:50:10.819030 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815542    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 16:50:10.819030 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815545    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 16:50:10.819030 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815547    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 16:50:10.819030 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815549    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 16:50:10.819030 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815552    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 16:50:10.819030 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815554    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 16:50:10.819030 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815556    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 16:50:10.819030 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815559    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 16:50:10.819030 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815561    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 16:50:10.819030 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815564    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 16:50:10.819030 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815566    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 16:50:10.819030 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815568    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 16:50:10.819030 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815571    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 16:50:10.819030 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815575    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 16:50:10.819030 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815578    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 16:50:10.819030 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815581    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 16:50:10.819513 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815584    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 16:50:10.819513 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815586    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 16:50:10.819513 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815589    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 16:50:10.819513 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815591    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 16:50:10.819513 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815594    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 16:50:10.819513 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815596    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 16:50:10.819513 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815599    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 16:50:10.819513 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815601    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 16:50:10.819513 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815604    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 16:50:10.819513 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815606    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 16:50:10.819513 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815610    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 16:50:10.819513 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815612    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 16:50:10.819513 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815615    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 16:50:10.819513 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815618    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 16:50:10.819513 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815620    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 16:50:10.819513 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815623    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 16:50:10.819897 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.815628    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 16:50:10.819897 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815753    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 16:50:10.819897 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815759    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 16:50:10.819897 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815761    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 16:50:10.819897 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815764    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 16:50:10.819897 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815767    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 16:50:10.819897 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815770    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 16:50:10.819897 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815772    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 16:50:10.819897 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815775    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 16:50:10.819897 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815778    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 16:50:10.819897 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815781    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 16:50:10.819897 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815784    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 16:50:10.819897 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815786    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 16:50:10.819897 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815789    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 16:50:10.819897 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815792    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 16:50:10.820308 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815794    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 16:50:10.820308 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815797    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 16:50:10.820308 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815799    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 16:50:10.820308 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815802    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 16:50:10.820308 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815804    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 16:50:10.820308 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815807    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 16:50:10.820308 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815809    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 16:50:10.820308 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815812    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 16:50:10.820308 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815814    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 16:50:10.820308 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815817    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 16:50:10.820308 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815819    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 16:50:10.820308 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815822    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 16:50:10.820308 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815825    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 16:50:10.820308 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815828    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 16:50:10.820308 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815831    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 16:50:10.820308 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815833    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 16:50:10.820308 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815836    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 16:50:10.820308 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815839    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 16:50:10.820308 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815841    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 16:50:10.820308 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815843    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 16:50:10.820782 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815847    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 16:50:10.820782 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815851    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 16:50:10.820782 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815854    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 16:50:10.820782 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815856    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 16:50:10.820782 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815859    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 16:50:10.820782 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815862    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 16:50:10.820782 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815864    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 16:50:10.820782 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815867    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 16:50:10.820782 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815869    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 16:50:10.820782 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815872    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 16:50:10.820782 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815874    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 16:50:10.820782 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815877    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 16:50:10.820782 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815880    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 16:50:10.820782 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815883    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 16:50:10.820782 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815886    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 16:50:10.820782 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815888    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 16:50:10.820782 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815891    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 16:50:10.820782 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815893    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 16:50:10.820782 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815895    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 16:50:10.821283 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815898    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 16:50:10.821283 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815900    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 16:50:10.821283 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815902    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 16:50:10.821283 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815905    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 16:50:10.821283 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815907    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 16:50:10.821283 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815910    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 16:50:10.821283 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815913    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 16:50:10.821283 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815915    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 16:50:10.821283 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815918    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 16:50:10.821283 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815923    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 16:50:10.821283 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815926    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 16:50:10.821283 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815929    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 16:50:10.821283 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815945    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 16:50:10.821283 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815948    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 16:50:10.821283 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815950    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 16:50:10.821283 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815953    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 16:50:10.821283 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815955    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 16:50:10.821283 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815958    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 16:50:10.821283 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815961    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 16:50:10.821743 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815963    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 16:50:10.821743 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815966    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 16:50:10.821743 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815969    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 16:50:10.821743 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815971    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 16:50:10.821743 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815974    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 16:50:10.821743 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815976    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 16:50:10.821743 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815979    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 16:50:10.821743 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815981    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 16:50:10.821743 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815984    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 16:50:10.821743 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815986    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 16:50:10.821743 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815989    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 16:50:10.821743 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815991    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 16:50:10.821743 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815994    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 16:50:10.821743 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815997    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 16:50:10.821743 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.815999    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 16:50:10.821743 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.816002    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 16:50:10.821743 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.816004    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 16:50:10.821743 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.816006    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 16:50:10.821743 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.816009    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 16:50:10.821743 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.816012    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 16:50:10.822406 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.816014    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 16:50:10.822406 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.816017    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 16:50:10.822406 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.816020    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 16:50:10.822406 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.816023    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 16:50:10.822406 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.816025    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 16:50:10.822406 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.816027    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 16:50:10.822406 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:10.816030    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 16:50:10.822406 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.816035    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 16:50:10.822406 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.816173    2561 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 28 16:50:10.822406 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.818387    2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 28 16:50:10.822406 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.819825    2561 server.go:1019] "Starting client certificate rotation"
Jul 28 16:50:10.822406 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.819927    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 16:50:10.822406 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.819976    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 16:50:10.824540 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.824517    2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 16:50:10.830532 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.830511    2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 16:50:10.841299 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.841275    2561 log.go:25] "Validated CRI v1 runtime API"
Jul 28 16:50:10.843806 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.843791    2561 log.go:25] "Validated CRI v1 image API"
Jul 28 16:50:10.844640 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.844626    2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 28 16:50:10.846972 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.846950    2561 fs.go:135] Filesystem UUIDs: map[1b80e274-ceaa-4da7-b42e-36dd31751920:/dev/nvme0n1p3 6338f7c7-0427-4075-8f4c-411ace92d212:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Jul 28 16:50:10.847035 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.846971    2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 28 16:50:10.852067 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.851957    2561 manager.go:216] Machine: {Timestamp:2026-07-28 16:50:10.850643531 +0000 UTC m=+0.322057183 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3093793 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec29dabe7bf7d23d22ae28a1711b01d0 SystemUUID:ec29dabe-7bf7-d23d-22ae-28a1711b01d0 BootID:1ee8139a-a502-48c6-ac3a-25a3200f9c0b Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ed:3f:ae:26:65 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ed:3f:ae:26:65 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:32:45:52:fd:c8:be Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 28 16:50:10.852067 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.852065    2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 28 16:50:10.852175 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.852148    2561 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 28 16:50:10.854926 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.854902    2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 28 16:50:10.855086 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.854928    2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-92.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 28 16:50:10.855769 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.855759    2561 topology_manager.go:138] "Creating topology manager with none policy"
Jul 28 16:50:10.855807 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.855775    2561 container_manager_linux.go:309] "Creating device plugin manager"
Jul 28 16:50:10.855807 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.855785    2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 16:50:10.856518 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.856507    2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 16:50:10.857697 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.857686    2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 28 16:50:10.859946 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.859922    2561 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 16:50:10.860071 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.860061    2561 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 28 16:50:10.860716 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.860706    2561 kubelet.go:486] "Attempting to sync node with API server"
Jul 28 16:50:10.860773 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.860719    2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 28 16:50:10.860773 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.860740    2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 28 16:50:10.860773 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.860750    2561 kubelet.go:398] "Adding apiserver pod source"
Jul 28 16:50:10.860773 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.860759    2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 28 16:50:10.861122 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.861107    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 16:50:10.861223 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.861139    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 16:50:10.863222 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.863198    2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 28 16:50:10.865606 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.865577    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 16:50:10.866079 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.866053    2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 28 16:50:10.866175 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.866103    2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 28 16:50:10.868555 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.868536    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 28 16:50:10.868648 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.868560    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 28 16:50:10.868648 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.868569    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 28 16:50:10.868648 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.868577    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 28 16:50:10.868648 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.868588    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 28 16:50:10.868648 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.868596    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 28 16:50:10.868648 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.868608    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 28 16:50:10.868648 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.868617    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 28 16:50:10.868648 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.868626    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 28 16:50:10.868648 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.868635    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 28 16:50:10.868648 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.868648    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 28 16:50:10.869075 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.868657    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 28 16:50:10.869075 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.868694    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 28 16:50:10.869075 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.868703    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 28 16:50:10.872176 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.872158    2561 server.go:1268] "Started kubelet"
Jul 28 16:50:10.872596 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.872572    2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 28 16:50:10.872837 ip-10-0-128-92 systemd[1]: Started Kubernetes Kubelet.
Jul 28 16:50:10.873533 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.873471    2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 28 16:50:10.873906 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.873888    2561 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 28 16:50:10.874024 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.873999    2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-92.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 28 16:50:10.874514 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.874496    2561 server.go:310] "Adding debug handlers to kubelet server"
Jul 28 16:50:10.876372 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.876355    2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 28 16:50:10.879488 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:10.879470    2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 28 16:50:10.880644 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:10.880623    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 28 16:50:10.881414 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:10.880359    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-92.ec2.internal.18c682280faac8c1  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-92.ec2.internal,UID:ip-10-0-128-92.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-92.ec2.internal,},FirstTimestamp:2026-07-28 16:50:10.872133825 +0000 UTC m=+0.343547476,LastTimestamp:2026-07-28 16:50:10.872133825 +0000 UTC m=+0.343547476,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-92.ec2.internal,}"
Jul 28 16:50:10.884017 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:10.883996    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-92.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 28 16:50:10.885791 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.885772    2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 28 16:50:10.885791 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.885782    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 28 16:50:10.885949 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:10.885913    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-92.ec2.internal\" not found"
Jul 28 16:50:10.886468 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.886449    2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 28 16:50:10.886468 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.886451    2561 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 28 16:50:10.886603 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.886496    2561 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 28 16:50:10.886603 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.886546    2561 factory.go:55] Registering systemd factory
Jul 28 16:50:10.886603 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.886559    2561 factory.go:223] Registration of the systemd container factory successfully
Jul 28 16:50:10.886603 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.886580    2561 reconstruct.go:97] "Volume reconstruction finished"
Jul 28 16:50:10.886603 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.886589    2561 reconciler.go:29] "Reconciler: start to sync state"
Jul 28 16:50:10.886988 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.886972    2561 factory.go:153] Registering CRI-O factory
Jul 28 16:50:10.887049 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.886992    2561 factory.go:223] Registration of the crio container factory successfully
Jul 28 16:50:10.887049 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.887040    2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 28 16:50:10.887144 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.887063    2561 factory.go:103] Registering Raw factory
Jul 28 16:50:10.887144 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.887075    2561 manager.go:1196] Started watching for new ooms in manager
Jul 28 16:50:10.887627 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.887613    2561 manager.go:349] Starting recovery of all containers
Jul 28 16:50:10.888065 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:10.888030    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 28 16:50:10.888386 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:10.888360    2561 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-92.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 28 16:50:10.892330 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.892312    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-88bfx"
Jul 28 16:50:10.898665 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.898536    2561 manager.go:354] Recovery completed
Jul 28 16:50:10.902126 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.902105    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-88bfx"
Jul 28 16:50:10.902718 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.902705    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 16:50:10.904589 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.904572    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-92.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 16:50:10.904652 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.904603    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-92.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 16:50:10.904652 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.904617    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-92.ec2.internal" event="NodeHasSufficientPID"
Jul 28 16:50:10.905246 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.905230    2561 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 28 16:50:10.905246 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.905244    2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 28 16:50:10.905360 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.905259    2561 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 16:50:10.905360 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.905245    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 16:50:10.906145 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.906132    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-92.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 16:50:10.906194 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.906158    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-92.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 16:50:10.906194 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.906170    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-92.ec2.internal" event="NodeHasSufficientPID"
Jul 28 16:50:10.907057 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.907046    2561 policy_none.go:49] "None policy: Start"
Jul 28 16:50:10.907095 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.907062    2561 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 28 16:50:10.907095 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.907072    2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 28 16:50:10.907385 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:10.907317    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-92.ec2.internal.18c682281199fbab  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-92.ec2.internal,UID:ip-10-0-128-92.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-92.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-92.ec2.internal,},FirstTimestamp:2026-07-28 16:50:10.904587179 +0000 UTC m=+0.376000829,LastTimestamp:2026-07-28 16:50:10.904587179 +0000 UTC m=+0.376000829,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-92.ec2.internal,}"
Jul 28 16:50:10.908274 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.908262    2561 policy_none.go:47] "Start"
Jul 28 16:50:10.943502 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.943484    2561 manager.go:337] "Starting Device Plugin manager"
Jul 28 16:50:10.943601 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:10.943527    2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 28 16:50:10.943601 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.943538    2561 server.go:87] "Starting device plugin registration server"
Jul 28 16:50:10.943801 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.943789    2561 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 28 16:50:10.943831 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.943803    2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 28 16:50:10.943995 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.943964    2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 28 16:50:10.944093 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.944049    2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 28 16:50:10.944093 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:10.944061    2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 28 16:50:10.945237 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:10.945218    2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 28 16:50:10.945341 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:10.945268    2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-92.ec2.internal\" not found"
Jul 28 16:50:11.044318 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:11.044277    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 16:50:11.045419 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:11.045287    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-92.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 16:50:11.045419 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:11.045321    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-92.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 16:50:11.045419 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:11.045334    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-92.ec2.internal" event="NodeHasSufficientPID"
Jul 28 16:50:11.045419 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:11.045367    2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-92.ec2.internal"
Jul 28 16:50:11.052438 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:11.052387    2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-92.ec2.internal"
Jul 28 16:50:11.052438 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:11.052411    2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-92.ec2.internal\": node \"ip-10-0-128-92.ec2.internal\" not found"
Jul 28 16:50:11.066331 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:11.066304    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-92.ec2.internal\" not found"
Jul 28 16:50:11.068203 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:11.068178    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 28 16:50:11.069578 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:11.069561    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 28 16:50:11.069654 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:11.069607    2561 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 28 16:50:11.069654 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:11.069634    2561 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 28 16:50:11.069752 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:11.069675    2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 28 16:50:11.072897 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:11.072880    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 16:50:11.166626 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:11.166577    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-92.ec2.internal\" not found"
Jul 28 16:50:11.170737 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:11.170709    2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-92.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-92.ec2.internal"]
Jul 28 16:50:11.170796 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:11.170788    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 16:50:11.171810 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:11.171793    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-92.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 16:50:11.171888 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:11.171828    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-92.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 16:50:11.171888 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:11.171843    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-92.ec2.internal" event="NodeHasSufficientPID"
Jul 28 16:50:11.173349 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:11.173336    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 16:50:11.173464 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:11.173448    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-92.ec2.internal"
Jul 28 16:50:11.173499 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:11.173486    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 16:50:11.174085 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:11.174070    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-92.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 16:50:11.174163 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:11.174074    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-92.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 16:50:11.174163 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:11.174102    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-92.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 16:50:11.174163 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:11.174111    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-92.ec2.internal" event="NodeHasSufficientPID"
Jul 28 16:50:11.174163 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:11.174112    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-92.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 16:50:11.174163 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:11.174130    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-92.ec2.internal" event="NodeHasSufficientPID"
Jul 28 16:50:11.175502 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:11.175487    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-92.ec2.internal"
Jul 28 16:50:11.175550 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:11.175519    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 16:50:11.176232 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:11.176214    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-92.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 16:50:11.176307 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:11.176243    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-92.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 16:50:11.176307 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:11.176257    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-92.ec2.internal" event="NodeHasSufficientPID"
Jul 28 16:50:11.200511 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:11.200486    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-92.ec2.internal\" not found" node="ip-10-0-128-92.ec2.internal"
Jul 28 16:50:11.205116 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:11.205101    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-92.ec2.internal\" not found" node="ip-10-0-128-92.ec2.internal"
Jul 28 16:50:11.267201 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:11.267174    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-92.ec2.internal\" not found"
Jul 28 16:50:11.288037 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:11.288016    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/70f89e41a82f3ee988cac00f2f5c30a0-config\") pod \"kube-apiserver-proxy-ip-10-0-128-92.ec2.internal\" (UID: \"70f89e41a82f3ee988cac00f2f5c30a0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-92.ec2.internal"
Jul 28 16:50:11.288112 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:11.288041    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/996afe303aee28056553054cb3e66c94-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-92.ec2.internal\" (UID: \"996afe303aee28056553054cb3e66c94\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-92.ec2.internal"
Jul 28 16:50:11.288112 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:11.288060    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/996afe303aee28056553054cb3e66c94-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-92.ec2.internal\" (UID: \"996afe303aee28056553054cb3e66c94\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-92.ec2.internal"
Jul 28 16:50:11.368249 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:11.368189    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-92.ec2.internal\" not found"
Jul 28 16:50:11.388546 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:11.388521    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/70f89e41a82f3ee988cac00f2f5c30a0-config\") pod \"kube-apiserver-proxy-ip-10-0-128-92.ec2.internal\" (UID: \"70f89e41a82f3ee988cac00f2f5c30a0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-92.ec2.internal"
Jul 28 16:50:11.388603 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:11.388574    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/70f89e41a82f3ee988cac00f2f5c30a0-config\") pod \"kube-apiserver-proxy-ip-10-0-128-92.ec2.internal\" (UID: \"70f89e41a82f3ee988cac00f2f5c30a0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-92.ec2.internal"
Jul 28 16:50:11.388638 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:11.388603    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/996afe303aee28056553054cb3e66c94-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-92.ec2.internal\" (UID: \"996afe303aee28056553054cb3e66c94\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-92.ec2.internal"
Jul 28 16:50:11.388638 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:11.388625    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/996afe303aee28056553054cb3e66c94-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-92.ec2.internal\" (UID: \"996afe303aee28056553054cb3e66c94\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-92.ec2.internal"
Jul 28 16:50:11.388706 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:11.388648    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/996afe303aee28056553054cb3e66c94-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-92.ec2.internal\" (UID: \"996afe303aee28056553054cb3e66c94\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-92.ec2.internal"
Jul 28 16:50:11.388706 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:11.388682    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/996afe303aee28056553054cb3e66c94-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-92.ec2.internal\" (UID: \"996afe303aee28056553054cb3e66c94\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-92.ec2.internal"
Jul 28 16:50:11.468738 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:11.468693    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-92.ec2.internal\" not found"
Jul 28 16:50:11.504217 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:11.504188    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-92.ec2.internal"
Jul 28 16:50:11.509224 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:11.509202    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-92.ec2.internal"
Jul 28 16:50:11.569095 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:11.569059    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-92.ec2.internal\" not found"
Jul 28 16:50:11.669661 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:11.669591    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-92.ec2.internal\" not found"
Jul 28 16:50:11.770104 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:11.770063    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-92.ec2.internal\" not found"
Jul 28 16:50:11.819607 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:11.819581    2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 28 16:50:11.820059 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:11.819749    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 28 16:50:11.871010 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:11.870981    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-92.ec2.internal\" not found"
Jul 28 16:50:11.883106 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:11.883082    2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 16:50:11.907522 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:11.907498    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 16:45:11 +0000 UTC" deadline="2028-03-17 22:06:08.468652225 +0000 UTC"
Jul 28 16:50:11.907522 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:11.907520    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14357h15m56.561135105s"
Jul 28 16:50:11.971849 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:11.971790    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-92.ec2.internal\" not found"
Jul 28 16:50:12.072434 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:12.072408    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-92.ec2.internal\" not found"
Jul 28 16:50:12.173525 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:12.173499    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-92.ec2.internal\" not found"
Jul 28 16:50:12.249405 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:12.249368    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70f89e41a82f3ee988cac00f2f5c30a0.slice/crio-f4ab46b314610531fa9296a346d41787a9ae8d2c65d04fc0dc6919c1a6a19e8a WatchSource:0}: Error finding container f4ab46b314610531fa9296a346d41787a9ae8d2c65d04fc0dc6919c1a6a19e8a: Status 404 returned error can't find the container with id f4ab46b314610531fa9296a346d41787a9ae8d2c65d04fc0dc6919c1a6a19e8a
Jul 28 16:50:12.249842 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:12.249826    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod996afe303aee28056553054cb3e66c94.slice/crio-0df4ca1a5342932ccc1d2aeb445cdee7e48b503775fb61ec0c6522ac16a0d39e WatchSource:0}: Error finding container 0df4ca1a5342932ccc1d2aeb445cdee7e48b503775fb61ec0c6522ac16a0d39e: Status 404 returned error can't find the container with id 0df4ca1a5342932ccc1d2aeb445cdee7e48b503775fb61ec0c6522ac16a0d39e
Jul 28 16:50:12.254888 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.254874    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 16:50:12.273853 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:12.273834    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-92.ec2.internal\" not found"
Jul 28 16:50:12.300351 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.300331    2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 16:50:12.386408 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.386383    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-92.ec2.internal"
Jul 28 16:50:12.399996 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.399979    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 16:50:12.401968 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.401955    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-92.ec2.internal"
Jul 28 16:50:12.412103 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.412080    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 16:50:12.481838 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.481816    2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 16:50:12.862811 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.862767    2561 apiserver.go:52] "Watching apiserver"
Jul 28 16:50:12.873631 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.873605    2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 28 16:50:12.874113 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.874079    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-vn69s","openshift-network-diagnostics/network-check-target-hbfct","kube-system/global-pull-secret-syncer-fvtsl","openshift-cluster-node-tuning-operator/tuned-pmwsn","openshift-multus/multus-additional-cni-plugins-txmf4","openshift-multus/multus-q77xn","openshift-network-operator/iptables-alerter-5x69v","openshift-ovn-kubernetes/ovnkube-node-7st4p","kube-system/konnectivity-agent-gspwj","kube-system/kube-apiserver-proxy-ip-10-0-128-92.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svsd","openshift-dns/node-resolver-495dh","openshift-image-registry/node-ca-qrhwd","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-92.ec2.internal"]
Jul 28 16:50:12.875920 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.875832    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5x69v"
Jul 28 16:50:12.877331 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.877289    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qrhwd"
Jul 28 16:50:12.879080 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.878554    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 28 16:50:12.879080 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.878786    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 28 16:50:12.879240 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.879110    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 28 16:50:12.879566 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.879410    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-l8pw4\""
Jul 28 16:50:12.879975 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.879956    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:12.881552 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.881534    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pmwsn"
Jul 28 16:50:12.882264 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.882243    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 28 16:50:12.882435 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.882416    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 28 16:50:12.882655 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.882636    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-nvlfx\""
Jul 28 16:50:12.882822 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.882806    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 28 16:50:12.885585 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.883211    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-txmf4"
Jul 28 16:50:12.885585 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.885133    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q77xn"
Jul 28 16:50:12.886153 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.885960    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 28 16:50:12.887425 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.886446    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gspwj"
Jul 28 16:50:12.887998 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.887855    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vn69s"
Jul 28 16:50:12.887998 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:12.887959    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vn69s" podUID="ab2695e6-884f-4726-ba45-fe2772ee69a8"
Jul 28 16:50:12.894440 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.894416    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 28 16:50:12.896069 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.894697    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 28 16:50:12.896069 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.895057    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 28 16:50:12.896069 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.895050    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 28 16:50:12.896069 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.895355    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 28 16:50:12.896069 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.895424    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 28 16:50:12.896069 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.895685    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lfk9f\""
Jul 28 16:50:12.896069 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.895765    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 28 16:50:12.896069 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.896060    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 28 16:50:12.896498 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.896261    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 28 16:50:12.896498 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.896348    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gl279\""
Jul 28 16:50:12.896498 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.896471    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 28 16:50:12.897916 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.896657    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 28 16:50:12.897916 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.896681    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 28 16:50:12.897916 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.896814    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 28 16:50:12.897916 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.896856    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-9z289\""
Jul 28 16:50:12.897916 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.897056    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hbfct"
Jul 28 16:50:12.897916 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:12.897140    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hbfct" podUID="7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee"
Jul 28 16:50:12.897916 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.897276    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 28 16:50:12.897916 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.897283    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4np62\""
Jul 28 16:50:12.897916 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.897488    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-495dh"
Jul 28 16:50:12.897916 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.897526    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 28 16:50:12.897916 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.897591    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 28 16:50:12.900695 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.900677    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svsd"
Jul 28 16:50:12.901001 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.900976    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 28 16:50:12.901113 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.901067    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 28 16:50:12.901211 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.900677    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvtsl"
Jul 28 16:50:12.901270 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.900982    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-kx8hp\""
Jul 28 16:50:12.901839 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.901810    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-zdhlw\""
Jul 28 16:50:12.903969 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.903945    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-host-run-ovn-kubernetes\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:12.905171 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.905147    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dba5feb3-e14f-4764-b07c-406929f4587e-host\") pod \"tuned-pmwsn\" (UID: \"dba5feb3-e14f-4764-b07c-406929f4587e\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwsn"
Jul 28 16:50:12.905265 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.905200    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/43c3a34e-2451-4eb9-878c-8100a5d2ac48-agent-certs\") pod \"konnectivity-agent-gspwj\" (UID: \"43c3a34e-2451-4eb9-878c-8100a5d2ac48\") " pod="kube-system/konnectivity-agent-gspwj"
Jul 28 16:50:12.905265 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.905228    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:12.905265 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.905255    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-env-overrides\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:12.905422 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.905282    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5eef3908-3a57-4ba9-be8c-8c78354aaf2a-host-var-lib-cni-bin\") pod \"multus-q77xn\" (UID: \"5eef3908-3a57-4ba9-be8c-8c78354aaf2a\") " pod="openshift-multus/multus-q77xn"
Jul 28 16:50:12.905422 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.905307    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5eef3908-3a57-4ba9-be8c-8c78354aaf2a-host-run-multus-certs\") pod \"multus-q77xn\" (UID: \"5eef3908-3a57-4ba9-be8c-8c78354aaf2a\") " pod="openshift-multus/multus-q77xn"
Jul 28 16:50:12.905422 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.905331    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dba5feb3-e14f-4764-b07c-406929f4587e-etc-sysctl-d\") pod \"tuned-pmwsn\" (UID: \"dba5feb3-e14f-4764-b07c-406929f4587e\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwsn"
Jul 28 16:50:12.905579 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.905354    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dba5feb3-e14f-4764-b07c-406929f4587e-run\") pod \"tuned-pmwsn\" (UID: \"dba5feb3-e14f-4764-b07c-406929f4587e\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwsn"
Jul 28 16:50:12.905579 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.905545    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dba5feb3-e14f-4764-b07c-406929f4587e-lib-modules\") pod \"tuned-pmwsn\" (UID: \"dba5feb3-e14f-4764-b07c-406929f4587e\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwsn"
Jul 28 16:50:12.905683 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.905584    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8537db2a-96d8-4755-ae0b-40e2462c90c2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-txmf4\" (UID: \"8537db2a-96d8-4755-ae0b-40e2462c90c2\") " pod="openshift-multus/multus-additional-cni-plugins-txmf4"
Jul 28 16:50:12.905683 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.905612    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-run-ovn\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:12.905683 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.905635    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5eef3908-3a57-4ba9-be8c-8c78354aaf2a-cnibin\") pod \"multus-q77xn\" (UID: \"5eef3908-3a57-4ba9-be8c-8c78354aaf2a\") " pod="openshift-multus/multus-q77xn"
Jul 28 16:50:12.905683 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.905657    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5eef3908-3a57-4ba9-be8c-8c78354aaf2a-os-release\") pod \"multus-q77xn\" (UID: \"5eef3908-3a57-4ba9-be8c-8c78354aaf2a\") " pod="openshift-multus/multus-q77xn"
Jul 28 16:50:12.905885 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.905680    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxftt\" (UniqueName: \"kubernetes.io/projected/8537db2a-96d8-4755-ae0b-40e2462c90c2-kube-api-access-dxftt\") pod \"multus-additional-cni-plugins-txmf4\" (UID: \"8537db2a-96d8-4755-ae0b-40e2462c90c2\") " pod="openshift-multus/multus-additional-cni-plugins-txmf4"
Jul 28 16:50:12.905885 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.905708    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1540ebde-12ed-4345-98c4-ed0dd754c994-iptables-alerter-script\") pod \"iptables-alerter-5x69v\" (UID: \"1540ebde-12ed-4345-98c4-ed0dd754c994\") " pod="openshift-network-operator/iptables-alerter-5x69v"
Jul 28 16:50:12.905885 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.905732    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-systemd-units\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:12.905885 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.905757    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-var-lib-openvswitch\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:12.905885 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.905781    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dba5feb3-e14f-4764-b07c-406929f4587e-etc-sysconfig\") pod \"tuned-pmwsn\" (UID: \"dba5feb3-e14f-4764-b07c-406929f4587e\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwsn"
Jul 28 16:50:12.905885 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.905803    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-node-log\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:12.905885 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.905837    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5c2c260e-d050-44eb-90d3-da4d25ade88a-serviceca\") pod \"node-ca-qrhwd\" (UID: \"5c2c260e-d050-44eb-90d3-da4d25ade88a\") " pod="openshift-image-registry/node-ca-qrhwd"
Jul 28 16:50:12.905885 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.905860    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8537db2a-96d8-4755-ae0b-40e2462c90c2-os-release\") pod \"multus-additional-cni-plugins-txmf4\" (UID: \"8537db2a-96d8-4755-ae0b-40e2462c90c2\") " pod="openshift-multus/multus-additional-cni-plugins-txmf4"
Jul 28 16:50:12.906376 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.905895    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8537db2a-96d8-4755-ae0b-40e2462c90c2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-txmf4\" (UID: \"8537db2a-96d8-4755-ae0b-40e2462c90c2\") " pod="openshift-multus/multus-additional-cni-plugins-txmf4"
Jul 28 16:50:12.906376 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.905921    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87t5b\" (UniqueName: \"kubernetes.io/projected/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-kube-api-access-87t5b\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:12.906376 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.905945    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5eef3908-3a57-4ba9-be8c-8c78354aaf2a-system-cni-dir\") pod \"multus-q77xn\" (UID: \"5eef3908-3a57-4ba9-be8c-8c78354aaf2a\") " pod="openshift-multus/multus-q77xn"
Jul 28 16:50:12.906376 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.905969    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5eef3908-3a57-4ba9-be8c-8c78354aaf2a-multus-conf-dir\") pod \"multus-q77xn\" (UID: \"5eef3908-3a57-4ba9-be8c-8c78354aaf2a\") " pod="openshift-multus/multus-q77xn"
Jul 28 16:50:12.906376 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.906027    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5eef3908-3a57-4ba9-be8c-8c78354aaf2a-multus-daemon-config\") pod \"multus-q77xn\" (UID: \"5eef3908-3a57-4ba9-be8c-8c78354aaf2a\") " pod="openshift-multus/multus-q77xn"
Jul 28 16:50:12.906376 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.906053    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5eef3908-3a57-4ba9-be8c-8c78354aaf2a-etc-kubernetes\") pod \"multus-q77xn\" (UID: \"5eef3908-3a57-4ba9-be8c-8c78354aaf2a\") " pod="openshift-multus/multus-q77xn"
Jul 28 16:50:12.906376 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.906078    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw88z\" (UniqueName: \"kubernetes.io/projected/ab2695e6-884f-4726-ba45-fe2772ee69a8-kube-api-access-rw88z\") pod \"network-metrics-daemon-vn69s\" (UID: \"ab2695e6-884f-4726-ba45-fe2772ee69a8\") " pod="openshift-multus/network-metrics-daemon-vn69s"
Jul 28 16:50:12.906376 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.906103    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8537db2a-96d8-4755-ae0b-40e2462c90c2-system-cni-dir\") pod \"multus-additional-cni-plugins-txmf4\" (UID: \"8537db2a-96d8-4755-ae0b-40e2462c90c2\") " pod="openshift-multus/multus-additional-cni-plugins-txmf4"
Jul 28 16:50:12.906376 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.906127    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8537db2a-96d8-4755-ae0b-40e2462c90c2-cni-binary-copy\") pod \"multus-additional-cni-plugins-txmf4\" (UID: \"8537db2a-96d8-4755-ae0b-40e2462c90c2\") " pod="openshift-multus/multus-additional-cni-plugins-txmf4"
Jul 28 16:50:12.906376 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.906152    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-host-kubelet\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:12.906376 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.906176    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5eef3908-3a57-4ba9-be8c-8c78354aaf2a-multus-cni-dir\") pod \"multus-q77xn\" (UID: \"5eef3908-3a57-4ba9-be8c-8c78354aaf2a\") " pod="openshift-multus/multus-q77xn"
Jul 28 16:50:12.906376 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.906200    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5eef3908-3a57-4ba9-be8c-8c78354aaf2a-host-run-k8s-cni-cncf-io\") pod \"multus-q77xn\" (UID: \"5eef3908-3a57-4ba9-be8c-8c78354aaf2a\") " pod="openshift-multus/multus-q77xn"
Jul 28 16:50:12.906376 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.906223    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5eef3908-3a57-4ba9-be8c-8c78354aaf2a-host-run-netns\") pod \"multus-q77xn\" (UID: \"5eef3908-3a57-4ba9-be8c-8c78354aaf2a\") " pod="openshift-multus/multus-q77xn"
Jul 28 16:50:12.906376 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.906247    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5eef3908-3a57-4ba9-be8c-8c78354aaf2a-host-var-lib-kubelet\") pod \"multus-q77xn\" (UID: \"5eef3908-3a57-4ba9-be8c-8c78354aaf2a\") " pod="openshift-multus/multus-q77xn"
Jul 28 16:50:12.906376 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.906272    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dba5feb3-e14f-4764-b07c-406929f4587e-var-lib-kubelet\") pod \"tuned-pmwsn\" (UID: \"dba5feb3-e14f-4764-b07c-406929f4587e\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwsn"
Jul 28 16:50:12.906376 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.906295    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dba5feb3-e14f-4764-b07c-406929f4587e-etc-tuned\") pod \"tuned-pmwsn\" (UID: \"dba5feb3-e14f-4764-b07c-406929f4587e\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwsn"
Jul 28 16:50:12.907179 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.906319    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8537db2a-96d8-4755-ae0b-40e2462c90c2-cnibin\") pod \"multus-additional-cni-plugins-txmf4\" (UID: \"8537db2a-96d8-4755-ae0b-40e2462c90c2\") " pod="openshift-multus/multus-additional-cni-plugins-txmf4"
Jul 28 16:50:12.907179 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.906344    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92mn4\" (UniqueName: \"kubernetes.io/projected/1540ebde-12ed-4345-98c4-ed0dd754c994-kube-api-access-92mn4\") pod \"iptables-alerter-5x69v\" (UID: \"1540ebde-12ed-4345-98c4-ed0dd754c994\") " pod="openshift-network-operator/iptables-alerter-5x69v"
Jul 28 16:50:12.907179 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.906371    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-run-openvswitch\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:12.907179 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.906406    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dba5feb3-e14f-4764-b07c-406929f4587e-etc-systemd\") pod \"tuned-pmwsn\" (UID: \"dba5feb3-e14f-4764-b07c-406929f4587e\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwsn"
Jul 28 16:50:12.907179 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.906432    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8537db2a-96d8-4755-ae0b-40e2462c90c2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-txmf4\" (UID: \"8537db2a-96d8-4755-ae0b-40e2462c90c2\") " pod="openshift-multus/multus-additional-cni-plugins-txmf4"
Jul 28 16:50:12.907179 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.907088    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-run-systemd\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:12.907179 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.907130    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-host-cni-bin\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:12.907179 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.907155    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5eef3908-3a57-4ba9-be8c-8c78354aaf2a-host-var-lib-cni-multus\") pod \"multus-q77xn\" (UID: \"5eef3908-3a57-4ba9-be8c-8c78354aaf2a\") " pod="openshift-multus/multus-q77xn"
Jul 28 16:50:12.907571 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.907181    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22ks4\" (UniqueName: \"kubernetes.io/projected/5eef3908-3a57-4ba9-be8c-8c78354aaf2a-kube-api-access-22ks4\") pod \"multus-q77xn\" (UID: \"5eef3908-3a57-4ba9-be8c-8c78354aaf2a\") " pod="openshift-multus/multus-q77xn"
Jul 28 16:50:12.907571 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.907206    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dba5feb3-e14f-4764-b07c-406929f4587e-sys\") pod \"tuned-pmwsn\" (UID: \"dba5feb3-e14f-4764-b07c-406929f4587e\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwsn"
Jul 28 16:50:12.907571 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.907231    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/43c3a34e-2451-4eb9-878c-8100a5d2ac48-konnectivity-ca\") pod \"konnectivity-agent-gspwj\" (UID: \"43c3a34e-2451-4eb9-878c-8100a5d2ac48\") " pod="kube-system/konnectivity-agent-gspwj"
Jul 28 16:50:12.907571 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.904122    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 16:50:12.907571 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.906756    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qlqfq\""
Jul 28 16:50:12.907571 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:12.904218    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvtsl" podUID="9a7043cc-b151-4888-90cc-f3dae8a2a91d"
Jul 28 16:50:12.907571 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.906800    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 28 16:50:12.907903 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.907255    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-host-cni-netd\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:12.907903 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.907617    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-ovnkube-config\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:12.907903 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.907643    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5eef3908-3a57-4ba9-be8c-8c78354aaf2a-hostroot\") pod \"multus-q77xn\" (UID: \"5eef3908-3a57-4ba9-be8c-8c78354aaf2a\") " pod="openshift-multus/multus-q77xn"
Jul 28 16:50:12.907903 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.906905    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 28 16:50:12.907903 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.906993    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 28 16:50:12.907903 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.907668    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9w96\" (UniqueName: \"kubernetes.io/projected/5c2c260e-d050-44eb-90d3-da4d25ade88a-kube-api-access-s9w96\") pod \"node-ca-qrhwd\" (UID: \"5c2c260e-d050-44eb-90d3-da4d25ade88a\") " pod="openshift-image-registry/node-ca-qrhwd"
Jul 28 16:50:12.907903 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.907803    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dba5feb3-e14f-4764-b07c-406929f4587e-etc-modprobe-d\") pod \"tuned-pmwsn\" (UID: \"dba5feb3-e14f-4764-b07c-406929f4587e\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwsn"
Jul 28 16:50:12.907903 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.907826    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dba5feb3-e14f-4764-b07c-406929f4587e-etc-sysctl-conf\") pod \"tuned-pmwsn\" (UID: \"dba5feb3-e14f-4764-b07c-406929f4587e\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwsn"
Jul 28 16:50:12.907903 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.907846    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dba5feb3-e14f-4764-b07c-406929f4587e-tmp\") pod \"tuned-pmwsn\" (UID: \"dba5feb3-e14f-4764-b07c-406929f4587e\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwsn"
Jul 28 16:50:12.907903 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.907895    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1540ebde-12ed-4345-98c4-ed0dd754c994-host-slash\") pod \"iptables-alerter-5x69v\" (UID: \"1540ebde-12ed-4345-98c4-ed0dd754c994\") " pod="openshift-network-operator/iptables-alerter-5x69v"
Jul 28 16:50:12.908450 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.907918    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-host-run-netns\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:12.908450 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.907940    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5eef3908-3a57-4ba9-be8c-8c78354aaf2a-multus-socket-dir-parent\") pod \"multus-q77xn\" (UID: \"5eef3908-3a57-4ba9-be8c-8c78354aaf2a\") " pod="openshift-multus/multus-q77xn"
Jul 28 16:50:12.908450 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.907966    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dba5feb3-e14f-4764-b07c-406929f4587e-etc-kubernetes\") pod \"tuned-pmwsn\" (UID: \"dba5feb3-e14f-4764-b07c-406929f4587e\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwsn"
Jul 28 16:50:12.908450 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.908257    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5eef3908-3a57-4ba9-be8c-8c78354aaf2a-cni-binary-copy\") pod \"multus-q77xn\" (UID: \"5eef3908-3a57-4ba9-be8c-8c78354aaf2a\") " pod="openshift-multus/multus-q77xn"
Jul 28 16:50:12.908450 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.908280    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-ovn-node-metrics-cert\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:12.908728 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.908302    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab2695e6-884f-4726-ba45-fe2772ee69a8-metrics-certs\") pod \"network-metrics-daemon-vn69s\" (UID: \"ab2695e6-884f-4726-ba45-fe2772ee69a8\") " pod="openshift-multus/network-metrics-daemon-vn69s"
Jul 28 16:50:12.908728 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.908592    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5dkx\" (UniqueName: \"kubernetes.io/projected/dba5feb3-e14f-4764-b07c-406929f4587e-kube-api-access-m5dkx\") pod \"tuned-pmwsn\" (UID: \"dba5feb3-e14f-4764-b07c-406929f4587e\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwsn"
Jul 28 16:50:12.908728 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.908629    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-etc-openvswitch\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:12.908728 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.908652    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-ovnkube-script-lib\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:12.908728 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.908676    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-host-slash\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:12.908728 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.908697    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-log-socket\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:12.908728 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.908718    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5c2c260e-d050-44eb-90d3-da4d25ade88a-host\") pod \"node-ca-qrhwd\" (UID: \"5c2c260e-d050-44eb-90d3-da4d25ade88a\") " pod="openshift-image-registry/node-ca-qrhwd"
Jul 28 16:50:12.925725 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.925700    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-sq4ql"
Jul 28 16:50:12.935980 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.935957    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-sq4ql"
Jul 28 16:50:12.987527 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:12.987506    2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 28 16:50:13.009634 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.009604    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dba5feb3-e14f-4764-b07c-406929f4587e-etc-sysconfig\") pod \"tuned-pmwsn\" (UID: \"dba5feb3-e14f-4764-b07c-406929f4587e\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwsn"
Jul 28 16:50:13.009743 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.009687    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c78f3240-32b5-4e57-bc03-c1f9e08c28e5-tmp-dir\") pod \"node-resolver-495dh\" (UID: \"c78f3240-32b5-4e57-bc03-c1f9e08c28e5\") " pod="openshift-dns/node-resolver-495dh"
Jul 28 16:50:13.009743 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.009715    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-node-log\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:13.009743 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.009733    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/dba5feb3-e14f-4764-b07c-406929f4587e-etc-sysconfig\") pod \"tuned-pmwsn\" (UID: \"dba5feb3-e14f-4764-b07c-406929f4587e\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwsn"
Jul 28 16:50:13.009879 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.009739    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5c2c260e-d050-44eb-90d3-da4d25ade88a-serviceca\") pod \"node-ca-qrhwd\" (UID: \"5c2c260e-d050-44eb-90d3-da4d25ade88a\") " pod="openshift-image-registry/node-ca-qrhwd"
Jul 28 16:50:13.009879 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.009794    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8537db2a-96d8-4755-ae0b-40e2462c90c2-os-release\") pod \"multus-additional-cni-plugins-txmf4\" (UID: \"8537db2a-96d8-4755-ae0b-40e2462c90c2\") " pod="openshift-multus/multus-additional-cni-plugins-txmf4"
Jul 28 16:50:13.009879 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.009821    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8537db2a-96d8-4755-ae0b-40e2462c90c2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-txmf4\" (UID: \"8537db2a-96d8-4755-ae0b-40e2462c90c2\") " pod="openshift-multus/multus-additional-cni-plugins-txmf4"
Jul 28 16:50:13.009879 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.009849    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87t5b\" (UniqueName: \"kubernetes.io/projected/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-kube-api-access-87t5b\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:13.009879 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.009873    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5eef3908-3a57-4ba9-be8c-8c78354aaf2a-system-cni-dir\") pod \"multus-q77xn\" (UID: \"5eef3908-3a57-4ba9-be8c-8c78354aaf2a\") " pod="openshift-multus/multus-q77xn"
Jul 28 16:50:13.010140 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.009898    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5eef3908-3a57-4ba9-be8c-8c78354aaf2a-multus-conf-dir\") pod \"multus-q77xn\" (UID: \"5eef3908-3a57-4ba9-be8c-8c78354aaf2a\") " pod="openshift-multus/multus-q77xn"
Jul 28 16:50:13.010140 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.009921    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5eef3908-3a57-4ba9-be8c-8c78354aaf2a-multus-daemon-config\") pod \"multus-q77xn\" (UID: \"5eef3908-3a57-4ba9-be8c-8c78354aaf2a\") " pod="openshift-multus/multus-q77xn"
Jul 28 16:50:13.010140 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.009946    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5eef3908-3a57-4ba9-be8c-8c78354aaf2a-etc-kubernetes\") pod \"multus-q77xn\" (UID: \"5eef3908-3a57-4ba9-be8c-8c78354aaf2a\") " pod="openshift-multus/multus-q77xn"
Jul 28 16:50:13.010140 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.010004    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rw88z\" (UniqueName: \"kubernetes.io/projected/ab2695e6-884f-4726-ba45-fe2772ee69a8-kube-api-access-rw88z\") pod \"network-metrics-daemon-vn69s\" (UID: \"ab2695e6-884f-4726-ba45-fe2772ee69a8\") " pod="openshift-multus/network-metrics-daemon-vn69s"
Jul 28 16:50:13.010140 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.010031    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8537db2a-96d8-4755-ae0b-40e2462c90c2-system-cni-dir\") pod \"multus-additional-cni-plugins-txmf4\" (UID: \"8537db2a-96d8-4755-ae0b-40e2462c90c2\") " pod="openshift-multus/multus-additional-cni-plugins-txmf4"
Jul 28 16:50:13.010140 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.010056    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8537db2a-96d8-4755-ae0b-40e2462c90c2-cni-binary-copy\") pod \"multus-additional-cni-plugins-txmf4\" (UID: \"8537db2a-96d8-4755-ae0b-40e2462c90c2\") " pod="openshift-multus/multus-additional-cni-plugins-txmf4"
Jul 28 16:50:13.010140 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.010081    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-host-kubelet\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:13.010140 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.010108    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5eef3908-3a57-4ba9-be8c-8c78354aaf2a-multus-cni-dir\") pod \"multus-q77xn\" (UID: \"5eef3908-3a57-4ba9-be8c-8c78354aaf2a\") " pod="openshift-multus/multus-q77xn"
Jul 28 16:50:13.010140 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.010134    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5eef3908-3a57-4ba9-be8c-8c78354aaf2a-host-run-k8s-cni-cncf-io\") pod \"multus-q77xn\" (UID: \"5eef3908-3a57-4ba9-be8c-8c78354aaf2a\") " pod="openshift-multus/multus-q77xn"
Jul 28 16:50:13.010546 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.010158    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5eef3908-3a57-4ba9-be8c-8c78354aaf2a-host-run-netns\") pod \"multus-q77xn\" (UID: \"5eef3908-3a57-4ba9-be8c-8c78354aaf2a\") " pod="openshift-multus/multus-q77xn"
Jul 28 16:50:13.010546 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.010185    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5eef3908-3a57-4ba9-be8c-8c78354aaf2a-host-var-lib-kubelet\") pod \"multus-q77xn\" (UID: \"5eef3908-3a57-4ba9-be8c-8c78354aaf2a\") " pod="openshift-multus/multus-q77xn"
Jul 28 16:50:13.010546 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.010212    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dba5feb3-e14f-4764-b07c-406929f4587e-var-lib-kubelet\") pod \"tuned-pmwsn\" (UID: \"dba5feb3-e14f-4764-b07c-406929f4587e\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwsn"
Jul 28 16:50:13.010546 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.010233    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dba5feb3-e14f-4764-b07c-406929f4587e-etc-tuned\") pod \"tuned-pmwsn\" (UID: \"dba5feb3-e14f-4764-b07c-406929f4587e\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwsn"
Jul 28 16:50:13.010546 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.010248    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8537db2a-96d8-4755-ae0b-40e2462c90c2-cnibin\") pod \"multus-additional-cni-plugins-txmf4\" (UID: \"8537db2a-96d8-4755-ae0b-40e2462c90c2\") " pod="openshift-multus/multus-additional-cni-plugins-txmf4"
Jul 28 16:50:13.010546 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.010263    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92mn4\" (UniqueName: \"kubernetes.io/projected/1540ebde-12ed-4345-98c4-ed0dd754c994-kube-api-access-92mn4\") pod \"iptables-alerter-5x69v\" (UID: \"1540ebde-12ed-4345-98c4-ed0dd754c994\") " pod="openshift-network-operator/iptables-alerter-5x69v"
Jul 28 16:50:13.010546 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.010284    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-run-openvswitch\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:13.010546 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.010309    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dba5feb3-e14f-4764-b07c-406929f4587e-etc-systemd\") pod \"tuned-pmwsn\" (UID: \"dba5feb3-e14f-4764-b07c-406929f4587e\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwsn"
Jul 28 16:50:13.010546 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.010334    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8537db2a-96d8-4755-ae0b-40e2462c90c2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-txmf4\" (UID: \"8537db2a-96d8-4755-ae0b-40e2462c90c2\") " pod="openshift-multus/multus-additional-cni-plugins-txmf4"
Jul 28 16:50:13.010546 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.010367    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0eb1879f-3c34-490c-b09d-317b5ed656e9-device-dir\") pod \"aws-ebs-csi-driver-node-7svsd\" (UID: \"0eb1879f-3c34-490c-b09d-317b5ed656e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svsd"
Jul 28 16:50:13.010546 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.010393    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0eb1879f-3c34-490c-b09d-317b5ed656e9-etc-selinux\") pod \"aws-ebs-csi-driver-node-7svsd\" (UID: \"0eb1879f-3c34-490c-b09d-317b5ed656e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svsd"
Jul 28 16:50:13.010546 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.010396    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5c2c260e-d050-44eb-90d3-da4d25ade88a-serviceca\") pod \"node-ca-qrhwd\" (UID: \"5c2c260e-d050-44eb-90d3-da4d25ade88a\") " pod="openshift-image-registry/node-ca-qrhwd"
Jul 28 16:50:13.010546 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.010420    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lq2tq\" (UniqueName: \"kubernetes.io/projected/0eb1879f-3c34-490c-b09d-317b5ed656e9-kube-api-access-lq2tq\") pod \"aws-ebs-csi-driver-node-7svsd\" (UID: \"0eb1879f-3c34-490c-b09d-317b5ed656e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svsd"
Jul 28 16:50:13.010546 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.010453    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-run-systemd\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:13.010546 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.010481    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-host-cni-bin\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:13.010546 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.010488    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5eef3908-3a57-4ba9-be8c-8c78354aaf2a-host-run-k8s-cni-cncf-io\") pod \"multus-q77xn\" (UID: \"5eef3908-3a57-4ba9-be8c-8c78354aaf2a\") " pod="openshift-multus/multus-q77xn"
Jul 28 16:50:13.010546 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.010501    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5eef3908-3a57-4ba9-be8c-8c78354aaf2a-host-var-lib-cni-multus\") pod \"multus-q77xn\" (UID: \"5eef3908-3a57-4ba9-be8c-8c78354aaf2a\") " pod="openshift-multus/multus-q77xn"
Jul 28 16:50:13.011080 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.010519    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22ks4\" (UniqueName: \"kubernetes.io/projected/5eef3908-3a57-4ba9-be8c-8c78354aaf2a-kube-api-access-22ks4\") pod \"multus-q77xn\" (UID: \"5eef3908-3a57-4ba9-be8c-8c78354aaf2a\") " pod="openshift-multus/multus-q77xn"
Jul 28 16:50:13.011080 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.010535    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dba5feb3-e14f-4764-b07c-406929f4587e-sys\") pod \"tuned-pmwsn\" (UID: \"dba5feb3-e14f-4764-b07c-406929f4587e\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwsn"
Jul 28 16:50:13.011080 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.010554    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/43c3a34e-2451-4eb9-878c-8100a5d2ac48-konnectivity-ca\") pod \"konnectivity-agent-gspwj\" (UID: \"43c3a34e-2451-4eb9-878c-8100a5d2ac48\") " pod="kube-system/konnectivity-agent-gspwj"
Jul 28 16:50:13.011080 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.010541    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8537db2a-96d8-4755-ae0b-40e2462c90c2-os-release\") pod \"multus-additional-cni-plugins-txmf4\" (UID: \"8537db2a-96d8-4755-ae0b-40e2462c90c2\") " pod="openshift-multus/multus-additional-cni-plugins-txmf4"
Jul 28 16:50:13.011080 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.010614    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5eef3908-3a57-4ba9-be8c-8c78354aaf2a-host-run-netns\") pod \"multus-q77xn\" (UID: \"5eef3908-3a57-4ba9-be8c-8c78354aaf2a\") " pod="openshift-multus/multus-q77xn"
Jul 28 16:50:13.011080 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.010669    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5eef3908-3a57-4ba9-be8c-8c78354aaf2a-system-cni-dir\") pod \"multus-q77xn\" (UID: \"5eef3908-3a57-4ba9-be8c-8c78354aaf2a\") " pod="openshift-multus/multus-q77xn"
Jul 28 16:50:13.011080 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.010701    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5eef3908-3a57-4ba9-be8c-8c78354aaf2a-multus-conf-dir\") pod \"multus-q77xn\" (UID: \"5eef3908-3a57-4ba9-be8c-8c78354aaf2a\") " pod="openshift-multus/multus-q77xn"
Jul 28 16:50:13.011080 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.010724    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8537db2a-96d8-4755-ae0b-40e2462c90c2-tuning-conf-dir\") pod \"multus-additional-cni-plugins-txmf4\" (UID: \"8537db2a-96d8-4755-ae0b-40e2462c90c2\") " pod="openshift-multus/multus-additional-cni-plugins-txmf4"
Jul 28 16:50:13.011080 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.010763    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dba5feb3-e14f-4764-b07c-406929f4587e-var-lib-kubelet\") pod \"tuned-pmwsn\" (UID: \"dba5feb3-e14f-4764-b07c-406929f4587e\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwsn"
Jul 28 16:50:13.011080 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.010976    2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 28 16:50:13.011575 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.011095    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-node-log\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:13.011575 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.011152    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5eef3908-3a57-4ba9-be8c-8c78354aaf2a-multus-daemon-config\") pod \"multus-q77xn\" (UID: \"5eef3908-3a57-4ba9-be8c-8c78354aaf2a\") " pod="openshift-multus/multus-q77xn"
Jul 28 16:50:13.011575 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.011205    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-host-kubelet\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:13.011575 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.011306    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5eef3908-3a57-4ba9-be8c-8c78354aaf2a-multus-cni-dir\") pod \"multus-q77xn\" (UID: \"5eef3908-3a57-4ba9-be8c-8c78354aaf2a\") " pod="openshift-multus/multus-q77xn"
Jul 28 16:50:13.011575 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.010570    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c78f3240-32b5-4e57-bc03-c1f9e08c28e5-hosts-file\") pod \"node-resolver-495dh\" (UID: \"c78f3240-32b5-4e57-bc03-c1f9e08c28e5\") " pod="openshift-dns/node-resolver-495dh"
Jul 28 16:50:13.011575 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.011350    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-host-cni-netd\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:13.011575 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.011367    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-ovnkube-config\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:13.011575 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.011384    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5eef3908-3a57-4ba9-be8c-8c78354aaf2a-hostroot\") pod \"multus-q77xn\" (UID: \"5eef3908-3a57-4ba9-be8c-8c78354aaf2a\") " pod="openshift-multus/multus-q77xn"
Jul 28 16:50:13.011575 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.011409    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9w96\" (UniqueName: \"kubernetes.io/projected/5c2c260e-d050-44eb-90d3-da4d25ade88a-kube-api-access-s9w96\") pod \"node-ca-qrhwd\" (UID: \"5c2c260e-d050-44eb-90d3-da4d25ade88a\") " pod="openshift-image-registry/node-ca-qrhwd"
Jul 28 16:50:13.011575 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.011435    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0eb1879f-3c34-490c-b09d-317b5ed656e9-socket-dir\") pod \"aws-ebs-csi-driver-node-7svsd\" (UID: \"0eb1879f-3c34-490c-b09d-317b5ed656e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svsd"
Jul 28 16:50:13.011575 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.011453    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dba5feb3-e14f-4764-b07c-406929f4587e-etc-modprobe-d\") pod \"tuned-pmwsn\" (UID: \"dba5feb3-e14f-4764-b07c-406929f4587e\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwsn"
Jul 28 16:50:13.011575 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.011469    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dba5feb3-e14f-4764-b07c-406929f4587e-etc-sysctl-conf\") pod \"tuned-pmwsn\" (UID: \"dba5feb3-e14f-4764-b07c-406929f4587e\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwsn"
Jul 28 16:50:13.011575 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.011485    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dba5feb3-e14f-4764-b07c-406929f4587e-tmp\") pod \"tuned-pmwsn\" (UID: \"dba5feb3-e14f-4764-b07c-406929f4587e\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwsn"
Jul 28 16:50:13.011575 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.011509    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1540ebde-12ed-4345-98c4-ed0dd754c994-host-slash\") pod \"iptables-alerter-5x69v\" (UID: \"1540ebde-12ed-4345-98c4-ed0dd754c994\") " pod="openshift-network-operator/iptables-alerter-5x69v"
Jul 28 16:50:13.011575 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.011526    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-host-run-netns\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:13.011575 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.011553    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5eef3908-3a57-4ba9-be8c-8c78354aaf2a-multus-socket-dir-parent\") pod \"multus-q77xn\" (UID: \"5eef3908-3a57-4ba9-be8c-8c78354aaf2a\") " pod="openshift-multus/multus-q77xn"
Jul 28 16:50:13.011575 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.011569    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dba5feb3-e14f-4764-b07c-406929f4587e-etc-kubernetes\") pod \"tuned-pmwsn\" (UID: \"dba5feb3-e14f-4764-b07c-406929f4587e\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwsn"
Jul 28 16:50:13.011575 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.011575    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5eef3908-3a57-4ba9-be8c-8c78354aaf2a-etc-kubernetes\") pod \"multus-q77xn\" (UID: \"5eef3908-3a57-4ba9-be8c-8c78354aaf2a\") " pod="openshift-multus/multus-q77xn"
Jul 28 16:50:13.012505 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.011592    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5eef3908-3a57-4ba9-be8c-8c78354aaf2a-cni-binary-copy\") pod \"multus-q77xn\" (UID: \"5eef3908-3a57-4ba9-be8c-8c78354aaf2a\") " pod="openshift-multus/multus-q77xn"
Jul 28 16:50:13.012505 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.011611    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8537db2a-96d8-4755-ae0b-40e2462c90c2-cni-binary-copy\") pod \"multus-additional-cni-plugins-txmf4\" (UID: \"8537db2a-96d8-4755-ae0b-40e2462c90c2\") " pod="openshift-multus/multus-additional-cni-plugins-txmf4"
Jul 28 16:50:13.012505 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.011621    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-ovn-node-metrics-cert\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:13.012505 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.011639    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab2695e6-884f-4726-ba45-fe2772ee69a8-metrics-certs\") pod \"network-metrics-daemon-vn69s\" (UID: \"ab2695e6-884f-4726-ba45-fe2772ee69a8\") " pod="openshift-multus/network-metrics-daemon-vn69s"
Jul 28 16:50:13.012505 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.011654    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5dkx\" (UniqueName: \"kubernetes.io/projected/dba5feb3-e14f-4764-b07c-406929f4587e-kube-api-access-m5dkx\") pod \"tuned-pmwsn\" (UID: \"dba5feb3-e14f-4764-b07c-406929f4587e\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwsn"
Jul 28 16:50:13.012505 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.011661    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8537db2a-96d8-4755-ae0b-40e2462c90c2-system-cni-dir\") pod \"multus-additional-cni-plugins-txmf4\" (UID: \"8537db2a-96d8-4755-ae0b-40e2462c90c2\") " pod="openshift-multus/multus-additional-cni-plugins-txmf4"
Jul 28 16:50:13.012505 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.011675    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-etc-openvswitch\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:13.012505 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.011721    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-etc-openvswitch\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:13.012505 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.011761    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-host-cni-netd\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:13.012505 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.011784    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-run-openvswitch\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:13.012505 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.011825    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5eef3908-3a57-4ba9-be8c-8c78354aaf2a-hostroot\") pod \"multus-q77xn\" (UID: \"5eef3908-3a57-4ba9-be8c-8c78354aaf2a\") " pod="openshift-multus/multus-q77xn"
Jul 28 16:50:13.012505 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.011883    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-run-systemd\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:13.012505 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.011936    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-host-cni-bin\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:13.012505 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.011978    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5eef3908-3a57-4ba9-be8c-8c78354aaf2a-host-var-lib-cni-multus\") pod \"multus-q77xn\" (UID: \"5eef3908-3a57-4ba9-be8c-8c78354aaf2a\") " pod="openshift-multus/multus-q77xn"
Jul 28 16:50:13.012505 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.012033    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-ovnkube-script-lib\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:13.012505 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.012065    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-host-slash\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:13.012505 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.012092    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-log-socket\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:13.012505 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.012117    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5c2c260e-d050-44eb-90d3-da4d25ade88a-host\") pod \"node-ca-qrhwd\" (UID: \"5c2c260e-d050-44eb-90d3-da4d25ade88a\") " pod="openshift-image-registry/node-ca-qrhwd"
Jul 28 16:50:13.013456 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.012164    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bg7p\" (UniqueName: \"kubernetes.io/projected/c78f3240-32b5-4e57-bc03-c1f9e08c28e5-kube-api-access-4bg7p\") pod \"node-resolver-495dh\" (UID: \"c78f3240-32b5-4e57-bc03-c1f9e08c28e5\") " pod="openshift-dns/node-resolver-495dh"
Jul 28 16:50:13.013456 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.012180    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/dba5feb3-e14f-4764-b07c-406929f4587e-etc-modprobe-d\") pod \"tuned-pmwsn\" (UID: \"dba5feb3-e14f-4764-b07c-406929f4587e\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwsn"
Jul 28 16:50:13.013456 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.012192    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9a7043cc-b151-4888-90cc-f3dae8a2a91d-dbus\") pod \"global-pull-secret-syncer-fvtsl\" (UID: \"9a7043cc-b151-4888-90cc-f3dae8a2a91d\") " pod="kube-system/global-pull-secret-syncer-fvtsl"
Jul 28 16:50:13.013456 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.012223    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-host-run-ovn-kubernetes\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:13.013456 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.012248    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dba5feb3-e14f-4764-b07c-406929f4587e-host\") pod \"tuned-pmwsn\" (UID: \"dba5feb3-e14f-4764-b07c-406929f4587e\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwsn"
Jul 28 16:50:13.013456 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.012275    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/43c3a34e-2451-4eb9-878c-8100a5d2ac48-agent-certs\") pod \"konnectivity-agent-gspwj\" (UID: \"43c3a34e-2451-4eb9-878c-8100a5d2ac48\") " pod="kube-system/konnectivity-agent-gspwj"
Jul 28 16:50:13.013456 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.012309    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trqt6\" (UniqueName: \"kubernetes.io/projected/7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee-kube-api-access-trqt6\") pod \"network-check-target-hbfct\" (UID: \"7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee\") " pod="openshift-network-diagnostics/network-check-target-hbfct"
Jul 28 16:50:13.013456 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.012320    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-ovnkube-config\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:13.013456 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.012337    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0eb1879f-3c34-490c-b09d-317b5ed656e9-registration-dir\") pod \"aws-ebs-csi-driver-node-7svsd\" (UID: \"0eb1879f-3c34-490c-b09d-317b5ed656e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svsd"
Jul 28 16:50:13.013456 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.012363    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0eb1879f-3c34-490c-b09d-317b5ed656e9-sys-fs\") pod \"aws-ebs-csi-driver-node-7svsd\" (UID: \"0eb1879f-3c34-490c-b09d-317b5ed656e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svsd"
Jul 28 16:50:13.013456 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.012389    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a7043cc-b151-4888-90cc-f3dae8a2a91d-original-pull-secret\") pod \"global-pull-secret-syncer-fvtsl\" (UID: \"9a7043cc-b151-4888-90cc-f3dae8a2a91d\") " pod="kube-system/global-pull-secret-syncer-fvtsl"
Jul 28 16:50:13.013456 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.012421    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:13.013456 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.012449    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-env-overrides\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:13.013456 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.012476    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5eef3908-3a57-4ba9-be8c-8c78354aaf2a-host-var-lib-cni-bin\") pod \"multus-q77xn\" (UID: \"5eef3908-3a57-4ba9-be8c-8c78354aaf2a\") " pod="openshift-multus/multus-q77xn"
Jul 28 16:50:13.013456 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.012503    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5eef3908-3a57-4ba9-be8c-8c78354aaf2a-host-run-multus-certs\") pod \"multus-q77xn\" (UID: \"5eef3908-3a57-4ba9-be8c-8c78354aaf2a\") " pod="openshift-multus/multus-q77xn"
Jul 28 16:50:13.013456 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.012535    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dba5feb3-e14f-4764-b07c-406929f4587e-etc-sysctl-d\") pod \"tuned-pmwsn\" (UID: \"dba5feb3-e14f-4764-b07c-406929f4587e\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwsn"
Jul 28 16:50:13.013456 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.012579    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dba5feb3-e14f-4764-b07c-406929f4587e-run\") pod \"tuned-pmwsn\" (UID: \"dba5feb3-e14f-4764-b07c-406929f4587e\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwsn"
Jul 28 16:50:13.014499 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.012605    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dba5feb3-e14f-4764-b07c-406929f4587e-lib-modules\") pod \"tuned-pmwsn\" (UID: \"dba5feb3-e14f-4764-b07c-406929f4587e\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwsn"
Jul 28 16:50:13.014499 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.012634    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8537db2a-96d8-4755-ae0b-40e2462c90c2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-txmf4\" (UID: \"8537db2a-96d8-4755-ae0b-40e2462c90c2\") " pod="openshift-multus/multus-additional-cni-plugins-txmf4"
Jul 28 16:50:13.014499 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.012668    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-run-ovn\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:13.014499 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.012695    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5eef3908-3a57-4ba9-be8c-8c78354aaf2a-cnibin\") pod \"multus-q77xn\" (UID: \"5eef3908-3a57-4ba9-be8c-8c78354aaf2a\") " pod="openshift-multus/multus-q77xn"
Jul 28 16:50:13.014499 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.012751    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5eef3908-3a57-4ba9-be8c-8c78354aaf2a-os-release\") pod \"multus-q77xn\" (UID: \"5eef3908-3a57-4ba9-be8c-8c78354aaf2a\") " pod="openshift-multus/multus-q77xn"
Jul 28 16:50:13.014499 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.012774    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8537db2a-96d8-4755-ae0b-40e2462c90c2-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-txmf4\" (UID: \"8537db2a-96d8-4755-ae0b-40e2462c90c2\") " pod="openshift-multus/multus-additional-cni-plugins-txmf4"
Jul 28 16:50:13.014499 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.012782    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxftt\" (UniqueName: \"kubernetes.io/projected/8537db2a-96d8-4755-ae0b-40e2462c90c2-kube-api-access-dxftt\") pod \"multus-additional-cni-plugins-txmf4\" (UID: \"8537db2a-96d8-4755-ae0b-40e2462c90c2\") " pod="openshift-multus/multus-additional-cni-plugins-txmf4"
Jul 28 16:50:13.014499 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.012819    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0eb1879f-3c34-490c-b09d-317b5ed656e9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7svsd\" (UID: \"0eb1879f-3c34-490c-b09d-317b5ed656e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svsd"
Jul 28 16:50:13.014499 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.012845    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9a7043cc-b151-4888-90cc-f3dae8a2a91d-kubelet-config\") pod \"global-pull-secret-syncer-fvtsl\" (UID: \"9a7043cc-b151-4888-90cc-f3dae8a2a91d\") " pod="kube-system/global-pull-secret-syncer-fvtsl"
Jul 28 16:50:13.014499 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.012874    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1540ebde-12ed-4345-98c4-ed0dd754c994-iptables-alerter-script\") pod \"iptables-alerter-5x69v\" (UID: \"1540ebde-12ed-4345-98c4-ed0dd754c994\") " pod="openshift-network-operator/iptables-alerter-5x69v"
Jul 28 16:50:13.014499 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.012902    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-systemd-units\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:13.014499 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.012928    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-var-lib-openvswitch\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:13.014499 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.013052    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-var-lib-openvswitch\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:13.014499 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.013135    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-systemd-units\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:13.014499 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.013594    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-ovnkube-script-lib\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:13.014499 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.013621    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/43c3a34e-2451-4eb9-878c-8100a5d2ac48-konnectivity-ca\") pod \"konnectivity-agent-gspwj\" (UID: \"43c3a34e-2451-4eb9-878c-8100a5d2ac48\") " pod="kube-system/konnectivity-agent-gspwj"
Jul 28 16:50:13.014499 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.013666    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-host-slash\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:13.015367 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.012276    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/dba5feb3-e14f-4764-b07c-406929f4587e-etc-sysctl-conf\") pod \"tuned-pmwsn\" (UID: \"dba5feb3-e14f-4764-b07c-406929f4587e\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwsn"
Jul 28 16:50:13.015367 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.013834    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5eef3908-3a57-4ba9-be8c-8c78354aaf2a-host-var-lib-kubelet\") pod \"multus-q77xn\" (UID: \"5eef3908-3a57-4ba9-be8c-8c78354aaf2a\") " pod="openshift-multus/multus-q77xn"
Jul 28 16:50:13.015367 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.013915    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dba5feb3-e14f-4764-b07c-406929f4587e-sys\") pod \"tuned-pmwsn\" (UID: \"dba5feb3-e14f-4764-b07c-406929f4587e\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwsn"
Jul 28 16:50:13.015367 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.013953    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-log-socket\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:13.015367 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.013989    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5c2c260e-d050-44eb-90d3-da4d25ade88a-host\") pod \"node-ca-qrhwd\" (UID: \"5c2c260e-d050-44eb-90d3-da4d25ade88a\") " pod="openshift-image-registry/node-ca-qrhwd"
Jul 28 16:50:13.015367 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.014054    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-host-run-ovn-kubernetes\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:13.015367 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.014096    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/dba5feb3-e14f-4764-b07c-406929f4587e-host\") pod \"tuned-pmwsn\" (UID: \"dba5feb3-e14f-4764-b07c-406929f4587e\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwsn"
Jul 28 16:50:13.015367 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.014167    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1540ebde-12ed-4345-98c4-ed0dd754c994-iptables-alerter-script\") pod \"iptables-alerter-5x69v\" (UID: \"1540ebde-12ed-4345-98c4-ed0dd754c994\") " pod="openshift-network-operator/iptables-alerter-5x69v"
Jul 28 16:50:13.015367 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.011652    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8537db2a-96d8-4755-ae0b-40e2462c90c2-cnibin\") pod \"multus-additional-cni-plugins-txmf4\" (UID: \"8537db2a-96d8-4755-ae0b-40e2462c90c2\") " pod="openshift-multus/multus-additional-cni-plugins-txmf4"
Jul 28 16:50:13.015367 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.014696    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/dba5feb3-e14f-4764-b07c-406929f4587e-run\") pod \"tuned-pmwsn\" (UID: \"dba5feb3-e14f-4764-b07c-406929f4587e\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwsn"
Jul 28 16:50:13.015367 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.014755    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/dba5feb3-e14f-4764-b07c-406929f4587e-etc-systemd\") pod \"tuned-pmwsn\" (UID: \"dba5feb3-e14f-4764-b07c-406929f4587e\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwsn"
Jul 28 16:50:13.015367 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.014808    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5eef3908-3a57-4ba9-be8c-8c78354aaf2a-host-var-lib-cni-bin\") pod \"multus-q77xn\" (UID: \"5eef3908-3a57-4ba9-be8c-8c78354aaf2a\") " pod="openshift-multus/multus-q77xn"
Jul 28 16:50:13.015367 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.014847    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:13.015367 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.014866    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5eef3908-3a57-4ba9-be8c-8c78354aaf2a-cni-binary-copy\") pod \"multus-q77xn\" (UID: \"5eef3908-3a57-4ba9-be8c-8c78354aaf2a\") " pod="openshift-multus/multus-q77xn"
Jul 28 16:50:13.015367 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.014907    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5eef3908-3a57-4ba9-be8c-8c78354aaf2a-host-run-multus-certs\") pod \"multus-q77xn\" (UID: \"5eef3908-3a57-4ba9-be8c-8c78354aaf2a\") " pod="openshift-multus/multus-q77xn"
Jul 28 16:50:13.015367 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.014994    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/dba5feb3-e14f-4764-b07c-406929f4587e-etc-sysctl-d\") pod \"tuned-pmwsn\" (UID: \"dba5feb3-e14f-4764-b07c-406929f4587e\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwsn"
Jul 28 16:50:13.015367 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.015212    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-env-overrides\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:13.015367 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.015272    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5eef3908-3a57-4ba9-be8c-8c78354aaf2a-cnibin\") pod \"multus-q77xn\" (UID: \"5eef3908-3a57-4ba9-be8c-8c78354aaf2a\") " pod="openshift-multus/multus-q77xn"
Jul 28 16:50:13.016135 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.015318    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dba5feb3-e14f-4764-b07c-406929f4587e-lib-modules\") pod \"tuned-pmwsn\" (UID: \"dba5feb3-e14f-4764-b07c-406929f4587e\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwsn"
Jul 28 16:50:13.016135 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.015356    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1540ebde-12ed-4345-98c4-ed0dd754c994-host-slash\") pod \"iptables-alerter-5x69v\" (UID: \"1540ebde-12ed-4345-98c4-ed0dd754c994\") " pod="openshift-network-operator/iptables-alerter-5x69v"
Jul 28 16:50:13.016135 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.015394    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-host-run-netns\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:13.016135 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.015441    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5eef3908-3a57-4ba9-be8c-8c78354aaf2a-multus-socket-dir-parent\") pod \"multus-q77xn\" (UID: \"5eef3908-3a57-4ba9-be8c-8c78354aaf2a\") " pod="openshift-multus/multus-q77xn"
Jul 28 16:50:13.016135 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.015488    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dba5feb3-e14f-4764-b07c-406929f4587e-etc-kubernetes\") pod \"tuned-pmwsn\" (UID: \"dba5feb3-e14f-4764-b07c-406929f4587e\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwsn"
Jul 28 16:50:13.016135 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.015524    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-run-ovn\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:13.016135 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.015585    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5eef3908-3a57-4ba9-be8c-8c78354aaf2a-os-release\") pod \"multus-q77xn\" (UID: \"5eef3908-3a57-4ba9-be8c-8c78354aaf2a\") " pod="openshift-multus/multus-q77xn"
Jul 28 16:50:13.016135 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:13.015670    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 16:50:13.016135 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.015696    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8537db2a-96d8-4755-ae0b-40e2462c90c2-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-txmf4\" (UID: \"8537db2a-96d8-4755-ae0b-40e2462c90c2\") " pod="openshift-multus/multus-additional-cni-plugins-txmf4"
Jul 28 16:50:13.016135 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:13.015759    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab2695e6-884f-4726-ba45-fe2772ee69a8-metrics-certs podName:ab2695e6-884f-4726-ba45-fe2772ee69a8 nodeName:}" failed. No retries permitted until 2026-07-28 16:50:13.51571877 +0000 UTC m=+2.987132410 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab2695e6-884f-4726-ba45-fe2772ee69a8-metrics-certs") pod "network-metrics-daemon-vn69s" (UID: "ab2695e6-884f-4726-ba45-fe2772ee69a8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 16:50:13.016135 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.015901    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/dba5feb3-e14f-4764-b07c-406929f4587e-tmp\") pod \"tuned-pmwsn\" (UID: \"dba5feb3-e14f-4764-b07c-406929f4587e\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwsn"
Jul 28 16:50:13.018066 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.018034    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/dba5feb3-e14f-4764-b07c-406929f4587e-etc-tuned\") pod \"tuned-pmwsn\" (UID: \"dba5feb3-e14f-4764-b07c-406929f4587e\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwsn"
Jul 28 16:50:13.019484 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.019464    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-ovn-node-metrics-cert\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:13.023220 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.023197    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/43c3a34e-2451-4eb9-878c-8100a5d2ac48-agent-certs\") pod \"konnectivity-agent-gspwj\" (UID: \"43c3a34e-2451-4eb9-878c-8100a5d2ac48\") " pod="kube-system/konnectivity-agent-gspwj"
Jul 28 16:50:13.030945 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.030922    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5dkx\" (UniqueName: \"kubernetes.io/projected/dba5feb3-e14f-4764-b07c-406929f4587e-kube-api-access-m5dkx\") pod \"tuned-pmwsn\" (UID: \"dba5feb3-e14f-4764-b07c-406929f4587e\") " pod="openshift-cluster-node-tuning-operator/tuned-pmwsn"
Jul 28 16:50:13.031522 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.031501    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-22ks4\" (UniqueName: \"kubernetes.io/projected/5eef3908-3a57-4ba9-be8c-8c78354aaf2a-kube-api-access-22ks4\") pod \"multus-q77xn\" (UID: \"5eef3908-3a57-4ba9-be8c-8c78354aaf2a\") " pod="openshift-multus/multus-q77xn"
Jul 28 16:50:13.033283 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.033262    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9w96\" (UniqueName: \"kubernetes.io/projected/5c2c260e-d050-44eb-90d3-da4d25ade88a-kube-api-access-s9w96\") pod \"node-ca-qrhwd\" (UID: \"5c2c260e-d050-44eb-90d3-da4d25ade88a\") " pod="openshift-image-registry/node-ca-qrhwd"
Jul 28 16:50:13.034420 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.034394    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw88z\" (UniqueName: \"kubernetes.io/projected/ab2695e6-884f-4726-ba45-fe2772ee69a8-kube-api-access-rw88z\") pod \"network-metrics-daemon-vn69s\" (UID: \"ab2695e6-884f-4726-ba45-fe2772ee69a8\") " pod="openshift-multus/network-metrics-daemon-vn69s"
Jul 28 16:50:13.034803 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.034783    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87t5b\" (UniqueName: \"kubernetes.io/projected/5286ccd9-f5ee-4c9c-963d-93d2530a5fc4-kube-api-access-87t5b\") pod \"ovnkube-node-7st4p\" (UID: \"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4\") " pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:13.036036 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.035989    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92mn4\" (UniqueName: \"kubernetes.io/projected/1540ebde-12ed-4345-98c4-ed0dd754c994-kube-api-access-92mn4\") pod \"iptables-alerter-5x69v\" (UID: \"1540ebde-12ed-4345-98c4-ed0dd754c994\") " pod="openshift-network-operator/iptables-alerter-5x69v"
Jul 28 16:50:13.036444 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.036419    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxftt\" (UniqueName: \"kubernetes.io/projected/8537db2a-96d8-4755-ae0b-40e2462c90c2-kube-api-access-dxftt\") pod \"multus-additional-cni-plugins-txmf4\" (UID: \"8537db2a-96d8-4755-ae0b-40e2462c90c2\") " pod="openshift-multus/multus-additional-cni-plugins-txmf4"
Jul 28 16:50:13.074789 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.074746    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-92.ec2.internal" event={"ID":"996afe303aee28056553054cb3e66c94","Type":"ContainerStarted","Data":"0df4ca1a5342932ccc1d2aeb445cdee7e48b503775fb61ec0c6522ac16a0d39e"}
Jul 28 16:50:13.076089 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.076046    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-92.ec2.internal" event={"ID":"70f89e41a82f3ee988cac00f2f5c30a0","Type":"ContainerStarted","Data":"f4ab46b314610531fa9296a346d41787a9ae8d2c65d04fc0dc6919c1a6a19e8a"}
Jul 28 16:50:13.114090 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.114026    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0eb1879f-3c34-490c-b09d-317b5ed656e9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7svsd\" (UID: \"0eb1879f-3c34-490c-b09d-317b5ed656e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svsd"
Jul 28 16:50:13.121516 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.121489    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0eb1879f-3c34-490c-b09d-317b5ed656e9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7svsd\" (UID: \"0eb1879f-3c34-490c-b09d-317b5ed656e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svsd"
Jul 28 16:50:13.121635 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.121546    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9a7043cc-b151-4888-90cc-f3dae8a2a91d-kubelet-config\") pod \"global-pull-secret-syncer-fvtsl\" (UID: \"9a7043cc-b151-4888-90cc-f3dae8a2a91d\") " pod="kube-system/global-pull-secret-syncer-fvtsl"
Jul 28 16:50:13.121635 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.121605    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9a7043cc-b151-4888-90cc-f3dae8a2a91d-kubelet-config\") pod \"global-pull-secret-syncer-fvtsl\" (UID: \"9a7043cc-b151-4888-90cc-f3dae8a2a91d\") " pod="kube-system/global-pull-secret-syncer-fvtsl"
Jul 28 16:50:13.121872 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.121851    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c78f3240-32b5-4e57-bc03-c1f9e08c28e5-tmp-dir\") pod \"node-resolver-495dh\" (UID: \"c78f3240-32b5-4e57-bc03-c1f9e08c28e5\") " pod="openshift-dns/node-resolver-495dh"
Jul 28 16:50:13.122217 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.122198    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0eb1879f-3c34-490c-b09d-317b5ed656e9-device-dir\") pod \"aws-ebs-csi-driver-node-7svsd\" (UID: \"0eb1879f-3c34-490c-b09d-317b5ed656e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svsd"
Jul 28 16:50:13.122308 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.122240    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0eb1879f-3c34-490c-b09d-317b5ed656e9-etc-selinux\") pod \"aws-ebs-csi-driver-node-7svsd\" (UID: \"0eb1879f-3c34-490c-b09d-317b5ed656e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svsd"
Jul 28 16:50:13.122308 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.122278    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lq2tq\" (UniqueName: \"kubernetes.io/projected/0eb1879f-3c34-490c-b09d-317b5ed656e9-kube-api-access-lq2tq\") pod \"aws-ebs-csi-driver-node-7svsd\" (UID: \"0eb1879f-3c34-490c-b09d-317b5ed656e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svsd"
Jul 28 16:50:13.122410 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.122316    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c78f3240-32b5-4e57-bc03-c1f9e08c28e5-hosts-file\") pod \"node-resolver-495dh\" (UID: \"c78f3240-32b5-4e57-bc03-c1f9e08c28e5\") " pod="openshift-dns/node-resolver-495dh"
Jul 28 16:50:13.122410 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.122353    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0eb1879f-3c34-490c-b09d-317b5ed656e9-socket-dir\") pod \"aws-ebs-csi-driver-node-7svsd\" (UID: \"0eb1879f-3c34-490c-b09d-317b5ed656e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svsd"
Jul 28 16:50:13.122516 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.122423    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bg7p\" (UniqueName: \"kubernetes.io/projected/c78f3240-32b5-4e57-bc03-c1f9e08c28e5-kube-api-access-4bg7p\") pod \"node-resolver-495dh\" (UID: \"c78f3240-32b5-4e57-bc03-c1f9e08c28e5\") " pod="openshift-dns/node-resolver-495dh"
Jul 28 16:50:13.122516 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.122452    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9a7043cc-b151-4888-90cc-f3dae8a2a91d-dbus\") pod \"global-pull-secret-syncer-fvtsl\" (UID: \"9a7043cc-b151-4888-90cc-f3dae8a2a91d\") " pod="kube-system/global-pull-secret-syncer-fvtsl"
Jul 28 16:50:13.122745 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.122728    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0eb1879f-3c34-490c-b09d-317b5ed656e9-device-dir\") pod \"aws-ebs-csi-driver-node-7svsd\" (UID: \"0eb1879f-3c34-490c-b09d-317b5ed656e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svsd"
Jul 28 16:50:13.122858 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.122843    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0eb1879f-3c34-490c-b09d-317b5ed656e9-etc-selinux\") pod \"aws-ebs-csi-driver-node-7svsd\" (UID: \"0eb1879f-3c34-490c-b09d-317b5ed656e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svsd"
Jul 28 16:50:13.123377 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.123356    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c78f3240-32b5-4e57-bc03-c1f9e08c28e5-tmp-dir\") pod \"node-resolver-495dh\" (UID: \"c78f3240-32b5-4e57-bc03-c1f9e08c28e5\") " pod="openshift-dns/node-resolver-495dh"
Jul 28 16:50:13.123458 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.122491    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trqt6\" (UniqueName: \"kubernetes.io/projected/7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee-kube-api-access-trqt6\") pod \"network-check-target-hbfct\" (UID: \"7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee\") " pod="openshift-network-diagnostics/network-check-target-hbfct"
Jul 28 16:50:13.123644 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.123625    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c78f3240-32b5-4e57-bc03-c1f9e08c28e5-hosts-file\") pod \"node-resolver-495dh\" (UID: \"c78f3240-32b5-4e57-bc03-c1f9e08c28e5\") " pod="openshift-dns/node-resolver-495dh"
Jul 28 16:50:13.123755 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.123739    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0eb1879f-3c34-490c-b09d-317b5ed656e9-socket-dir\") pod \"aws-ebs-csi-driver-node-7svsd\" (UID: \"0eb1879f-3c34-490c-b09d-317b5ed656e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svsd"
Jul 28 16:50:13.124314 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.124101    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9a7043cc-b151-4888-90cc-f3dae8a2a91d-dbus\") pod \"global-pull-secret-syncer-fvtsl\" (UID: \"9a7043cc-b151-4888-90cc-f3dae8a2a91d\") " pod="kube-system/global-pull-secret-syncer-fvtsl"
Jul 28 16:50:13.124314 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.124153    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0eb1879f-3c34-490c-b09d-317b5ed656e9-registration-dir\") pod \"aws-ebs-csi-driver-node-7svsd\" (UID: \"0eb1879f-3c34-490c-b09d-317b5ed656e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svsd"
Jul 28 16:50:13.124314 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.124182    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0eb1879f-3c34-490c-b09d-317b5ed656e9-sys-fs\") pod \"aws-ebs-csi-driver-node-7svsd\" (UID: \"0eb1879f-3c34-490c-b09d-317b5ed656e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svsd"
Jul 28 16:50:13.124314 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.124216    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a7043cc-b151-4888-90cc-f3dae8a2a91d-original-pull-secret\") pod \"global-pull-secret-syncer-fvtsl\" (UID: \"9a7043cc-b151-4888-90cc-f3dae8a2a91d\") " pod="kube-system/global-pull-secret-syncer-fvtsl"
Jul 28 16:50:13.124314 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.124280    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0eb1879f-3c34-490c-b09d-317b5ed656e9-registration-dir\") pod \"aws-ebs-csi-driver-node-7svsd\" (UID: \"0eb1879f-3c34-490c-b09d-317b5ed656e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svsd"
Jul 28 16:50:13.124314 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.124288    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0eb1879f-3c34-490c-b09d-317b5ed656e9-sys-fs\") pod \"aws-ebs-csi-driver-node-7svsd\" (UID: \"0eb1879f-3c34-490c-b09d-317b5ed656e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svsd"
Jul 28 16:50:13.124680 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:13.124330    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 16:50:13.124680 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:13.124396    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a7043cc-b151-4888-90cc-f3dae8a2a91d-original-pull-secret podName:9a7043cc-b151-4888-90cc-f3dae8a2a91d nodeName:}" failed. No retries permitted until 2026-07-28 16:50:13.624370127 +0000 UTC m=+3.095783768 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a7043cc-b151-4888-90cc-f3dae8a2a91d-original-pull-secret") pod "global-pull-secret-syncer-fvtsl" (UID: "9a7043cc-b151-4888-90cc-f3dae8a2a91d") : object "kube-system"/"original-pull-secret" not registered
Jul 28 16:50:13.136769 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:13.136747    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 16:50:13.136769 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:13.136770    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 16:50:13.136932 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:13.136780    2561 projected.go:196] Error preparing data for projected volume kube-api-access-trqt6 for pod openshift-network-diagnostics/network-check-target-hbfct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 16:50:13.136932 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:13.136823    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee-kube-api-access-trqt6 podName:7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee nodeName:}" failed. No retries permitted until 2026-07-28 16:50:13.636811757 +0000 UTC m=+3.108225399 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-trqt6" (UniqueName: "kubernetes.io/projected/7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee-kube-api-access-trqt6") pod "network-check-target-hbfct" (UID: "7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 16:50:13.139696 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.139675    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lq2tq\" (UniqueName: \"kubernetes.io/projected/0eb1879f-3c34-490c-b09d-317b5ed656e9-kube-api-access-lq2tq\") pod \"aws-ebs-csi-driver-node-7svsd\" (UID: \"0eb1879f-3c34-490c-b09d-317b5ed656e9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svsd"
Jul 28 16:50:13.140429 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.140407    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bg7p\" (UniqueName: \"kubernetes.io/projected/c78f3240-32b5-4e57-bc03-c1f9e08c28e5-kube-api-access-4bg7p\") pod \"node-resolver-495dh\" (UID: \"c78f3240-32b5-4e57-bc03-c1f9e08c28e5\") " pod="openshift-dns/node-resolver-495dh"
Jul 28 16:50:13.192127 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.192096    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5x69v"
Jul 28 16:50:13.202432 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.202410    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qrhwd"
Jul 28 16:50:13.217436 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.217411    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:13.223630 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.223607    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pmwsn"
Jul 28 16:50:13.229838 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.229817    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-txmf4"
Jul 28 16:50:13.236031 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.236010    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q77xn"
Jul 28 16:50:13.245039 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.245017    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-gspwj"
Jul 28 16:50:13.251842 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.251818    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-495dh"
Jul 28 16:50:13.258734 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.258717    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svsd"
Jul 28 16:50:13.321472 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.321446    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 16:50:13.527538 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.527507    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab2695e6-884f-4726-ba45-fe2772ee69a8-metrics-certs\") pod \"network-metrics-daemon-vn69s\" (UID: \"ab2695e6-884f-4726-ba45-fe2772ee69a8\") " pod="openshift-multus/network-metrics-daemon-vn69s"
Jul 28 16:50:13.527707 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:13.527674    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 16:50:13.527783 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:13.527759    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab2695e6-884f-4726-ba45-fe2772ee69a8-metrics-certs podName:ab2695e6-884f-4726-ba45-fe2772ee69a8 nodeName:}" failed. No retries permitted until 2026-07-28 16:50:14.527735839 +0000 UTC m=+3.999149485 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab2695e6-884f-4726-ba45-fe2772ee69a8-metrics-certs") pod "network-metrics-daemon-vn69s" (UID: "ab2695e6-884f-4726-ba45-fe2772ee69a8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 16:50:13.628570 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.628528    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a7043cc-b151-4888-90cc-f3dae8a2a91d-original-pull-secret\") pod \"global-pull-secret-syncer-fvtsl\" (UID: \"9a7043cc-b151-4888-90cc-f3dae8a2a91d\") " pod="kube-system/global-pull-secret-syncer-fvtsl"
Jul 28 16:50:13.628750 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:13.628634    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 16:50:13.628750 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:13.628696    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a7043cc-b151-4888-90cc-f3dae8a2a91d-original-pull-secret podName:9a7043cc-b151-4888-90cc-f3dae8a2a91d nodeName:}" failed. No retries permitted until 2026-07-28 16:50:14.628678091 +0000 UTC m=+4.100091749 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a7043cc-b151-4888-90cc-f3dae8a2a91d-original-pull-secret") pod "global-pull-secret-syncer-fvtsl" (UID: "9a7043cc-b151-4888-90cc-f3dae8a2a91d") : object "kube-system"/"original-pull-secret" not registered
Jul 28 16:50:13.729742 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.729706    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trqt6\" (UniqueName: \"kubernetes.io/projected/7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee-kube-api-access-trqt6\") pod \"network-check-target-hbfct\" (UID: \"7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee\") " pod="openshift-network-diagnostics/network-check-target-hbfct"
Jul 28 16:50:13.729929 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:13.729909    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 16:50:13.730006 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:13.729936    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 16:50:13.730006 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:13.729963    2561 projected.go:196] Error preparing data for projected volume kube-api-access-trqt6 for pod openshift-network-diagnostics/network-check-target-hbfct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 16:50:13.730104 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:13.730029    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee-kube-api-access-trqt6 podName:7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee nodeName:}" failed. No retries permitted until 2026-07-28 16:50:14.730007239 +0000 UTC m=+4.201420907 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-trqt6" (UniqueName: "kubernetes.io/projected/7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee-kube-api-access-trqt6") pod "network-check-target-hbfct" (UID: "7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 16:50:13.938501 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.938450    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 16:45:13 +0000 UTC" deadline="2028-04-28 02:14:00.957023274 +0000 UTC"
Jul 28 16:50:13.938501 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:13.938487    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15345h23m47.018540719s"
Jul 28 16:50:14.070516 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:14.070438    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hbfct"
Jul 28 16:50:14.070646 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:14.070546    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hbfct" podUID="7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee"
Jul 28 16:50:14.252615 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:14.252515    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c2c260e_d050_44eb_90d3_da4d25ade88a.slice/crio-50ab7409e366b0ea87caea0dbecd23696c3598c3ef14373a2c98fb3b011e348c WatchSource:0}: Error finding container 50ab7409e366b0ea87caea0dbecd23696c3598c3ef14373a2c98fb3b011e348c: Status 404 returned error can't find the container with id 50ab7409e366b0ea87caea0dbecd23696c3598c3ef14373a2c98fb3b011e348c
Jul 28 16:50:14.257683 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:14.257646    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43c3a34e_2451_4eb9_878c_8100a5d2ac48.slice/crio-f84f83b3d581d4f3182623ac205b02d5f7b662e666687f5547cf217e43271139 WatchSource:0}: Error finding container f84f83b3d581d4f3182623ac205b02d5f7b662e666687f5547cf217e43271139: Status 404 returned error can't find the container with id f84f83b3d581d4f3182623ac205b02d5f7b662e666687f5547cf217e43271139
Jul 28 16:50:14.259414 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:14.259313    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0eb1879f_3c34_490c_b09d_317b5ed656e9.slice/crio-989ebc5a6d35132c963919e9896f9a5ed41ad34c8feb0c6b23a6c92b5b674b84 WatchSource:0}: Error finding container 989ebc5a6d35132c963919e9896f9a5ed41ad34c8feb0c6b23a6c92b5b674b84: Status 404 returned error can't find the container with id 989ebc5a6d35132c963919e9896f9a5ed41ad34c8feb0c6b23a6c92b5b674b84
Jul 28 16:50:14.260216 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:14.260191    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8537db2a_96d8_4755_ae0b_40e2462c90c2.slice/crio-f96a44162806f770d4db15f3dab4705a101f45f698b1717c4aa72be645ea842e WatchSource:0}: Error finding container f96a44162806f770d4db15f3dab4705a101f45f698b1717c4aa72be645ea842e: Status 404 returned error can't find the container with id f96a44162806f770d4db15f3dab4705a101f45f698b1717c4aa72be645ea842e
Jul 28 16:50:14.273675 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:14.273560    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5286ccd9_f5ee_4c9c_963d_93d2530a5fc4.slice/crio-14ad1e0ec011b8cb978995523342514117d871fe46e6bf098a8f5660971356f7 WatchSource:0}: Error finding container 14ad1e0ec011b8cb978995523342514117d871fe46e6bf098a8f5660971356f7: Status 404 returned error can't find the container with id 14ad1e0ec011b8cb978995523342514117d871fe46e6bf098a8f5660971356f7
Jul 28 16:50:14.273794 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:14.273774    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1540ebde_12ed_4345_98c4_ed0dd754c994.slice/crio-d18afca4633697d8e500a02820f4dbc962477821fde1ccf0484e37c45c2943fa WatchSource:0}: Error finding container d18afca4633697d8e500a02820f4dbc962477821fde1ccf0484e37c45c2943fa: Status 404 returned error can't find the container with id d18afca4633697d8e500a02820f4dbc962477821fde1ccf0484e37c45c2943fa
Jul 28 16:50:14.274523 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:14.274501    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddba5feb3_e14f_4764_b07c_406929f4587e.slice/crio-83a618a48f8da38286d46278ac9bd51718387c0f246238ac96bc828f51f927c4 WatchSource:0}: Error finding container 83a618a48f8da38286d46278ac9bd51718387c0f246238ac96bc828f51f927c4: Status 404 returned error can't find the container with id 83a618a48f8da38286d46278ac9bd51718387c0f246238ac96bc828f51f927c4
Jul 28 16:50:14.276400 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:14.276072    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc78f3240_32b5_4e57_bc03_c1f9e08c28e5.slice/crio-64a79ade0a8d34ccbd8cf7f8755d3794070302ff58b5ed501b68f2872a3137cd WatchSource:0}: Error finding container 64a79ade0a8d34ccbd8cf7f8755d3794070302ff58b5ed501b68f2872a3137cd: Status 404 returned error can't find the container with id 64a79ade0a8d34ccbd8cf7f8755d3794070302ff58b5ed501b68f2872a3137cd
Jul 28 16:50:14.277194 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:50:14.277169    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5eef3908_3a57_4ba9_be8c_8c78354aaf2a.slice/crio-6433a55e4bffbeaff7c32228a8668909a0a02fa75e5ad524cbc47973e86db44f WatchSource:0}: Error finding container 6433a55e4bffbeaff7c32228a8668909a0a02fa75e5ad524cbc47973e86db44f: Status 404 returned error can't find the container with id 6433a55e4bffbeaff7c32228a8668909a0a02fa75e5ad524cbc47973e86db44f
Jul 28 16:50:14.536516 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:14.536334    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab2695e6-884f-4726-ba45-fe2772ee69a8-metrics-certs\") pod \"network-metrics-daemon-vn69s\" (UID: \"ab2695e6-884f-4726-ba45-fe2772ee69a8\") " pod="openshift-multus/network-metrics-daemon-vn69s"
Jul 28 16:50:14.536622 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:14.536469    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 16:50:14.536662 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:14.536623    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab2695e6-884f-4726-ba45-fe2772ee69a8-metrics-certs podName:ab2695e6-884f-4726-ba45-fe2772ee69a8 nodeName:}" failed. No retries permitted until 2026-07-28 16:50:16.53660754 +0000 UTC m=+6.008021180 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab2695e6-884f-4726-ba45-fe2772ee69a8-metrics-certs") pod "network-metrics-daemon-vn69s" (UID: "ab2695e6-884f-4726-ba45-fe2772ee69a8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 16:50:14.637101 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:14.637028    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a7043cc-b151-4888-90cc-f3dae8a2a91d-original-pull-secret\") pod \"global-pull-secret-syncer-fvtsl\" (UID: \"9a7043cc-b151-4888-90cc-f3dae8a2a91d\") " pod="kube-system/global-pull-secret-syncer-fvtsl"
Jul 28 16:50:14.637210 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:14.637146    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 16:50:14.637210 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:14.637195    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a7043cc-b151-4888-90cc-f3dae8a2a91d-original-pull-secret podName:9a7043cc-b151-4888-90cc-f3dae8a2a91d nodeName:}" failed. No retries permitted until 2026-07-28 16:50:16.637181525 +0000 UTC m=+6.108595163 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a7043cc-b151-4888-90cc-f3dae8a2a91d-original-pull-secret") pod "global-pull-secret-syncer-fvtsl" (UID: "9a7043cc-b151-4888-90cc-f3dae8a2a91d") : object "kube-system"/"original-pull-secret" not registered
Jul 28 16:50:14.737589 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:14.737544    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trqt6\" (UniqueName: \"kubernetes.io/projected/7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee-kube-api-access-trqt6\") pod \"network-check-target-hbfct\" (UID: \"7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee\") " pod="openshift-network-diagnostics/network-check-target-hbfct"
Jul 28 16:50:14.737803 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:14.737781    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 16:50:14.737803 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:14.737804    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 16:50:14.737803 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:14.737817    2561 projected.go:196] Error preparing data for projected volume kube-api-access-trqt6 for pod openshift-network-diagnostics/network-check-target-hbfct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 16:50:14.738183 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:14.737870    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee-kube-api-access-trqt6 podName:7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee nodeName:}" failed. No retries permitted until 2026-07-28 16:50:16.737851581 +0000 UTC m=+6.209265242 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-trqt6" (UniqueName: "kubernetes.io/projected/7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee-kube-api-access-trqt6") pod "network-check-target-hbfct" (UID: "7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 16:50:14.939453 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:14.939341    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 16:45:13 +0000 UTC" deadline="2027-12-24 17:24:47.047631745 +0000 UTC"
Jul 28 16:50:14.939453 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:14.939404    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12336h34m32.108231846s"
Jul 28 16:50:15.072252 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:15.072143    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvtsl"
Jul 28 16:50:15.072418 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:15.072290    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvtsl" podUID="9a7043cc-b151-4888-90cc-f3dae8a2a91d"
Jul 28 16:50:15.072418 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:15.072331    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vn69s"
Jul 28 16:50:15.072539 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:15.072487    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vn69s" podUID="ab2695e6-884f-4726-ba45-fe2772ee69a8"
Jul 28 16:50:15.089415 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:15.089380    2561 generic.go:356] "Generic (PLEG): container finished" podID="996afe303aee28056553054cb3e66c94" containerID="6e8eef89f151220aff00f1fa1865df7c9c7d07d88632646f3883a09cbbe0a1d5" exitCode=0
Jul 28 16:50:15.090067 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:15.090039    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-92.ec2.internal" event={"ID":"996afe303aee28056553054cb3e66c94","Type":"ContainerDied","Data":"6e8eef89f151220aff00f1fa1865df7c9c7d07d88632646f3883a09cbbe0a1d5"}
Jul 28 16:50:15.106229 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:15.106198    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-495dh" event={"ID":"c78f3240-32b5-4e57-bc03-c1f9e08c28e5","Type":"ContainerStarted","Data":"64a79ade0a8d34ccbd8cf7f8755d3794070302ff58b5ed501b68f2872a3137cd"}
Jul 28 16:50:15.118186 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:15.115244    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q77xn" event={"ID":"5eef3908-3a57-4ba9-be8c-8c78354aaf2a","Type":"ContainerStarted","Data":"6433a55e4bffbeaff7c32228a8668909a0a02fa75e5ad524cbc47973e86db44f"}
Jul 28 16:50:15.118186 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:15.117814    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pmwsn" event={"ID":"dba5feb3-e14f-4764-b07c-406929f4587e","Type":"ContainerStarted","Data":"83a618a48f8da38286d46278ac9bd51718387c0f246238ac96bc828f51f927c4"}
Jul 28 16:50:15.131136 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:15.131104    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7st4p" event={"ID":"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4","Type":"ContainerStarted","Data":"14ad1e0ec011b8cb978995523342514117d871fe46e6bf098a8f5660971356f7"}
Jul 28 16:50:15.137125 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:15.137043    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gspwj" event={"ID":"43c3a34e-2451-4eb9-878c-8100a5d2ac48","Type":"ContainerStarted","Data":"f84f83b3d581d4f3182623ac205b02d5f7b662e666687f5547cf217e43271139"}
Jul 28 16:50:15.145152 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:15.145071    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qrhwd" event={"ID":"5c2c260e-d050-44eb-90d3-da4d25ade88a","Type":"ContainerStarted","Data":"50ab7409e366b0ea87caea0dbecd23696c3598c3ef14373a2c98fb3b011e348c"}
Jul 28 16:50:15.151724 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:15.151135    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-92.ec2.internal" event={"ID":"70f89e41a82f3ee988cac00f2f5c30a0","Type":"ContainerStarted","Data":"f864f6396562180bd55d8baacaf9cc2b271abfcbfd6ed93939eb13060fe1afdf"}
Jul 28 16:50:15.161045 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:15.160955    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5x69v" event={"ID":"1540ebde-12ed-4345-98c4-ed0dd754c994","Type":"ContainerStarted","Data":"d18afca4633697d8e500a02820f4dbc962477821fde1ccf0484e37c45c2943fa"}
Jul 28 16:50:15.163555 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:15.163490    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-txmf4" event={"ID":"8537db2a-96d8-4755-ae0b-40e2462c90c2","Type":"ContainerStarted","Data":"f96a44162806f770d4db15f3dab4705a101f45f698b1717c4aa72be645ea842e"}
Jul 28 16:50:15.170379 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:15.170306    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svsd" event={"ID":"0eb1879f-3c34-490c-b09d-317b5ed656e9","Type":"ContainerStarted","Data":"989ebc5a6d35132c963919e9896f9a5ed41ad34c8feb0c6b23a6c92b5b674b84"}
Jul 28 16:50:16.070211 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:16.070177    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hbfct"
Jul 28 16:50:16.070798 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:16.070310    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hbfct" podUID="7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee"
Jul 28 16:50:16.218838 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:16.218421    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-92.ec2.internal" event={"ID":"996afe303aee28056553054cb3e66c94","Type":"ContainerStarted","Data":"db1f2eef72e3c17b0f21c6ed76a4a3d3f95086d99b8eea186f4066b3d809d736"}
Jul 28 16:50:16.238493 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:16.237495    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-92.ec2.internal" podStartSLOduration=3.237473773 podStartE2EDuration="3.237473773s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 16:50:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:50:15.182139976 +0000 UTC m=+4.653553641" watchObservedRunningTime="2026-07-28 16:50:16.237473773 +0000 UTC m=+5.708887438"
Jul 28 16:50:16.555517 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:16.554872    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab2695e6-884f-4726-ba45-fe2772ee69a8-metrics-certs\") pod \"network-metrics-daemon-vn69s\" (UID: \"ab2695e6-884f-4726-ba45-fe2772ee69a8\") " pod="openshift-multus/network-metrics-daemon-vn69s"
Jul 28 16:50:16.555517 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:16.555073    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 16:50:16.555517 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:16.555140    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab2695e6-884f-4726-ba45-fe2772ee69a8-metrics-certs podName:ab2695e6-884f-4726-ba45-fe2772ee69a8 nodeName:}" failed. No retries permitted until 2026-07-28 16:50:20.555117835 +0000 UTC m=+10.026531488 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab2695e6-884f-4726-ba45-fe2772ee69a8-metrics-certs") pod "network-metrics-daemon-vn69s" (UID: "ab2695e6-884f-4726-ba45-fe2772ee69a8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 16:50:16.655967 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:16.655327    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a7043cc-b151-4888-90cc-f3dae8a2a91d-original-pull-secret\") pod \"global-pull-secret-syncer-fvtsl\" (UID: \"9a7043cc-b151-4888-90cc-f3dae8a2a91d\") " pod="kube-system/global-pull-secret-syncer-fvtsl"
Jul 28 16:50:16.655967 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:16.655538    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 16:50:16.655967 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:16.655605    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a7043cc-b151-4888-90cc-f3dae8a2a91d-original-pull-secret podName:9a7043cc-b151-4888-90cc-f3dae8a2a91d nodeName:}" failed. No retries permitted until 2026-07-28 16:50:20.655584914 +0000 UTC m=+10.126998570 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a7043cc-b151-4888-90cc-f3dae8a2a91d-original-pull-secret") pod "global-pull-secret-syncer-fvtsl" (UID: "9a7043cc-b151-4888-90cc-f3dae8a2a91d") : object "kube-system"/"original-pull-secret" not registered
Jul 28 16:50:16.756476 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:16.756439    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trqt6\" (UniqueName: \"kubernetes.io/projected/7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee-kube-api-access-trqt6\") pod \"network-check-target-hbfct\" (UID: \"7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee\") " pod="openshift-network-diagnostics/network-check-target-hbfct"
Jul 28 16:50:16.756680 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:16.756661    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 16:50:16.756759 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:16.756690    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 16:50:16.756759 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:16.756704    2561 projected.go:196] Error preparing data for projected volume kube-api-access-trqt6 for pod openshift-network-diagnostics/network-check-target-hbfct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 16:50:16.756886 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:16.756764    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee-kube-api-access-trqt6 podName:7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee nodeName:}" failed. No retries permitted until 2026-07-28 16:50:20.756743468 +0000 UTC m=+10.228157133 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-trqt6" (UniqueName: "kubernetes.io/projected/7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee-kube-api-access-trqt6") pod "network-check-target-hbfct" (UID: "7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 16:50:17.071359 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:17.071095    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvtsl"
Jul 28 16:50:17.071359 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:17.071233    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvtsl" podUID="9a7043cc-b151-4888-90cc-f3dae8a2a91d"
Jul 28 16:50:17.071928 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:17.071677    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vn69s"
Jul 28 16:50:17.071928 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:17.071832    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vn69s" podUID="ab2695e6-884f-4726-ba45-fe2772ee69a8"
Jul 28 16:50:18.070477 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:18.070425    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hbfct"
Jul 28 16:50:18.070687 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:18.070599    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hbfct" podUID="7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee"
Jul 28 16:50:19.071726 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:19.071086    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvtsl"
Jul 28 16:50:19.071726 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:19.071220    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvtsl" podUID="9a7043cc-b151-4888-90cc-f3dae8a2a91d"
Jul 28 16:50:19.071726 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:19.071087    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vn69s"
Jul 28 16:50:19.071726 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:19.071635    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vn69s" podUID="ab2695e6-884f-4726-ba45-fe2772ee69a8"
Jul 28 16:50:20.070947 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:20.070870    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hbfct"
Jul 28 16:50:20.071140 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:20.071046    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hbfct" podUID="7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee"
Jul 28 16:50:20.591041 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:20.590991    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab2695e6-884f-4726-ba45-fe2772ee69a8-metrics-certs\") pod \"network-metrics-daemon-vn69s\" (UID: \"ab2695e6-884f-4726-ba45-fe2772ee69a8\") " pod="openshift-multus/network-metrics-daemon-vn69s"
Jul 28 16:50:20.591646 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:20.591169    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 16:50:20.591646 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:20.591252    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab2695e6-884f-4726-ba45-fe2772ee69a8-metrics-certs podName:ab2695e6-884f-4726-ba45-fe2772ee69a8 nodeName:}" failed. No retries permitted until 2026-07-28 16:50:28.591228581 +0000 UTC m=+18.062642233 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab2695e6-884f-4726-ba45-fe2772ee69a8-metrics-certs") pod "network-metrics-daemon-vn69s" (UID: "ab2695e6-884f-4726-ba45-fe2772ee69a8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 16:50:20.692353 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:20.692275    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a7043cc-b151-4888-90cc-f3dae8a2a91d-original-pull-secret\") pod \"global-pull-secret-syncer-fvtsl\" (UID: \"9a7043cc-b151-4888-90cc-f3dae8a2a91d\") " pod="kube-system/global-pull-secret-syncer-fvtsl"
Jul 28 16:50:20.692531 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:20.692465    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 16:50:20.692612 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:20.692547    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a7043cc-b151-4888-90cc-f3dae8a2a91d-original-pull-secret podName:9a7043cc-b151-4888-90cc-f3dae8a2a91d nodeName:}" failed. No retries permitted until 2026-07-28 16:50:28.692526102 +0000 UTC m=+18.163939744 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a7043cc-b151-4888-90cc-f3dae8a2a91d-original-pull-secret") pod "global-pull-secret-syncer-fvtsl" (UID: "9a7043cc-b151-4888-90cc-f3dae8a2a91d") : object "kube-system"/"original-pull-secret" not registered
Jul 28 16:50:20.793429 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:20.793387    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trqt6\" (UniqueName: \"kubernetes.io/projected/7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee-kube-api-access-trqt6\") pod \"network-check-target-hbfct\" (UID: \"7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee\") " pod="openshift-network-diagnostics/network-check-target-hbfct"
Jul 28 16:50:20.793603 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:20.793548    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 16:50:20.793603 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:20.793567    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 16:50:20.793603 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:20.793576    2561 projected.go:196] Error preparing data for projected volume kube-api-access-trqt6 for pod openshift-network-diagnostics/network-check-target-hbfct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 16:50:20.793717 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:20.793625    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee-kube-api-access-trqt6 podName:7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee nodeName:}" failed. No retries permitted until 2026-07-28 16:50:28.793611423 +0000 UTC m=+18.265025080 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-trqt6" (UniqueName: "kubernetes.io/projected/7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee-kube-api-access-trqt6") pod "network-check-target-hbfct" (UID: "7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 16:50:21.071201 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:21.071165    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvtsl"
Jul 28 16:50:21.071380 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:21.071214    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vn69s"
Jul 28 16:50:21.071380 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:21.071294    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvtsl" podUID="9a7043cc-b151-4888-90cc-f3dae8a2a91d"
Jul 28 16:50:21.071760 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:21.071733    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vn69s" podUID="ab2695e6-884f-4726-ba45-fe2772ee69a8"
Jul 28 16:50:22.070787 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:22.070746    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hbfct"
Jul 28 16:50:22.071333 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:22.070870    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hbfct" podUID="7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee"
Jul 28 16:50:23.070808 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:23.070274    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vn69s"
Jul 28 16:50:23.070808 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:23.070283    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvtsl"
Jul 28 16:50:23.070808 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:23.070412    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vn69s" podUID="ab2695e6-884f-4726-ba45-fe2772ee69a8"
Jul 28 16:50:23.070808 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:23.070510    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvtsl" podUID="9a7043cc-b151-4888-90cc-f3dae8a2a91d"
Jul 28 16:50:24.070461 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:24.070430    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hbfct"
Jul 28 16:50:24.070626 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:24.070542    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hbfct" podUID="7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee"
Jul 28 16:50:25.070897 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:25.070860    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvtsl"
Jul 28 16:50:25.071344 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:25.070859    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vn69s"
Jul 28 16:50:25.071344 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:25.071000    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvtsl" podUID="9a7043cc-b151-4888-90cc-f3dae8a2a91d"
Jul 28 16:50:25.071344 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:25.071068    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vn69s" podUID="ab2695e6-884f-4726-ba45-fe2772ee69a8"
Jul 28 16:50:26.070573 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:26.070541    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hbfct"
Jul 28 16:50:26.070719 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:26.070649    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hbfct" podUID="7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee"
Jul 28 16:50:27.070342 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:27.070311    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vn69s"
Jul 28 16:50:27.070781 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:27.070454    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vn69s" podUID="ab2695e6-884f-4726-ba45-fe2772ee69a8"
Jul 28 16:50:27.070781 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:27.070512    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvtsl"
Jul 28 16:50:27.070781 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:27.070621    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvtsl" podUID="9a7043cc-b151-4888-90cc-f3dae8a2a91d"
Jul 28 16:50:28.069955 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:28.069911    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hbfct"
Jul 28 16:50:28.070139 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:28.070050    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hbfct" podUID="7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee"
Jul 28 16:50:28.653930 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:28.653896    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab2695e6-884f-4726-ba45-fe2772ee69a8-metrics-certs\") pod \"network-metrics-daemon-vn69s\" (UID: \"ab2695e6-884f-4726-ba45-fe2772ee69a8\") " pod="openshift-multus/network-metrics-daemon-vn69s"
Jul 28 16:50:28.654413 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:28.654042    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 16:50:28.654413 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:28.654090    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab2695e6-884f-4726-ba45-fe2772ee69a8-metrics-certs podName:ab2695e6-884f-4726-ba45-fe2772ee69a8 nodeName:}" failed. No retries permitted until 2026-07-28 16:50:44.654075273 +0000 UTC m=+34.125488910 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab2695e6-884f-4726-ba45-fe2772ee69a8-metrics-certs") pod "network-metrics-daemon-vn69s" (UID: "ab2695e6-884f-4726-ba45-fe2772ee69a8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 16:50:28.754679 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:28.754645    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a7043cc-b151-4888-90cc-f3dae8a2a91d-original-pull-secret\") pod \"global-pull-secret-syncer-fvtsl\" (UID: \"9a7043cc-b151-4888-90cc-f3dae8a2a91d\") " pod="kube-system/global-pull-secret-syncer-fvtsl"
Jul 28 16:50:28.754838 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:28.754789    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 16:50:28.754879 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:28.754848    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a7043cc-b151-4888-90cc-f3dae8a2a91d-original-pull-secret podName:9a7043cc-b151-4888-90cc-f3dae8a2a91d nodeName:}" failed. No retries permitted until 2026-07-28 16:50:44.754828093 +0000 UTC m=+34.226241733 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a7043cc-b151-4888-90cc-f3dae8a2a91d-original-pull-secret") pod "global-pull-secret-syncer-fvtsl" (UID: "9a7043cc-b151-4888-90cc-f3dae8a2a91d") : object "kube-system"/"original-pull-secret" not registered
Jul 28 16:50:28.855433 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:28.855402    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trqt6\" (UniqueName: \"kubernetes.io/projected/7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee-kube-api-access-trqt6\") pod \"network-check-target-hbfct\" (UID: \"7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee\") " pod="openshift-network-diagnostics/network-check-target-hbfct"
Jul 28 16:50:28.855627 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:28.855582    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 16:50:28.855627 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:28.855605    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 16:50:28.855627 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:28.855615    2561 projected.go:196] Error preparing data for projected volume kube-api-access-trqt6 for pod openshift-network-diagnostics/network-check-target-hbfct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 16:50:28.855732 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:28.855662    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee-kube-api-access-trqt6 podName:7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee nodeName:}" failed. No retries permitted until 2026-07-28 16:50:44.855648698 +0000 UTC m=+34.327062352 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-trqt6" (UniqueName: "kubernetes.io/projected/7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee-kube-api-access-trqt6") pod "network-check-target-hbfct" (UID: "7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 16:50:29.070102 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:29.070066    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vn69s"
Jul 28 16:50:29.070261 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:29.070068    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvtsl"
Jul 28 16:50:29.070330 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:29.070278    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vn69s" podUID="ab2695e6-884f-4726-ba45-fe2772ee69a8"
Jul 28 16:50:29.070465 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:29.070439    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvtsl" podUID="9a7043cc-b151-4888-90cc-f3dae8a2a91d"
Jul 28 16:50:30.070271 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:30.070235    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hbfct"
Jul 28 16:50:30.070723 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:30.070363    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hbfct" podUID="7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee"
Jul 28 16:50:31.071289 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:31.071263    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvtsl"
Jul 28 16:50:31.071740 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:31.071368    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvtsl" podUID="9a7043cc-b151-4888-90cc-f3dae8a2a91d"
Jul 28 16:50:31.071740 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:31.071477    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vn69s"
Jul 28 16:50:31.071740 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:31.071628    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vn69s" podUID="ab2695e6-884f-4726-ba45-fe2772ee69a8"
Jul 28 16:50:32.069807 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:32.069777    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hbfct"
Jul 28 16:50:32.069987 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:32.069876    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hbfct" podUID="7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee"
Jul 28 16:50:33.070571 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:33.070128    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvtsl"
Jul 28 16:50:33.070571 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:33.070250    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvtsl" podUID="9a7043cc-b151-4888-90cc-f3dae8a2a91d"
Jul 28 16:50:33.070571 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:33.070337    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vn69s"
Jul 28 16:50:33.070571 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:33.070424    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vn69s" podUID="ab2695e6-884f-4726-ba45-fe2772ee69a8"
Jul 28 16:50:34.070540 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:34.070239    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hbfct"
Jul 28 16:50:34.070670 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:34.070621    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hbfct" podUID="7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee"
Jul 28 16:50:34.258916 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:34.258873    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7st4p" event={"ID":"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4","Type":"ContainerStarted","Data":"fa7af6d4326711bc94632606891c62c2fb18138caae0cba185c0dee3230a2e0f"}
Jul 28 16:50:34.259111 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:34.258995    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7st4p" event={"ID":"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4","Type":"ContainerStarted","Data":"a88447655ba9d03eb937fc60d482ef17d389a88f86c18c76b9b0f0d45a7734e5"}
Jul 28 16:50:34.259111 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:34.259042    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7st4p" event={"ID":"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4","Type":"ContainerStarted","Data":"b9d0a4e5b4da10d6091c1a9969b8100c4e37c3e49e5445d7754fce306260d15b"}
Jul 28 16:50:34.259111 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:34.259073    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7st4p" event={"ID":"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4","Type":"ContainerStarted","Data":"fd00d998522c458f64aa8db7001c1e6c3897344aa4c7299aeeb1bfbfc15661e0"}
Jul 28 16:50:34.259111 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:34.259107    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7st4p" event={"ID":"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4","Type":"ContainerStarted","Data":"37b1330ac023cf544c429f7a951900967f4577b873bb0f1816537bc1554a82f8"}
Jul 28 16:50:34.259303 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:34.259154    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7st4p" event={"ID":"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4","Type":"ContainerStarted","Data":"1f6aa5b6b08447df8f5dcb5ad1dd1e19847f472a621529394aac6d5ee868dcfa"}
Jul 28 16:50:34.260523 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:34.260493    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-gspwj" event={"ID":"43c3a34e-2451-4eb9-878c-8100a5d2ac48","Type":"ContainerStarted","Data":"b79ebbb7f38e654613ea4245b83aeb83c3184f84d939a31670aced2dcb96794f"}
Jul 28 16:50:34.262145 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:34.262116    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qrhwd" event={"ID":"5c2c260e-d050-44eb-90d3-da4d25ade88a","Type":"ContainerStarted","Data":"ef8b0a02804af4c97c0216f33deed22116dcd56c30279f1aa8e1f021c9c0fa77"}
Jul 28 16:50:34.263795 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:34.263766    2561 generic.go:356] "Generic (PLEG): container finished" podID="8537db2a-96d8-4755-ae0b-40e2462c90c2" containerID="176ad37d8e4fd7cfc96371fee1ddf4b15056f8ab9a3003b80022052ab69b95ff" exitCode=0
Jul 28 16:50:34.263905 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:34.263802    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-txmf4" event={"ID":"8537db2a-96d8-4755-ae0b-40e2462c90c2","Type":"ContainerDied","Data":"176ad37d8e4fd7cfc96371fee1ddf4b15056f8ab9a3003b80022052ab69b95ff"}
Jul 28 16:50:34.265479 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:34.265455    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svsd" event={"ID":"0eb1879f-3c34-490c-b09d-317b5ed656e9","Type":"ContainerStarted","Data":"8a3a2e934884c5b18c2efa61d681993f19a375452b59d7ea762cb32b71861b6a"}
Jul 28 16:50:34.267017 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:34.266996    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-495dh" event={"ID":"c78f3240-32b5-4e57-bc03-c1f9e08c28e5","Type":"ContainerStarted","Data":"5c7339a36bd83c70b45f662572576e1fd8f43599eac46caa8a7a5663b5614186"}
Jul 28 16:50:34.268686 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:34.268664    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q77xn" event={"ID":"5eef3908-3a57-4ba9-be8c-8c78354aaf2a","Type":"ContainerStarted","Data":"d344842dd98497848e57ad57ef9ccb8cbb23a031a3068129afd312f9894cf236"}
Jul 28 16:50:34.270203 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:34.270180    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pmwsn" event={"ID":"dba5feb3-e14f-4764-b07c-406929f4587e","Type":"ContainerStarted","Data":"7eda61f57e284b4385708cdb25c597d84b03d8bc3140fc2dfc613e8843b744b7"}
Jul 28 16:50:34.278515 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:34.278475    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-gspwj" podStartSLOduration=11.807986424 podStartE2EDuration="23.278463142s" totalImagesPullingTime="11.470476718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:50:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:50:34.278117881 +0000 UTC m=+23.749531542" watchObservedRunningTime="2026-07-28 16:50:34.278463142 +0000 UTC m=+23.749876802"
Jul 28 16:50:34.278696 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:34.278666    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-92.ec2.internal" podStartSLOduration=21.278660596 podStartE2EDuration="21.278660596s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 16:50:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:50:16.238461874 +0000 UTC m=+5.709875541" watchObservedRunningTime="2026-07-28 16:50:34.278660596 +0000 UTC m=+23.750074256"
Jul 28 16:50:34.295070 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:34.295027    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qrhwd" podStartSLOduration=4.090485744 podStartE2EDuration="23.295014975s" totalImagesPullingTime="19.204529231s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 16:50:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:50:34.294534679 +0000 UTC m=+23.765948486" watchObservedRunningTime="2026-07-28 16:50:34.295014975 +0000 UTC m=+23.766429032"
Jul 28 16:50:34.313402 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:34.313348    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pmwsn" podStartSLOduration=4.116597495 podStartE2EDuration="23.313334884s" totalImagesPullingTime="19.196737389s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 16:50:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:50:34.313296314 +0000 UTC m=+23.784709973" watchObservedRunningTime="2026-07-28 16:50:34.313334884 +0000 UTC m=+23.784748543"
Jul 28 16:50:34.359446 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:34.359394    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-q77xn" podStartSLOduration=4.126839477 podStartE2EDuration="23.359383408s" totalImagesPullingTime="19.232543931s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 16:50:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:50:34.359085857 +0000 UTC m=+23.830499518" watchObservedRunningTime="2026-07-28 16:50:34.359383408 +0000 UTC m=+23.830797067"
Jul 28 16:50:34.387840 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:34.387807    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:34.465042 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:34.464959    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:34.565358 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:34.565321    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:34.668347 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:34.668317    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:34.942670 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:34.942641    2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 28 16:50:34.956507 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:34.956424    2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T16:50:34.942665578Z","UUID":"24fc29dd-af3f-4f2f-831c-8502ff67714e","Handler":null,"Name":"","Endpoint":""}
Jul 28 16:50:34.958127 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:34.958107    2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 28 16:50:34.958227 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:34.958152    2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 28 16:50:35.070838 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:35.070751    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vn69s"
Jul 28 16:50:35.071309 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:35.070756    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvtsl"
Jul 28 16:50:35.071309 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:35.070865    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vn69s" podUID="ab2695e6-884f-4726-ba45-fe2772ee69a8"
Jul 28 16:50:35.071309 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:35.070965    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvtsl" podUID="9a7043cc-b151-4888-90cc-f3dae8a2a91d"
Jul 28 16:50:35.274390 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:35.274336    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5x69v" event={"ID":"1540ebde-12ed-4345-98c4-ed0dd754c994","Type":"ContainerStarted","Data":"285cf28bed2022b5c8745a3d99e1225e14262ace82ad98bc301ffb22a9ade6ad"}
Jul 28 16:50:35.276461 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:35.276427    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svsd" event={"ID":"0eb1879f-3c34-490c-b09d-317b5ed656e9","Type":"ContainerStarted","Data":"fbaa31a9c9cc197e6c7e14ab01711331a3ec8f00e49b59ead9997738c3502c59"}
Jul 28 16:50:35.297690 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:35.297639    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-495dh" podStartSLOduration=5.109737983 podStartE2EDuration="24.297620555s" totalImagesPullingTime="19.187882572s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 16:50:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:50:34.375693866 +0000 UTC m=+23.847107527" watchObservedRunningTime="2026-07-28 16:50:35.297620555 +0000 UTC m=+24.769034216"
Jul 28 16:50:35.449961 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:35.449860    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:35.553355 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:35.553315    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:35.649699 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:35.649663    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:36.070195 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:36.070160    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hbfct"
Jul 28 16:50:36.070447 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:36.070281    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hbfct" podUID="7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee"
Jul 28 16:50:36.707367 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:36.707278    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:36.755061 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:36.755025    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-gspwj"
Jul 28 16:50:36.769347 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:36.769316    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:36.981037 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:36.981008    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:37.065986 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:37.065953    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:37.069914 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:37.069887    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vn69s"
Jul 28 16:50:37.070064 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:37.070040    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vn69s" podUID="ab2695e6-884f-4726-ba45-fe2772ee69a8"
Jul 28 16:50:37.070126 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:37.070072    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvtsl"
Jul 28 16:50:37.070195 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:37.070174    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvtsl" podUID="9a7043cc-b151-4888-90cc-f3dae8a2a91d"
Jul 28 16:50:37.284990 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:37.284886    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7st4p" event={"ID":"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4","Type":"ContainerStarted","Data":"5b607c82e5e45fed7e764f8d5c7809e0f430e7810215b82d79cd3880cec0e4d2"}
Jul 28 16:50:37.287243 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:37.287210    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svsd" event={"ID":"0eb1879f-3c34-490c-b09d-317b5ed656e9","Type":"ContainerStarted","Data":"282d0f58dcc4b924d1632b93466eaf7513d7f33a2e2a1c785c1e3ce1ad0cde7e"}
Jul 28 16:50:37.309170 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:37.309112    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5x69v" podStartSLOduration=7.124819028 podStartE2EDuration="26.309093988s" totalImagesPullingTime="19.18427496s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 16:50:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:50:35.297785066 +0000 UTC m=+24.769198727" watchObservedRunningTime="2026-07-28 16:50:37.309093988 +0000 UTC m=+26.780507648"
Jul 28 16:50:37.455598 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:37.455554    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:37.525871 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:37.525672    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:37.614435 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:37.614358    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:37.711011 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:37.710973    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:37.767536 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:37.767509    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:37.854221 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:37.854188    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:37.911040 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:37.910971    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-495dh_c78f3240-32b5-4e57-bc03-c1f9e08c28e5/dns-node-resolver/0.log"
Jul 28 16:50:38.069805 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:38.069778    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hbfct"
Jul 28 16:50:38.070019 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:38.069905    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hbfct" podUID="7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee"
Jul 28 16:50:38.150356 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:38.150310    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:38.235868 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:38.235837    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:38.733890 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:38.733865    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-gspwj"
Jul 28 16:50:38.734652 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:38.734637    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-gspwj"
Jul 28 16:50:38.753657 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:38.753578    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7svsd" podStartSLOduration=6.174089325 podStartE2EDuration="27.753563477s" totalImagesPullingTime="21.579474152s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 16:50:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:50:37.309277029 +0000 UTC m=+26.780690692" watchObservedRunningTime="2026-07-28 16:50:38.753563477 +0000 UTC m=+28.224977144"
Jul 28 16:50:39.070235 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:39.070004    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvtsl"
Jul 28 16:50:39.070391 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:39.070079    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vn69s"
Jul 28 16:50:39.070391 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:39.070294    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvtsl" podUID="9a7043cc-b151-4888-90cc-f3dae8a2a91d"
Jul 28 16:50:39.070391 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:39.070348    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vn69s" podUID="ab2695e6-884f-4726-ba45-fe2772ee69a8"
Jul 28 16:50:39.292505 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:39.292469    2561 generic.go:356] "Generic (PLEG): container finished" podID="8537db2a-96d8-4755-ae0b-40e2462c90c2" containerID="f6966ab92d8837e8e10750f66100dfc9815bac6d1c91b471beb4dde515254e86" exitCode=0
Jul 28 16:50:39.292670 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:39.292555    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-txmf4" event={"ID":"8537db2a-96d8-4755-ae0b-40e2462c90c2","Type":"ContainerDied","Data":"f6966ab92d8837e8e10750f66100dfc9815bac6d1c91b471beb4dde515254e86"}
Jul 28 16:50:39.296318 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:39.296291    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-7st4p" event={"ID":"5286ccd9-f5ee-4c9c-963d-93d2530a5fc4","Type":"ContainerStarted","Data":"35d800a6bb2e53d3eeca4ef51ca312354dc2eb19271f7936273d12069566abe0"}
Jul 28 16:50:39.299439 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:39.297436    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-gspwj"
Jul 28 16:50:39.315638 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:39.315619    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qrhwd_5c2c260e-d050-44eb-90d3-da4d25ade88a/node-ca/0.log"
Jul 28 16:50:39.394363 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:39.394306    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:39.395762 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:39.395729    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-7st4p" podStartSLOduration=9.145271561 podStartE2EDuration="28.39571731s" totalImagesPullingTime="19.250445749s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 16:50:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:50:39.395348956 +0000 UTC m=+28.866762616" watchObservedRunningTime="2026-07-28 16:50:39.39571731 +0000 UTC m=+28.867130969"
Jul 28 16:50:39.458879 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:39.458855    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:39.773799 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:39.773725    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:39.880959 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:39.879383    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:40.070418 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:40.070358    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hbfct"
Jul 28 16:50:40.070632 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:40.070453    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hbfct" podUID="7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee"
Jul 28 16:50:40.300117 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:40.300091    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-txmf4" event={"ID":"8537db2a-96d8-4755-ae0b-40e2462c90c2","Type":"ContainerStarted","Data":"fc97ae827ea34c33c3194b130ffaa2e6ed0b2b55020e5986db77f7487779a360"}
Jul 28 16:50:40.301302 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:40.300821    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:40.301302 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:40.300889    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:40.301302 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:40.300922    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:40.316091 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:40.316069    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:40.316564 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:40.316544    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:50:40.783100 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:40.783070    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fvtsl"]
Jul 28 16:50:40.783488 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:40.783219    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvtsl"
Jul 28 16:50:40.783488 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:40.783325    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvtsl" podUID="9a7043cc-b151-4888-90cc-f3dae8a2a91d"
Jul 28 16:50:40.786734 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:40.786701    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hbfct"]
Jul 28 16:50:40.786845 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:40.786808    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hbfct"
Jul 28 16:50:40.786953 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:40.786903    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hbfct" podUID="7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee"
Jul 28 16:50:40.787353 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:40.787331    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vn69s"]
Jul 28 16:50:40.787433 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:40.787425    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vn69s"
Jul 28 16:50:40.787518 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:40.787498    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vn69s" podUID="ab2695e6-884f-4726-ba45-fe2772ee69a8"
Jul 28 16:50:40.804376 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:40.804298    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:41.303716 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:41.303688    2561 generic.go:356] "Generic (PLEG): container finished" podID="8537db2a-96d8-4755-ae0b-40e2462c90c2" containerID="fc97ae827ea34c33c3194b130ffaa2e6ed0b2b55020e5986db77f7487779a360" exitCode=0
Jul 28 16:50:41.303883 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:41.303791    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-txmf4" event={"ID":"8537db2a-96d8-4755-ae0b-40e2462c90c2","Type":"ContainerDied","Data":"fc97ae827ea34c33c3194b130ffaa2e6ed0b2b55020e5986db77f7487779a360"}
Jul 28 16:50:41.559184 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:41.559095    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:41.665108 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:41.665075    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:41.769636 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:41.769609    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:41.869615 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:41.869525    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:41.966743 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:41.966718    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:42.067344 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:42.067311    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:42.069835 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:42.069819    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hbfct"
Jul 28 16:50:42.069960 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:42.069929    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hbfct" podUID="7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee"
Jul 28 16:50:42.070002 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:42.069977    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vn69s"
Jul 28 16:50:42.070065 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:42.070051    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vn69s" podUID="ab2695e6-884f-4726-ba45-fe2772ee69a8"
Jul 28 16:50:42.261377 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:42.261350    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:43.070843 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:43.070679    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvtsl"
Jul 28 16:50:43.071198 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:43.070928    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvtsl" podUID="9a7043cc-b151-4888-90cc-f3dae8a2a91d"
Jul 28 16:50:43.281283 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:43.281247    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:43.310025 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:43.309996    2561 generic.go:356] "Generic (PLEG): container finished" podID="8537db2a-96d8-4755-ae0b-40e2462c90c2" containerID="e1c02e312f9f63d0b726d930a112783fd14398976f901a87bad179ef20f1c869" exitCode=0
Jul 28 16:50:43.310132 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:43.310047    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-txmf4" event={"ID":"8537db2a-96d8-4755-ae0b-40e2462c90c2","Type":"ContainerDied","Data":"e1c02e312f9f63d0b726d930a112783fd14398976f901a87bad179ef20f1c869"}
Jul 28 16:50:43.631820 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:43.631790    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:43.697814 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:43.697786    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:43.846685 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:43.846657    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:44.046254 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:44.046222    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:44.070262 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:44.070237    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vn69s"
Jul 28 16:50:44.070373 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:44.070342    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vn69s" podUID="ab2695e6-884f-4726-ba45-fe2772ee69a8"
Jul 28 16:50:44.070412 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:44.070393    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hbfct"
Jul 28 16:50:44.070487 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:44.070471    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hbfct" podUID="7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee"
Jul 28 16:50:44.447507 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:44.447438    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:44.676700 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:44.676671    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab2695e6-884f-4726-ba45-fe2772ee69a8-metrics-certs\") pod \"network-metrics-daemon-vn69s\" (UID: \"ab2695e6-884f-4726-ba45-fe2772ee69a8\") " pod="openshift-multus/network-metrics-daemon-vn69s"
Jul 28 16:50:44.676868 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:44.676814    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 16:50:44.676947 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:44.676876    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab2695e6-884f-4726-ba45-fe2772ee69a8-metrics-certs podName:ab2695e6-884f-4726-ba45-fe2772ee69a8 nodeName:}" failed. No retries permitted until 2026-07-28 16:51:16.6768546 +0000 UTC m=+66.148268256 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab2695e6-884f-4726-ba45-fe2772ee69a8-metrics-certs") pod "network-metrics-daemon-vn69s" (UID: "ab2695e6-884f-4726-ba45-fe2772ee69a8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 16:50:44.777965 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:44.777916    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a7043cc-b151-4888-90cc-f3dae8a2a91d-original-pull-secret\") pod \"global-pull-secret-syncer-fvtsl\" (UID: \"9a7043cc-b151-4888-90cc-f3dae8a2a91d\") " pod="kube-system/global-pull-secret-syncer-fvtsl"
Jul 28 16:50:44.778133 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:44.778079    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 16:50:44.778211 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:44.778153    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a7043cc-b151-4888-90cc-f3dae8a2a91d-original-pull-secret podName:9a7043cc-b151-4888-90cc-f3dae8a2a91d nodeName:}" failed. No retries permitted until 2026-07-28 16:51:16.778130608 +0000 UTC m=+66.249544261 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9a7043cc-b151-4888-90cc-f3dae8a2a91d-original-pull-secret") pod "global-pull-secret-syncer-fvtsl" (UID: "9a7043cc-b151-4888-90cc-f3dae8a2a91d") : object "kube-system"/"original-pull-secret" not registered
Jul 28 16:50:44.878638 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:44.878610    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trqt6\" (UniqueName: \"kubernetes.io/projected/7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee-kube-api-access-trqt6\") pod \"network-check-target-hbfct\" (UID: \"7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee\") " pod="openshift-network-diagnostics/network-check-target-hbfct"
Jul 28 16:50:44.878822 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:44.878795    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 16:50:44.878822 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:44.878823    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 16:50:44.879026 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:44.878837    2561 projected.go:196] Error preparing data for projected volume kube-api-access-trqt6 for pod openshift-network-diagnostics/network-check-target-hbfct: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 16:50:44.879026 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:44.878898    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee-kube-api-access-trqt6 podName:7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee nodeName:}" failed. No retries permitted until 2026-07-28 16:51:16.878879761 +0000 UTC m=+66.350293417 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-trqt6" (UniqueName: "kubernetes.io/projected/7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee-kube-api-access-trqt6") pod "network-check-target-hbfct" (UID: "7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 16:50:45.053527 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:45.053434    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:45.073844 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:45.073819    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvtsl"
Jul 28 16:50:45.074050 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:45.073952    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvtsl" podUID="9a7043cc-b151-4888-90cc-f3dae8a2a91d"
Jul 28 16:50:45.356326 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:45.356241    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:45.462143 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:45.462102    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:45.563029 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:45.562995    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:45.662348 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:45.662274    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:46.070297 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:46.070260    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hbfct"
Jul 28 16:50:46.070472 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:46.070278    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vn69s"
Jul 28 16:50:46.070472 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:46.070387    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hbfct" podUID="7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee"
Jul 28 16:50:46.070576 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:46.070532    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vn69s" podUID="ab2695e6-884f-4726-ba45-fe2772ee69a8"
Jul 28 16:50:46.253339 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:46.253308    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:46.353236 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:46.353155    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:46.658261 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:46.658186    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:47.073600 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:47.073572    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvtsl"
Jul 28 16:50:47.073780 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:47.073693    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvtsl" podUID="9a7043cc-b151-4888-90cc-f3dae8a2a91d"
Jul 28 16:50:47.076065 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:47.076034    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:47.240093 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:47.240059    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:47.323044 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:47.323004    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:47.463496 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:47.463412    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:47.763093 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:47.763071    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:47.848157 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:47.848133    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:47.906227 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:47.906199    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:48.010653 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:48.010575    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:48.070607 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:48.070557    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hbfct"
Jul 28 16:50:48.070607 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:48.070596    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vn69s"
Jul 28 16:50:48.070741 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:48.070698    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hbfct" podUID="7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee"
Jul 28 16:50:48.070842 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:48.070824    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vn69s" podUID="ab2695e6-884f-4726-ba45-fe2772ee69a8"
Jul 28 16:50:48.109081 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:48.109050    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:48.176031 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:48.176000    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:48.255194 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:48.255163    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:48.319836 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:48.319759    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:48.323455 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:48.323427    2561 generic.go:356] "Generic (PLEG): container finished" podID="8537db2a-96d8-4755-ae0b-40e2462c90c2" containerID="8a357f935a52c5bcd5f152691c8c753131f9906bf2227f1ec16af9a51507ef60" exitCode=0
Jul 28 16:50:48.323587 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:48.323476    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-txmf4" event={"ID":"8537db2a-96d8-4755-ae0b-40e2462c90c2","Type":"ContainerDied","Data":"8a357f935a52c5bcd5f152691c8c753131f9906bf2227f1ec16af9a51507ef60"}
Jul 28 16:50:48.574291 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:48.574206    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:48.674378 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:48.674346    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:48.775646 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:48.775616    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:48.875696 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:48.875614    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:49.070601 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:49.070563    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvtsl"
Jul 28 16:50:49.070782 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:49.070672    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvtsl" podUID="9a7043cc-b151-4888-90cc-f3dae8a2a91d"
Jul 28 16:50:49.328596 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:49.328563    2561 generic.go:356] "Generic (PLEG): container finished" podID="8537db2a-96d8-4755-ae0b-40e2462c90c2" containerID="5d970f1b455cc3fda6d0e99db7bca83dfdfa6b09be2be149c2b0b0df2c840e03" exitCode=0
Jul 28 16:50:49.328786 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:49.328630    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-txmf4" event={"ID":"8537db2a-96d8-4755-ae0b-40e2462c90c2","Type":"ContainerDied","Data":"5d970f1b455cc3fda6d0e99db7bca83dfdfa6b09be2be149c2b0b0df2c840e03"}
Jul 28 16:50:49.447077 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:49.447048    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:49.548607 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:49.548563    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:49.858255 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:49.858221    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:49.919007 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:49.918973    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:50.070394 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:50.070361    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hbfct"
Jul 28 16:50:50.070579 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:50.070477    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hbfct" podUID="7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee"
Jul 28 16:50:50.070579 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:50.070528    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vn69s"
Jul 28 16:50:50.070682 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:50.070619    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vn69s" podUID="ab2695e6-884f-4726-ba45-fe2772ee69a8"
Jul 28 16:50:50.073191 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:50.073173    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:50.170107 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:50.170029    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:50.334718 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:50.334541    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-txmf4" event={"ID":"8537db2a-96d8-4755-ae0b-40e2462c90c2","Type":"ContainerStarted","Data":"e6a739bfffcf372a8f8fc99a5b0c9543727a46806236dd461388c53f2a238dab"}
Jul 28 16:50:50.362906 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:50.362844    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-txmf4" podStartSLOduration=9.777431414 podStartE2EDuration="39.362828673s" totalImagesPullingTime="29.585397259s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 16:50:11 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:50:50.362500428 +0000 UTC m=+39.833914090" watchObservedRunningTime="2026-07-28 16:50:50.362828673 +0000 UTC m=+39.834242333"
Jul 28 16:50:50.668351 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:50.668318    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:50.885196 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:50.885153    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:50.942328 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:50.942221    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:51.070920 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:51.070891    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvtsl"
Jul 28 16:50:51.071072 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:51.070985    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvtsl" podUID="9a7043cc-b151-4888-90cc-f3dae8a2a91d"
Jul 28 16:50:51.248595 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:51.248563    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:51.449978 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:51.449946    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:51.856394 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:51.856366    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:52.052677 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:52.052645    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:52.070768 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:52.070748    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hbfct"
Jul 28 16:50:52.070857 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:52.070827    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hbfct" podUID="7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee"
Jul 28 16:50:52.070895 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:52.070881    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vn69s"
Jul 28 16:50:52.070999 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:52.070983    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vn69s" podUID="ab2695e6-884f-4726-ba45-fe2772ee69a8"
Jul 28 16:50:52.452596 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:52.452572    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:52.651421 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:52.651388    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:53.070660 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:53.070633    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvtsl"
Jul 28 16:50:53.071032 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:53.070728    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvtsl" podUID="9a7043cc-b151-4888-90cc-f3dae8a2a91d"
Jul 28 16:50:54.070784 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:54.070754    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hbfct"
Jul 28 16:50:54.071166 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:54.070754    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vn69s"
Jul 28 16:50:54.071166 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:54.070855    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hbfct" podUID="7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee"
Jul 28 16:50:54.071166 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:54.070926    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vn69s" podUID="ab2695e6-884f-4726-ba45-fe2772ee69a8"
Jul 28 16:50:54.333908 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:54.333839    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:54.411402 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:54.411370    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:55.070255 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:55.070222    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvtsl"
Jul 28 16:50:55.070423 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:55.070330    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvtsl" podUID="9a7043cc-b151-4888-90cc-f3dae8a2a91d"
Jul 28 16:50:55.096862 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:55.096830    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:55.196743 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:55.196714    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:56.070588 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:56.070561    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hbfct"
Jul 28 16:50:56.070809 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:56.070561    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vn69s"
Jul 28 16:50:56.070809 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:56.070646    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hbfct" podUID="7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee"
Jul 28 16:50:56.070809 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:56.070737    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vn69s" podUID="ab2695e6-884f-4726-ba45-fe2772ee69a8"
Jul 28 16:50:57.070785 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:57.070757    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvtsl"
Jul 28 16:50:57.071183 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:57.070849    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvtsl" podUID="9a7043cc-b151-4888-90cc-f3dae8a2a91d"
Jul 28 16:50:58.070116 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:58.070085    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vn69s"
Jul 28 16:50:58.070116 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:58.070119    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hbfct"
Jul 28 16:50:58.070313 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:58.070204    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vn69s" podUID="ab2695e6-884f-4726-ba45-fe2772ee69a8"
Jul 28 16:50:58.070313 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:58.070279    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hbfct" podUID="7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee"
Jul 28 16:50:58.908390 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:58.908361    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:58.991842 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:58.991813    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:50:59.070425 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:50:59.070401    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvtsl"
Jul 28 16:50:59.070552 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:50:59.070500    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvtsl" podUID="9a7043cc-b151-4888-90cc-f3dae8a2a91d"
Jul 28 16:51:00.069879 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:00.069837    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hbfct"
Jul 28 16:51:00.070252 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:00.069837    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vn69s"
Jul 28 16:51:00.070252 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:51:00.069964    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hbfct" podUID="7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee"
Jul 28 16:51:00.070252 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:51:00.070034    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vn69s" podUID="ab2695e6-884f-4726-ba45-fe2772ee69a8"
Jul 28 16:51:01.070723 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:01.070689    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvtsl"
Jul 28 16:51:01.071193 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:51:01.070766    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvtsl" podUID="9a7043cc-b151-4888-90cc-f3dae8a2a91d"
Jul 28 16:51:02.070070 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:02.070039    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vn69s"
Jul 28 16:51:02.070240 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:02.070076    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hbfct"
Jul 28 16:51:02.070240 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:51:02.070151    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vn69s" podUID="ab2695e6-884f-4726-ba45-fe2772ee69a8"
Jul 28 16:51:02.070322 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:51:02.070260    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hbfct" podUID="7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee"
Jul 28 16:51:02.712955 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:02.712916    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:02.812536 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:02.812507    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:03.070054 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:03.070030    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvtsl"
Jul 28 16:51:03.070184 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:51:03.070123    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fvtsl" podUID="9a7043cc-b151-4888-90cc-f3dae8a2a91d"
Jul 28 16:51:03.659222 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:03.659188    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:03.744869 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:03.744836    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:03.853582 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:03.853544    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:03.958116 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:03.958093    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:04.053150 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.053107    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:04.070550 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.070526    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hbfct"
Jul 28 16:51:04.070674 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:51:04.070638    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hbfct" podUID="7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee"
Jul 28 16:51:04.070747 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.070728    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vn69s"
Jul 28 16:51:04.070847 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:51:04.070830    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-vn69s" podUID="ab2695e6-884f-4726-ba45-fe2772ee69a8"
Jul 28 16:51:04.200717 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.200691    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:04.298529 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.298507    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:04.323253 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.323234    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-92.ec2.internal" event="NodeReady"
Jul 28 16:51:04.323440 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.323353    2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 28 16:51:04.398089 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.398065    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-lprvh"]
Jul 28 16:51:04.419660 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.419640    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-d9pjq"]
Jul 28 16:51:04.419765 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.419752    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lprvh"
Jul 28 16:51:04.422738 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.422717    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 28 16:51:04.422913 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.422898    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 28 16:51:04.423718 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.423701    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5xfk2\""
Jul 28 16:51:04.445637 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.445613    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lprvh"]
Jul 28 16:51:04.445731 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.445651    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-d9pjq"]
Jul 28 16:51:04.445731 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.445688    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-zzdwf"]
Jul 28 16:51:04.445838 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.445817    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-d9pjq"
Jul 28 16:51:04.449430 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.449406    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 28 16:51:04.449519 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.449446    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 28 16:51:04.450414 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.450396    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 28 16:51:04.450414 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.450404    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 28 16:51:04.450572 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.450469    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9rknk\""
Jul 28 16:51:04.461607 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.461587    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zzdwf"
Jul 28 16:51:04.461607 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.461602    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zzdwf"]
Jul 28 16:51:04.464624 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.464608    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 28 16:51:04.465109 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.465086    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 28 16:51:04.465247 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.465232    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 28 16:51:04.465730 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.465714    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-qkqqp\""
Jul 28 16:51:04.523708 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.523684    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1f76d1cf-0908-4c40-9d33-50e1b6c85200-crio-socket\") pod \"insights-runtime-extractor-d9pjq\" (UID: \"1f76d1cf-0908-4c40-9d33-50e1b6c85200\") " pod="openshift-insights/insights-runtime-extractor-d9pjq"
Jul 28 16:51:04.523825 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.523714    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1f76d1cf-0908-4c40-9d33-50e1b6c85200-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d9pjq\" (UID: \"1f76d1cf-0908-4c40-9d33-50e1b6c85200\") " pod="openshift-insights/insights-runtime-extractor-d9pjq"
Jul 28 16:51:04.523825 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.523737    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1fb47334-76af-492b-8706-2e51e6da5fcc-config-volume\") pod \"dns-default-lprvh\" (UID: \"1fb47334-76af-492b-8706-2e51e6da5fcc\") " pod="openshift-dns/dns-default-lprvh"
Jul 28 16:51:04.523825 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.523762    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1f76d1cf-0908-4c40-9d33-50e1b6c85200-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d9pjq\" (UID: \"1f76d1cf-0908-4c40-9d33-50e1b6c85200\") " pod="openshift-insights/insights-runtime-extractor-d9pjq"
Jul 28 16:51:04.524022 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.523848    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1fb47334-76af-492b-8706-2e51e6da5fcc-tmp-dir\") pod \"dns-default-lprvh\" (UID: \"1fb47334-76af-492b-8706-2e51e6da5fcc\") " pod="openshift-dns/dns-default-lprvh"
Jul 28 16:51:04.524022 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.523888    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbvh2\" (UniqueName: \"kubernetes.io/projected/1f76d1cf-0908-4c40-9d33-50e1b6c85200-kube-api-access-mbvh2\") pod \"insights-runtime-extractor-d9pjq\" (UID: \"1f76d1cf-0908-4c40-9d33-50e1b6c85200\") " pod="openshift-insights/insights-runtime-extractor-d9pjq"
Jul 28 16:51:04.524022 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.523914    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/298a9936-16c8-4817-b4dd-3c5a46b45cb3-cert\") pod \"ingress-canary-zzdwf\" (UID: \"298a9936-16c8-4817-b4dd-3c5a46b45cb3\") " pod="openshift-ingress-canary/ingress-canary-zzdwf"
Jul 28 16:51:04.524022 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.523959    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48dw6\" (UniqueName: \"kubernetes.io/projected/1fb47334-76af-492b-8706-2e51e6da5fcc-kube-api-access-48dw6\") pod \"dns-default-lprvh\" (UID: \"1fb47334-76af-492b-8706-2e51e6da5fcc\") " pod="openshift-dns/dns-default-lprvh"
Jul 28 16:51:04.524022 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.523998    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1f76d1cf-0908-4c40-9d33-50e1b6c85200-data-volume\") pod \"insights-runtime-extractor-d9pjq\" (UID: \"1f76d1cf-0908-4c40-9d33-50e1b6c85200\") " pod="openshift-insights/insights-runtime-extractor-d9pjq"
Jul 28 16:51:04.524022 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.524021    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1fb47334-76af-492b-8706-2e51e6da5fcc-metrics-tls\") pod \"dns-default-lprvh\" (UID: \"1fb47334-76af-492b-8706-2e51e6da5fcc\") " pod="openshift-dns/dns-default-lprvh"
Jul 28 16:51:04.524240 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.524046    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khvn5\" (UniqueName: \"kubernetes.io/projected/298a9936-16c8-4817-b4dd-3c5a46b45cb3-kube-api-access-khvn5\") pod \"ingress-canary-zzdwf\" (UID: \"298a9936-16c8-4817-b4dd-3c5a46b45cb3\") " pod="openshift-ingress-canary/ingress-canary-zzdwf"
Jul 28 16:51:04.625042 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.624981    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1fb47334-76af-492b-8706-2e51e6da5fcc-tmp-dir\") pod \"dns-default-lprvh\" (UID: \"1fb47334-76af-492b-8706-2e51e6da5fcc\") " pod="openshift-dns/dns-default-lprvh"
Jul 28 16:51:04.625042 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.625011    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbvh2\" (UniqueName: \"kubernetes.io/projected/1f76d1cf-0908-4c40-9d33-50e1b6c85200-kube-api-access-mbvh2\") pod \"insights-runtime-extractor-d9pjq\" (UID: \"1f76d1cf-0908-4c40-9d33-50e1b6c85200\") " pod="openshift-insights/insights-runtime-extractor-d9pjq"
Jul 28 16:51:04.625042 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.625028    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/298a9936-16c8-4817-b4dd-3c5a46b45cb3-cert\") pod \"ingress-canary-zzdwf\" (UID: \"298a9936-16c8-4817-b4dd-3c5a46b45cb3\") " pod="openshift-ingress-canary/ingress-canary-zzdwf"
Jul 28 16:51:04.625042 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.625043    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48dw6\" (UniqueName: \"kubernetes.io/projected/1fb47334-76af-492b-8706-2e51e6da5fcc-kube-api-access-48dw6\") pod \"dns-default-lprvh\" (UID: \"1fb47334-76af-492b-8706-2e51e6da5fcc\") " pod="openshift-dns/dns-default-lprvh"
Jul 28 16:51:04.625293 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.625072    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1f76d1cf-0908-4c40-9d33-50e1b6c85200-data-volume\") pod \"insights-runtime-extractor-d9pjq\" (UID: \"1f76d1cf-0908-4c40-9d33-50e1b6c85200\") " pod="openshift-insights/insights-runtime-extractor-d9pjq"
Jul 28 16:51:04.625293 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.625099    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1fb47334-76af-492b-8706-2e51e6da5fcc-metrics-tls\") pod \"dns-default-lprvh\" (UID: \"1fb47334-76af-492b-8706-2e51e6da5fcc\") " pod="openshift-dns/dns-default-lprvh"
Jul 28 16:51:04.625293 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.625124    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khvn5\" (UniqueName: \"kubernetes.io/projected/298a9936-16c8-4817-b4dd-3c5a46b45cb3-kube-api-access-khvn5\") pod \"ingress-canary-zzdwf\" (UID: \"298a9936-16c8-4817-b4dd-3c5a46b45cb3\") " pod="openshift-ingress-canary/ingress-canary-zzdwf"
Jul 28 16:51:04.625293 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.625172    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1f76d1cf-0908-4c40-9d33-50e1b6c85200-crio-socket\") pod \"insights-runtime-extractor-d9pjq\" (UID: \"1f76d1cf-0908-4c40-9d33-50e1b6c85200\") " pod="openshift-insights/insights-runtime-extractor-d9pjq"
Jul 28 16:51:04.625293 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.625206    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1f76d1cf-0908-4c40-9d33-50e1b6c85200-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d9pjq\" (UID: \"1f76d1cf-0908-4c40-9d33-50e1b6c85200\") " pod="openshift-insights/insights-runtime-extractor-d9pjq"
Jul 28 16:51:04.625293 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.625230    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1fb47334-76af-492b-8706-2e51e6da5fcc-config-volume\") pod \"dns-default-lprvh\" (UID: \"1fb47334-76af-492b-8706-2e51e6da5fcc\") " pod="openshift-dns/dns-default-lprvh"
Jul 28 16:51:04.625293 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.625256    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1f76d1cf-0908-4c40-9d33-50e1b6c85200-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d9pjq\" (UID: \"1f76d1cf-0908-4c40-9d33-50e1b6c85200\") " pod="openshift-insights/insights-runtime-extractor-d9pjq"
Jul 28 16:51:04.625293 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.625280    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1f76d1cf-0908-4c40-9d33-50e1b6c85200-crio-socket\") pod \"insights-runtime-extractor-d9pjq\" (UID: \"1f76d1cf-0908-4c40-9d33-50e1b6c85200\") " pod="openshift-insights/insights-runtime-extractor-d9pjq"
Jul 28 16:51:04.625665 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.625406    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1fb47334-76af-492b-8706-2e51e6da5fcc-tmp-dir\") pod \"dns-default-lprvh\" (UID: \"1fb47334-76af-492b-8706-2e51e6da5fcc\") " pod="openshift-dns/dns-default-lprvh"
Jul 28 16:51:04.625665 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.625430    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1f76d1cf-0908-4c40-9d33-50e1b6c85200-data-volume\") pod \"insights-runtime-extractor-d9pjq\" (UID: \"1f76d1cf-0908-4c40-9d33-50e1b6c85200\") " pod="openshift-insights/insights-runtime-extractor-d9pjq"
Jul 28 16:51:04.625875 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.625842    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1fb47334-76af-492b-8706-2e51e6da5fcc-config-volume\") pod \"dns-default-lprvh\" (UID: \"1fb47334-76af-492b-8706-2e51e6da5fcc\") " pod="openshift-dns/dns-default-lprvh"
Jul 28 16:51:04.625993 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.625848    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1f76d1cf-0908-4c40-9d33-50e1b6c85200-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-d9pjq\" (UID: \"1f76d1cf-0908-4c40-9d33-50e1b6c85200\") " pod="openshift-insights/insights-runtime-extractor-d9pjq"
Jul 28 16:51:04.629172 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.629153    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/298a9936-16c8-4817-b4dd-3c5a46b45cb3-cert\") pod \"ingress-canary-zzdwf\" (UID: \"298a9936-16c8-4817-b4dd-3c5a46b45cb3\") " pod="openshift-ingress-canary/ingress-canary-zzdwf"
Jul 28 16:51:04.629247 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.629186    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1fb47334-76af-492b-8706-2e51e6da5fcc-metrics-tls\") pod \"dns-default-lprvh\" (UID: \"1fb47334-76af-492b-8706-2e51e6da5fcc\") " pod="openshift-dns/dns-default-lprvh"
Jul 28 16:51:04.629247 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.629186    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1f76d1cf-0908-4c40-9d33-50e1b6c85200-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-d9pjq\" (UID: \"1f76d1cf-0908-4c40-9d33-50e1b6c85200\") " pod="openshift-insights/insights-runtime-extractor-d9pjq"
Jul 28 16:51:04.630614 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.630595    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:04.635987 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.635971    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48dw6\" (UniqueName: \"kubernetes.io/projected/1fb47334-76af-492b-8706-2e51e6da5fcc-kube-api-access-48dw6\") pod \"dns-default-lprvh\" (UID: \"1fb47334-76af-492b-8706-2e51e6da5fcc\") " pod="openshift-dns/dns-default-lprvh"
Jul 28 16:51:04.636169 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.636152    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbvh2\" (UniqueName: \"kubernetes.io/projected/1f76d1cf-0908-4c40-9d33-50e1b6c85200-kube-api-access-mbvh2\") pod \"insights-runtime-extractor-d9pjq\" (UID: \"1f76d1cf-0908-4c40-9d33-50e1b6c85200\") " pod="openshift-insights/insights-runtime-extractor-d9pjq"
Jul 28 16:51:04.638242 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.638223    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khvn5\" (UniqueName: \"kubernetes.io/projected/298a9936-16c8-4817-b4dd-3c5a46b45cb3-kube-api-access-khvn5\") pod \"ingress-canary-zzdwf\" (UID: \"298a9936-16c8-4817-b4dd-3c5a46b45cb3\") " pod="openshift-ingress-canary/ingress-canary-zzdwf"
Jul 28 16:51:04.729370 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.729338    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-lprvh"
Jul 28 16:51:04.753553 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.753526    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-d9pjq"
Jul 28 16:51:04.769244 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.769221    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-zzdwf"
Jul 28 16:51:04.936793 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.936764    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:04.988392 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:04.988364    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-d9pjq"]
Jul 28 16:51:04.991580 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:51:04.991561    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f76d1cf_0908_4c40_9d33_50e1b6c85200.slice/crio-c1e4e080ecdefd4953175d2a393d6b002d5d0615745a4332e4291a0119a97222 WatchSource:0}: Error finding container c1e4e080ecdefd4953175d2a393d6b002d5d0615745a4332e4291a0119a97222: Status 404 returned error can't find the container with id c1e4e080ecdefd4953175d2a393d6b002d5d0615745a4332e4291a0119a97222
Jul 28 16:51:05.003950 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:05.003912    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:05.070188 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:05.070165    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvtsl"
Jul 28 16:51:05.074174 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:05.073784    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 16:51:05.163430 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:05.163369    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-lprvh"]
Jul 28 16:51:05.166419 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:51:05.166392    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fb47334_76af_492b_8706_2e51e6da5fcc.slice/crio-e0edbba9ee027ea9b98a87dc94c4a146aba81d3e031ee5b847299583b99885f2 WatchSource:0}: Error finding container e0edbba9ee027ea9b98a87dc94c4a146aba81d3e031ee5b847299583b99885f2: Status 404 returned error can't find the container with id e0edbba9ee027ea9b98a87dc94c4a146aba81d3e031ee5b847299583b99885f2
Jul 28 16:51:05.166886 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:05.166868    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-zzdwf"]
Jul 28 16:51:05.169322 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:51:05.169298    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod298a9936_16c8_4817_b4dd_3c5a46b45cb3.slice/crio-7d917bf34d97a93e4ff6dcef728e8cee39e062df0e65528d9819fb56000f75ce WatchSource:0}: Error finding container 7d917bf34d97a93e4ff6dcef728e8cee39e062df0e65528d9819fb56000f75ce: Status 404 returned error can't find the container with id 7d917bf34d97a93e4ff6dcef728e8cee39e062df0e65528d9819fb56000f75ce
Jul 28 16:51:05.369345 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:05.369271    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d9pjq" event={"ID":"1f76d1cf-0908-4c40-9d33-50e1b6c85200","Type":"ContainerStarted","Data":"c1e4e080ecdefd4953175d2a393d6b002d5d0615745a4332e4291a0119a97222"}
Jul 28 16:51:05.370469 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:05.370442    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lprvh" event={"ID":"1fb47334-76af-492b-8706-2e51e6da5fcc","Type":"ContainerStarted","Data":"e0edbba9ee027ea9b98a87dc94c4a146aba81d3e031ee5b847299583b99885f2"}
Jul 28 16:51:05.371483 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:05.371464    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zzdwf" event={"ID":"298a9936-16c8-4817-b4dd-3c5a46b45cb3","Type":"ContainerStarted","Data":"7d917bf34d97a93e4ff6dcef728e8cee39e062df0e65528d9819fb56000f75ce"}
Jul 28 16:51:05.437883 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:05.437827    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:05.537330 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:05.537288    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:05.625530 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:05.625501    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-c8zl6"]
Jul 28 16:51:05.625689 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:05.625497    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:05.640226 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:05.639508    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-c8zl6"
Jul 28 16:51:05.640226 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:05.640007    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-c8zl6"]
Jul 28 16:51:05.645832 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:05.645810    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 28 16:51:05.645964 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:05.645894    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-t97v8\""
Jul 28 16:51:05.733369 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:05.733340    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e177b6cf-d22b-410c-a17e-525d7484a097-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-c8zl6\" (UID: \"e177b6cf-d22b-410c-a17e-525d7484a097\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-c8zl6"
Jul 28 16:51:05.816992 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:05.816962    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:05.834011 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:05.833979    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e177b6cf-d22b-410c-a17e-525d7484a097-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-c8zl6\" (UID: \"e177b6cf-d22b-410c-a17e-525d7484a097\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-c8zl6"
Jul 28 16:51:05.834196 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:51:05.834176    2561 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 28 16:51:05.834305 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:51:05.834294    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e177b6cf-d22b-410c-a17e-525d7484a097-tls-certificates podName:e177b6cf-d22b-410c-a17e-525d7484a097 nodeName:}" failed. No retries permitted until 2026-07-28 16:51:06.334272317 +0000 UTC m=+55.805685969 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/e177b6cf-d22b-410c-a17e-525d7484a097-tls-certificates") pod "prometheus-operator-admission-webhook-7f8d78f54b-c8zl6" (UID: "e177b6cf-d22b-410c-a17e-525d7484a097") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 28 16:51:05.916244 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:05.916216    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:06.070226 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:06.070126    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vn69s"
Jul 28 16:51:06.070597 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:06.070576    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hbfct"
Jul 28 16:51:06.075196 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:06.075167    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 16:51:06.077088 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:06.077017    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bwtfm\""
Jul 28 16:51:06.077334 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:06.077281    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 16:51:06.077488 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:06.077468    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-swxjj\""
Jul 28 16:51:06.077696 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:06.077680    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 16:51:06.274525 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:06.274490    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:06.338612 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:06.338533    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e177b6cf-d22b-410c-a17e-525d7484a097-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-c8zl6\" (UID: \"e177b6cf-d22b-410c-a17e-525d7484a097\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-c8zl6"
Jul 28 16:51:06.342200 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:06.342174    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/e177b6cf-d22b-410c-a17e-525d7484a097-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-c8zl6\" (UID: \"e177b6cf-d22b-410c-a17e-525d7484a097\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-c8zl6"
Jul 28 16:51:06.556303 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:06.556261    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-c8zl6"
Jul 28 16:51:06.759563 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:06.759523    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-c8zl6"]
Jul 28 16:51:06.764351 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:51:06.764326    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode177b6cf_d22b_410c_a17e_525d7484a097.slice/crio-b2fef7c95a91a14dbbbc8dc08693dea1103eb01b57aa248839a2784abfee8871 WatchSource:0}: Error finding container b2fef7c95a91a14dbbbc8dc08693dea1103eb01b57aa248839a2784abfee8871: Status 404 returned error can't find the container with id b2fef7c95a91a14dbbbc8dc08693dea1103eb01b57aa248839a2784abfee8871
Jul 28 16:51:07.378333 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:07.378290    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-c8zl6" event={"ID":"e177b6cf-d22b-410c-a17e-525d7484a097","Type":"ContainerStarted","Data":"b2fef7c95a91a14dbbbc8dc08693dea1103eb01b57aa248839a2784abfee8871"}
Jul 28 16:51:08.511666 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:08.511633    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:08.576073 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:08.576033    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:08.911259 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:08.911134    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:08.983098 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:08.983060    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:09.332434 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:09.332404    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:09.390987 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:09.390951    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:09.946423 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:09.946385    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:10.021353 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:10.021322    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:10.081197 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:10.081172    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:10.899462 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:10.899436    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6456d458d7-kkvpf"]
Jul 28 16:51:10.901445 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:10.901426    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6456d458d7-kkvpf"
Jul 28 16:51:10.904711 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:10.904246    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 28 16:51:10.904711 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:10.904304    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 28 16:51:10.904711 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:10.904323    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 28 16:51:10.904711 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:10.904497    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 28 16:51:10.904711 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:10.904635    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 28 16:51:10.905532 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:10.905510    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 28 16:51:10.905655 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:10.905548    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-c85mn\""
Jul 28 16:51:10.905708 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:10.905660    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 28 16:51:10.910607 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:10.910586    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 28 16:51:10.913590 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:10.913566    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6456d458d7-kkvpf"]
Jul 28 16:51:10.979060 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:10.979029    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1-oauth-serving-cert\") pod \"console-6456d458d7-kkvpf\" (UID: \"708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1\") " pod="openshift-console/console-6456d458d7-kkvpf"
Jul 28 16:51:10.979451 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:10.979069    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1-trusted-ca-bundle\") pod \"console-6456d458d7-kkvpf\" (UID: \"708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1\") " pod="openshift-console/console-6456d458d7-kkvpf"
Jul 28 16:51:10.979451 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:10.979125    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1-service-ca\") pod \"console-6456d458d7-kkvpf\" (UID: \"708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1\") " pod="openshift-console/console-6456d458d7-kkvpf"
Jul 28 16:51:10.979451 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:10.979275    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1-console-oauth-config\") pod \"console-6456d458d7-kkvpf\" (UID: \"708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1\") " pod="openshift-console/console-6456d458d7-kkvpf"
Jul 28 16:51:10.979451 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:10.979310    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1-console-config\") pod \"console-6456d458d7-kkvpf\" (UID: \"708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1\") " pod="openshift-console/console-6456d458d7-kkvpf"
Jul 28 16:51:10.979451 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:10.979342    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1-console-serving-cert\") pod \"console-6456d458d7-kkvpf\" (UID: \"708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1\") " pod="openshift-console/console-6456d458d7-kkvpf"
Jul 28 16:51:10.979451 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:10.979368    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv7r7\" (UniqueName: \"kubernetes.io/projected/708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1-kube-api-access-vv7r7\") pod \"console-6456d458d7-kkvpf\" (UID: \"708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1\") " pod="openshift-console/console-6456d458d7-kkvpf"
Jul 28 16:51:11.080406 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:11.080380    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1-console-serving-cert\") pod \"console-6456d458d7-kkvpf\" (UID: \"708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1\") " pod="openshift-console/console-6456d458d7-kkvpf"
Jul 28 16:51:11.080490 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:11.080435    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vv7r7\" (UniqueName: \"kubernetes.io/projected/708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1-kube-api-access-vv7r7\") pod \"console-6456d458d7-kkvpf\" (UID: \"708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1\") " pod="openshift-console/console-6456d458d7-kkvpf"
Jul 28 16:51:11.080490 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:11.080474    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1-oauth-serving-cert\") pod \"console-6456d458d7-kkvpf\" (UID: \"708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1\") " pod="openshift-console/console-6456d458d7-kkvpf"
Jul 28 16:51:11.080585 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:11.080499    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1-trusted-ca-bundle\") pod \"console-6456d458d7-kkvpf\" (UID: \"708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1\") " pod="openshift-console/console-6456d458d7-kkvpf"
Jul 28 16:51:11.080585 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:11.080570    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1-service-ca\") pod \"console-6456d458d7-kkvpf\" (UID: \"708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1\") " pod="openshift-console/console-6456d458d7-kkvpf"
Jul 28 16:51:11.080670 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:11.080641    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1-console-oauth-config\") pod \"console-6456d458d7-kkvpf\" (UID: \"708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1\") " pod="openshift-console/console-6456d458d7-kkvpf"
Jul 28 16:51:11.080670 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:11.080664    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1-console-config\") pod \"console-6456d458d7-kkvpf\" (UID: \"708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1\") " pod="openshift-console/console-6456d458d7-kkvpf"
Jul 28 16:51:11.081757 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:11.081470    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1-console-config\") pod \"console-6456d458d7-kkvpf\" (UID: \"708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1\") " pod="openshift-console/console-6456d458d7-kkvpf"
Jul 28 16:51:11.081757 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:11.081490    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1-service-ca\") pod \"console-6456d458d7-kkvpf\" (UID: \"708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1\") " pod="openshift-console/console-6456d458d7-kkvpf"
Jul 28 16:51:11.081757 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:11.081718    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1-trusted-ca-bundle\") pod \"console-6456d458d7-kkvpf\" (UID: \"708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1\") " pod="openshift-console/console-6456d458d7-kkvpf"
Jul 28 16:51:11.082282 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:11.082256    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1-oauth-serving-cert\") pod \"console-6456d458d7-kkvpf\" (UID: \"708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1\") " pod="openshift-console/console-6456d458d7-kkvpf"
Jul 28 16:51:11.084115 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:11.084090    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1-console-oauth-config\") pod \"console-6456d458d7-kkvpf\" (UID: \"708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1\") " pod="openshift-console/console-6456d458d7-kkvpf"
Jul 28 16:51:11.084738 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:11.084716    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1-console-serving-cert\") pod \"console-6456d458d7-kkvpf\" (UID: \"708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1\") " pod="openshift-console/console-6456d458d7-kkvpf"
Jul 28 16:51:11.089886 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:11.089864    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv7r7\" (UniqueName: \"kubernetes.io/projected/708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1-kube-api-access-vv7r7\") pod \"console-6456d458d7-kkvpf\" (UID: \"708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1\") " pod="openshift-console/console-6456d458d7-kkvpf"
Jul 28 16:51:11.213321 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:11.213160    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6456d458d7-kkvpf"
Jul 28 16:51:11.350716 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:11.350680    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6456d458d7-kkvpf"]
Jul 28 16:51:11.353801 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:51:11.353771    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod708ed4ad_c0ab_4c2e_957f_6641e0b5c2e1.slice/crio-04ac7ea2ee9a1b9d0b0292be0472e66c5a64d8d8cd794eeb8514a6c044f5e43f WatchSource:0}: Error finding container 04ac7ea2ee9a1b9d0b0292be0472e66c5a64d8d8cd794eeb8514a6c044f5e43f: Status 404 returned error can't find the container with id 04ac7ea2ee9a1b9d0b0292be0472e66c5a64d8d8cd794eeb8514a6c044f5e43f
Jul 28 16:51:11.389911 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:11.389888    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-zzdwf" event={"ID":"298a9936-16c8-4817-b4dd-3c5a46b45cb3","Type":"ContainerStarted","Data":"5e5806d275b872e975523863e3e59c2917a864519ce13a424221021ce48ffe15"}
Jul 28 16:51:11.391287 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:11.391267    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d9pjq" event={"ID":"1f76d1cf-0908-4c40-9d33-50e1b6c85200","Type":"ContainerStarted","Data":"9c925d0882ba9ece9df6e1a5786d353652f282d5f1380caed5bcd8d10c04f58d"}
Jul 28 16:51:11.392611 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:11.392591    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-c8zl6" event={"ID":"e177b6cf-d22b-410c-a17e-525d7484a097","Type":"ContainerStarted","Data":"180c4ccfd0f9c3f6aec43777a06f961bca80c31057d04e48bea6daae4f0d0ece"}
Jul 28 16:51:11.392726 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:11.392705    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-c8zl6"
Jul 28 16:51:11.393908 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:11.393876    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6456d458d7-kkvpf" event={"ID":"708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1","Type":"ContainerStarted","Data":"04ac7ea2ee9a1b9d0b0292be0472e66c5a64d8d8cd794eeb8514a6c044f5e43f"}
Jul 28 16:51:11.395719 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:11.395698    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lprvh" event={"ID":"1fb47334-76af-492b-8706-2e51e6da5fcc","Type":"ContainerStarted","Data":"cc8f4c06f313be3f9fee6c1e1ba397a74454777f0a99ec8b639e64a49e5c3f49"}
Jul 28 16:51:11.395811 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:11.395739    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-lprvh" event={"ID":"1fb47334-76af-492b-8706-2e51e6da5fcc","Type":"ContainerStarted","Data":"c00d271c056d36081fb14ae54967c3ea4d4c16dffb304e8dc063b22c53aac349"}
Jul 28 16:51:11.395867 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:11.395842    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-lprvh"
Jul 28 16:51:11.397645 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:11.397631    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-c8zl6"
Jul 28 16:51:11.407473 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:11.407438    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-zzdwf" podStartSLOduration=1.789350993 podStartE2EDuration="7.407426616s" totalImagesPullingTime="5.618075623s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:51:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:51:11.406651627 +0000 UTC m=+60.878065294" watchObservedRunningTime="2026-07-28 16:51:11.407426616 +0000 UTC m=+60.878840295"
Jul 28 16:51:11.422822 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:11.422783    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-c8zl6" podStartSLOduration=2.111022209 podStartE2EDuration="6.422769345s" totalImagesPullingTime="4.311747136s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:51:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:51:11.422358812 +0000 UTC m=+60.893772473" watchObservedRunningTime="2026-07-28 16:51:11.422769345 +0000 UTC m=+60.894183004"
Jul 28 16:51:11.440245 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:11.440206    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-lprvh" podStartSLOduration=1.820460475 podStartE2EDuration="7.440193653s" totalImagesPullingTime="5.619733178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:51:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:51:11.439549802 +0000 UTC m=+60.910963463" watchObservedRunningTime="2026-07-28 16:51:11.440193653 +0000 UTC m=+60.911607312"
Jul 28 16:51:11.649585 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:11.649509    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:11.712190 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:11.712162    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:11.913853 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:11.913774    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:12.326101 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:12.326071    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-7st4p"
Jul 28 16:51:12.444467 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:12.444439    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:12.546643 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:12.546612    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:12.607458 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:12.607374    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:14.006407 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:14.006377    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:16.118165 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:16.118142    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:16.222087 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:16.222055    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:16.414459 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:16.414379    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d9pjq" event={"ID":"1f76d1cf-0908-4c40-9d33-50e1b6c85200","Type":"ContainerStarted","Data":"4715039273ad73a5d3535a7dc8b13f4d3cbef443e9641ad0451cdae352d412de"}
Jul 28 16:51:16.415854 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:16.415830    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6456d458d7-kkvpf" event={"ID":"708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1","Type":"ContainerStarted","Data":"295c0ae8f0565dccbd734d3596bde2ee4c2e22ed4797ffd50b4dbce815081c22"}
Jul 28 16:51:16.448905 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:16.448861    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6456d458d7-kkvpf" podStartSLOduration=1.7370791429999999 podStartE2EDuration="6.448849311s" totalImagesPullingTime="4.711770168s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:51:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:51:16.448268354 +0000 UTC m=+65.919682013" watchObservedRunningTime="2026-07-28 16:51:16.448849311 +0000 UTC m=+65.920262970"
Jul 28 16:51:16.727644 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:16.727608    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab2695e6-884f-4726-ba45-fe2772ee69a8-metrics-certs\") pod \"network-metrics-daemon-vn69s\" (UID: \"ab2695e6-884f-4726-ba45-fe2772ee69a8\") " pod="openshift-multus/network-metrics-daemon-vn69s"
Jul 28 16:51:16.730666 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:16.730641    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 16:51:16.740846 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:16.740811    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab2695e6-884f-4726-ba45-fe2772ee69a8-metrics-certs\") pod \"network-metrics-daemon-vn69s\" (UID: \"ab2695e6-884f-4726-ba45-fe2772ee69a8\") " pod="openshift-multus/network-metrics-daemon-vn69s"
Jul 28 16:51:16.828562 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:16.828534    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a7043cc-b151-4888-90cc-f3dae8a2a91d-original-pull-secret\") pod \"global-pull-secret-syncer-fvtsl\" (UID: \"9a7043cc-b151-4888-90cc-f3dae8a2a91d\") " pod="kube-system/global-pull-secret-syncer-fvtsl"
Jul 28 16:51:16.833242 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:16.833223    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 16:51:16.841670 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:16.841636    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9a7043cc-b151-4888-90cc-f3dae8a2a91d-original-pull-secret\") pod \"global-pull-secret-syncer-fvtsl\" (UID: \"9a7043cc-b151-4888-90cc-f3dae8a2a91d\") " pod="kube-system/global-pull-secret-syncer-fvtsl"
Jul 28 16:51:16.891009 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:16.890986    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bwtfm\""
Jul 28 16:51:16.898666 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:16.898639    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-vn69s"
Jul 28 16:51:16.929275 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:16.929242    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trqt6\" (UniqueName: \"kubernetes.io/projected/7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee-kube-api-access-trqt6\") pod \"network-check-target-hbfct\" (UID: \"7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee\") " pod="openshift-network-diagnostics/network-check-target-hbfct"
Jul 28 16:51:16.932502 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:16.932481    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 16:51:16.942825 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:16.942805    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 16:51:16.955638 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:16.955590    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trqt6\" (UniqueName: \"kubernetes.io/projected/7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee-kube-api-access-trqt6\") pod \"network-check-target-hbfct\" (UID: \"7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee\") " pod="openshift-network-diagnostics/network-check-target-hbfct"
Jul 28 16:51:16.986782 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:16.986753    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:17.057101 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:17.057066    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-vn69s"]
Jul 28 16:51:17.060365 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:51:17.060341    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab2695e6_884f_4726_ba45_fe2772ee69a8.slice/crio-49ad952862a95bacb3bbfa39d6a0764251483016b7cba7c58ec3b39b6de25526 WatchSource:0}: Error finding container 49ad952862a95bacb3bbfa39d6a0764251483016b7cba7c58ec3b39b6de25526: Status 404 returned error can't find the container with id 49ad952862a95bacb3bbfa39d6a0764251483016b7cba7c58ec3b39b6de25526
Jul 28 16:51:17.068184 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:17.068137    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:17.082785 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:17.082759    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fvtsl"
Jul 28 16:51:17.202365 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:17.202338    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-swxjj\""
Jul 28 16:51:17.209978 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:17.209950    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hbfct"
Jul 28 16:51:17.225400 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:17.225377    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fvtsl"]
Jul 28 16:51:17.227996 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:51:17.227968    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a7043cc_b151_4888_90cc_f3dae8a2a91d.slice/crio-4d0d8aa937db281752d6a5e9cc245efb44009c706903801895d30ef3daf2b259 WatchSource:0}: Error finding container 4d0d8aa937db281752d6a5e9cc245efb44009c706903801895d30ef3daf2b259: Status 404 returned error can't find the container with id 4d0d8aa937db281752d6a5e9cc245efb44009c706903801895d30ef3daf2b259
Jul 28 16:51:17.359321 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:17.359288    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hbfct"]
Jul 28 16:51:17.364363 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:51:17.364333    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d6d1fea_9980_41ab_a88b_eb0b04e4d8ee.slice/crio-e7e8f499a8679c0183f54ce01f5704729b3c8616f17671d08e9a49fd6dda42f8 WatchSource:0}: Error finding container e7e8f499a8679c0183f54ce01f5704729b3c8616f17671d08e9a49fd6dda42f8: Status 404 returned error can't find the container with id e7e8f499a8679c0183f54ce01f5704729b3c8616f17671d08e9a49fd6dda42f8
Jul 28 16:51:17.421800 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:17.421753    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fvtsl" event={"ID":"9a7043cc-b151-4888-90cc-f3dae8a2a91d","Type":"ContainerStarted","Data":"4d0d8aa937db281752d6a5e9cc245efb44009c706903801895d30ef3daf2b259"}
Jul 28 16:51:17.423740 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:17.423711    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hbfct" event={"ID":"7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee","Type":"ContainerStarted","Data":"e7e8f499a8679c0183f54ce01f5704729b3c8616f17671d08e9a49fd6dda42f8"}
Jul 28 16:51:17.424837 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:17.424811    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vn69s" event={"ID":"ab2695e6-884f-4726-ba45-fe2772ee69a8","Type":"ContainerStarted","Data":"49ad952862a95bacb3bbfa39d6a0764251483016b7cba7c58ec3b39b6de25526"}
Jul 28 16:51:17.804336 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:17.804280    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:17.990654 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:17.990616    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:18.103772 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.103698    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-nwwnm"]
Jul 28 16:51:18.106494 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.106463    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:18.108248 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.108228    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nwwnm"
Jul 28 16:51:18.111396 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.111212    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 28 16:51:18.111396 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.111348    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 28 16:51:18.113447 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.112627    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 28 16:51:18.113447 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.112878    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 28 16:51:18.113447 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.113093    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-k6vkf\""
Jul 28 16:51:18.113447 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.113304    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 28 16:51:18.133050 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.132724    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-nwwnm"]
Jul 28 16:51:18.162794 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.160255    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fkj9s"]
Jul 28 16:51:18.165727 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.165704    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-mj2cg"]
Jul 28 16:51:18.166048 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.165999    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fkj9s"
Jul 28 16:51:18.168896 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.168877    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mj2cg"
Jul 28 16:51:18.169379 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.169360    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 28 16:51:18.169502 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.169489    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 28 16:51:18.169664 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.169650    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-czn9q\""
Jul 28 16:51:18.169831 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.169817    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 28 16:51:18.173354 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.173334    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 28 16:51:18.173672 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.173656    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 28 16:51:18.173926 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.173864    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-dbntf\""
Jul 28 16:51:18.174342 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.174104    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 28 16:51:18.179575 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.179554    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-mj2cg"]
Jul 28 16:51:18.198332 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.198226    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:18.240715 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.240684    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f00acafc-07e7-44e5-adf0-e27090651d24-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-nwwnm\" (UID: \"f00acafc-07e7-44e5-adf0-e27090651d24\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nwwnm"
Jul 28 16:51:18.241127 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.240723    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gp58\" (UniqueName: \"kubernetes.io/projected/6cd2b8dd-9699-463c-94f4-1ac4a58f480c-kube-api-access-6gp58\") pod \"node-exporter-fkj9s\" (UID: \"6cd2b8dd-9699-463c-94f4-1ac4a58f480c\") " pod="openshift-monitoring/node-exporter-fkj9s"
Jul 28 16:51:18.241127 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.240755    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6cd2b8dd-9699-463c-94f4-1ac4a58f480c-node-exporter-tls\") pod \"node-exporter-fkj9s\" (UID: \"6cd2b8dd-9699-463c-94f4-1ac4a58f480c\") " pod="openshift-monitoring/node-exporter-fkj9s"
Jul 28 16:51:18.241127 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.240783    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/113011e3-c1ad-40f8-b250-0ffb6826e4f9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-mj2cg\" (UID: \"113011e3-c1ad-40f8-b250-0ffb6826e4f9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mj2cg"
Jul 28 16:51:18.241127 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.240814    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f00acafc-07e7-44e5-adf0-e27090651d24-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-nwwnm\" (UID: \"f00acafc-07e7-44e5-adf0-e27090651d24\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nwwnm"
Jul 28 16:51:18.241127 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.240839    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/113011e3-c1ad-40f8-b250-0ffb6826e4f9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-mj2cg\" (UID: \"113011e3-c1ad-40f8-b250-0ffb6826e4f9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mj2cg"
Jul 28 16:51:18.241127 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.240867    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trvwt\" (UniqueName: \"kubernetes.io/projected/113011e3-c1ad-40f8-b250-0ffb6826e4f9-kube-api-access-trvwt\") pod \"kube-state-metrics-56d9f944b4-mj2cg\" (UID: \"113011e3-c1ad-40f8-b250-0ffb6826e4f9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mj2cg"
Jul 28 16:51:18.241127 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.240920    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/113011e3-c1ad-40f8-b250-0ffb6826e4f9-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-mj2cg\" (UID: \"113011e3-c1ad-40f8-b250-0ffb6826e4f9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mj2cg"
Jul 28 16:51:18.241127 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.240985    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/113011e3-c1ad-40f8-b250-0ffb6826e4f9-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-mj2cg\" (UID: \"113011e3-c1ad-40f8-b250-0ffb6826e4f9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mj2cg"
Jul 28 16:51:18.241127 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.241067    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj7wt\" (UniqueName: \"kubernetes.io/projected/f00acafc-07e7-44e5-adf0-e27090651d24-kube-api-access-jj7wt\") pod \"openshift-state-metrics-b8f49f5c6-nwwnm\" (UID: \"f00acafc-07e7-44e5-adf0-e27090651d24\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nwwnm"
Jul 28 16:51:18.241127 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.241091    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6cd2b8dd-9699-463c-94f4-1ac4a58f480c-root\") pod \"node-exporter-fkj9s\" (UID: \"6cd2b8dd-9699-463c-94f4-1ac4a58f480c\") " pod="openshift-monitoring/node-exporter-fkj9s"
Jul 28 16:51:18.241127 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.241117    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6cd2b8dd-9699-463c-94f4-1ac4a58f480c-node-exporter-textfile\") pod \"node-exporter-fkj9s\" (UID: \"6cd2b8dd-9699-463c-94f4-1ac4a58f480c\") " pod="openshift-monitoring/node-exporter-fkj9s"
Jul 28 16:51:18.241567 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.241181    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f00acafc-07e7-44e5-adf0-e27090651d24-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-nwwnm\" (UID: \"f00acafc-07e7-44e5-adf0-e27090651d24\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nwwnm"
Jul 28 16:51:18.241567 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.241237    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/113011e3-c1ad-40f8-b250-0ffb6826e4f9-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-mj2cg\" (UID: \"113011e3-c1ad-40f8-b250-0ffb6826e4f9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mj2cg"
Jul 28 16:51:18.241567 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.241257    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6cd2b8dd-9699-463c-94f4-1ac4a58f480c-metrics-client-ca\") pod \"node-exporter-fkj9s\" (UID: \"6cd2b8dd-9699-463c-94f4-1ac4a58f480c\") " pod="openshift-monitoring/node-exporter-fkj9s"
Jul 28 16:51:18.241567 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.241324    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6cd2b8dd-9699-463c-94f4-1ac4a58f480c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fkj9s\" (UID: \"6cd2b8dd-9699-463c-94f4-1ac4a58f480c\") " pod="openshift-monitoring/node-exporter-fkj9s"
Jul 28 16:51:18.241567 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.241340    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6cd2b8dd-9699-463c-94f4-1ac4a58f480c-node-exporter-accelerators-collector-config\") pod \"node-exporter-fkj9s\" (UID: \"6cd2b8dd-9699-463c-94f4-1ac4a58f480c\") " pod="openshift-monitoring/node-exporter-fkj9s"
Jul 28 16:51:18.241567 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.241357    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6cd2b8dd-9699-463c-94f4-1ac4a58f480c-sys\") pod \"node-exporter-fkj9s\" (UID: \"6cd2b8dd-9699-463c-94f4-1ac4a58f480c\") " pod="openshift-monitoring/node-exporter-fkj9s"
Jul 28 16:51:18.241567 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.241385    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6cd2b8dd-9699-463c-94f4-1ac4a58f480c-node-exporter-wtmp\") pod \"node-exporter-fkj9s\" (UID: \"6cd2b8dd-9699-463c-94f4-1ac4a58f480c\") " pod="openshift-monitoring/node-exporter-fkj9s"
Jul 28 16:51:18.276383 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.276339    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:18.345807 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.342632    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6cd2b8dd-9699-463c-94f4-1ac4a58f480c-node-exporter-tls\") pod \"node-exporter-fkj9s\" (UID: \"6cd2b8dd-9699-463c-94f4-1ac4a58f480c\") " pod="openshift-monitoring/node-exporter-fkj9s"
Jul 28 16:51:18.345807 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.342684    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/113011e3-c1ad-40f8-b250-0ffb6826e4f9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-mj2cg\" (UID: \"113011e3-c1ad-40f8-b250-0ffb6826e4f9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mj2cg"
Jul 28 16:51:18.345807 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.342720    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f00acafc-07e7-44e5-adf0-e27090651d24-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-nwwnm\" (UID: \"f00acafc-07e7-44e5-adf0-e27090651d24\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nwwnm"
Jul 28 16:51:18.345807 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.342745    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/113011e3-c1ad-40f8-b250-0ffb6826e4f9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-mj2cg\" (UID: \"113011e3-c1ad-40f8-b250-0ffb6826e4f9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mj2cg"
Jul 28 16:51:18.345807 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.342773    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trvwt\" (UniqueName: \"kubernetes.io/projected/113011e3-c1ad-40f8-b250-0ffb6826e4f9-kube-api-access-trvwt\") pod \"kube-state-metrics-56d9f944b4-mj2cg\" (UID: \"113011e3-c1ad-40f8-b250-0ffb6826e4f9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mj2cg"
Jul 28 16:51:18.345807 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.342813    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/113011e3-c1ad-40f8-b250-0ffb6826e4f9-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-mj2cg\" (UID: \"113011e3-c1ad-40f8-b250-0ffb6826e4f9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mj2cg"
Jul 28 16:51:18.345807 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.342848    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/113011e3-c1ad-40f8-b250-0ffb6826e4f9-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-mj2cg\" (UID: \"113011e3-c1ad-40f8-b250-0ffb6826e4f9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mj2cg"
Jul 28 16:51:18.345807 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.342881    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj7wt\" (UniqueName: \"kubernetes.io/projected/f00acafc-07e7-44e5-adf0-e27090651d24-kube-api-access-jj7wt\") pod \"openshift-state-metrics-b8f49f5c6-nwwnm\" (UID: \"f00acafc-07e7-44e5-adf0-e27090651d24\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nwwnm"
Jul 28 16:51:18.345807 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.342908    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6cd2b8dd-9699-463c-94f4-1ac4a58f480c-root\") pod \"node-exporter-fkj9s\" (UID: \"6cd2b8dd-9699-463c-94f4-1ac4a58f480c\") " pod="openshift-monitoring/node-exporter-fkj9s"
Jul 28 16:51:18.345807 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.342949    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6cd2b8dd-9699-463c-94f4-1ac4a58f480c-node-exporter-textfile\") pod \"node-exporter-fkj9s\" (UID: \"6cd2b8dd-9699-463c-94f4-1ac4a58f480c\") " pod="openshift-monitoring/node-exporter-fkj9s"
Jul 28 16:51:18.345807 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.342986    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f00acafc-07e7-44e5-adf0-e27090651d24-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-nwwnm\" (UID: \"f00acafc-07e7-44e5-adf0-e27090651d24\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nwwnm"
Jul 28 16:51:18.345807 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.343010    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/113011e3-c1ad-40f8-b250-0ffb6826e4f9-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-mj2cg\" (UID: \"113011e3-c1ad-40f8-b250-0ffb6826e4f9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mj2cg"
Jul 28 16:51:18.345807 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.343039    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6cd2b8dd-9699-463c-94f4-1ac4a58f480c-metrics-client-ca\") pod \"node-exporter-fkj9s\" (UID: \"6cd2b8dd-9699-463c-94f4-1ac4a58f480c\") " pod="openshift-monitoring/node-exporter-fkj9s"
Jul 28 16:51:18.345807 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.343069    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6cd2b8dd-9699-463c-94f4-1ac4a58f480c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fkj9s\" (UID: \"6cd2b8dd-9699-463c-94f4-1ac4a58f480c\") " pod="openshift-monitoring/node-exporter-fkj9s"
Jul 28 16:51:18.345807 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.343094    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6cd2b8dd-9699-463c-94f4-1ac4a58f480c-node-exporter-accelerators-collector-config\") pod \"node-exporter-fkj9s\" (UID: \"6cd2b8dd-9699-463c-94f4-1ac4a58f480c\") " pod="openshift-monitoring/node-exporter-fkj9s"
Jul 28 16:51:18.345807 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.343140    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6cd2b8dd-9699-463c-94f4-1ac4a58f480c-sys\") pod \"node-exporter-fkj9s\" (UID: \"6cd2b8dd-9699-463c-94f4-1ac4a58f480c\") " pod="openshift-monitoring/node-exporter-fkj9s"
Jul 28 16:51:18.346737 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.343168    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6cd2b8dd-9699-463c-94f4-1ac4a58f480c-node-exporter-wtmp\") pod \"node-exporter-fkj9s\" (UID: \"6cd2b8dd-9699-463c-94f4-1ac4a58f480c\") " pod="openshift-monitoring/node-exporter-fkj9s"
Jul 28 16:51:18.346737 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.343205    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f00acafc-07e7-44e5-adf0-e27090651d24-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-nwwnm\" (UID: \"f00acafc-07e7-44e5-adf0-e27090651d24\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nwwnm"
Jul 28 16:51:18.346737 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.343231    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gp58\" (UniqueName: \"kubernetes.io/projected/6cd2b8dd-9699-463c-94f4-1ac4a58f480c-kube-api-access-6gp58\") pod \"node-exporter-fkj9s\" (UID: \"6cd2b8dd-9699-463c-94f4-1ac4a58f480c\") " pod="openshift-monitoring/node-exporter-fkj9s"
Jul 28 16:51:18.346737 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.344223    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6cd2b8dd-9699-463c-94f4-1ac4a58f480c-node-exporter-textfile\") pod \"node-exporter-fkj9s\" (UID: \"6cd2b8dd-9699-463c-94f4-1ac4a58f480c\") " pod="openshift-monitoring/node-exporter-fkj9s"
Jul 28 16:51:18.346737 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.344867    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/113011e3-c1ad-40f8-b250-0ffb6826e4f9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-mj2cg\" (UID: \"113011e3-c1ad-40f8-b250-0ffb6826e4f9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mj2cg"
Jul 28 16:51:18.346737 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.345496    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f00acafc-07e7-44e5-adf0-e27090651d24-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-nwwnm\" (UID: \"f00acafc-07e7-44e5-adf0-e27090651d24\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nwwnm"
Jul 28 16:51:18.347609 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.347586    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/113011e3-c1ad-40f8-b250-0ffb6826e4f9-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-mj2cg\" (UID: \"113011e3-c1ad-40f8-b250-0ffb6826e4f9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mj2cg"
Jul 28 16:51:18.347703 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.347608    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/113011e3-c1ad-40f8-b250-0ffb6826e4f9-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-mj2cg\" (UID: \"113011e3-c1ad-40f8-b250-0ffb6826e4f9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mj2cg"
Jul 28 16:51:18.348476 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.348424    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6cd2b8dd-9699-463c-94f4-1ac4a58f480c-node-exporter-accelerators-collector-config\") pod \"node-exporter-fkj9s\" (UID: \"6cd2b8dd-9699-463c-94f4-1ac4a58f480c\") " pod="openshift-monitoring/node-exporter-fkj9s"
Jul 28 16:51:18.348572 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.348502    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6cd2b8dd-9699-463c-94f4-1ac4a58f480c-root\") pod \"node-exporter-fkj9s\" (UID: \"6cd2b8dd-9699-463c-94f4-1ac4a58f480c\") " pod="openshift-monitoring/node-exporter-fkj9s"
Jul 28 16:51:18.348950 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.348913    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6cd2b8dd-9699-463c-94f4-1ac4a58f480c-metrics-client-ca\") pod \"node-exporter-fkj9s\" (UID: \"6cd2b8dd-9699-463c-94f4-1ac4a58f480c\") " pod="openshift-monitoring/node-exporter-fkj9s"
Jul 28 16:51:18.349037 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.348998    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6cd2b8dd-9699-463c-94f4-1ac4a58f480c-sys\") pod \"node-exporter-fkj9s\" (UID: \"6cd2b8dd-9699-463c-94f4-1ac4a58f480c\") " pod="openshift-monitoring/node-exporter-fkj9s"
Jul 28 16:51:18.349095 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.349079    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6cd2b8dd-9699-463c-94f4-1ac4a58f480c-node-exporter-wtmp\") pod \"node-exporter-fkj9s\" (UID: \"6cd2b8dd-9699-463c-94f4-1ac4a58f480c\") " pod="openshift-monitoring/node-exporter-fkj9s"
Jul 28 16:51:18.350075 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.350037    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6cd2b8dd-9699-463c-94f4-1ac4a58f480c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fkj9s\" (UID: \"6cd2b8dd-9699-463c-94f4-1ac4a58f480c\") " pod="openshift-monitoring/node-exporter-fkj9s"
Jul 28 16:51:18.351038 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.350818    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/113011e3-c1ad-40f8-b250-0ffb6826e4f9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-mj2cg\" (UID: \"113011e3-c1ad-40f8-b250-0ffb6826e4f9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mj2cg"
Jul 28 16:51:18.351038 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.350999    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6cd2b8dd-9699-463c-94f4-1ac4a58f480c-node-exporter-tls\") pod \"node-exporter-fkj9s\" (UID: \"6cd2b8dd-9699-463c-94f4-1ac4a58f480c\") " pod="openshift-monitoring/node-exporter-fkj9s"
Jul 28 16:51:18.352307 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.352263    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f00acafc-07e7-44e5-adf0-e27090651d24-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-nwwnm\" (UID: \"f00acafc-07e7-44e5-adf0-e27090651d24\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nwwnm"
Jul 28 16:51:18.353574 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.353515    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f00acafc-07e7-44e5-adf0-e27090651d24-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-nwwnm\" (UID: \"f00acafc-07e7-44e5-adf0-e27090651d24\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nwwnm"
Jul 28 16:51:18.354162 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.354115    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gp58\" (UniqueName: \"kubernetes.io/projected/6cd2b8dd-9699-463c-94f4-1ac4a58f480c-kube-api-access-6gp58\") pod \"node-exporter-fkj9s\" (UID: \"6cd2b8dd-9699-463c-94f4-1ac4a58f480c\") " pod="openshift-monitoring/node-exporter-fkj9s"
Jul 28 16:51:18.355804 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.355317    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/113011e3-c1ad-40f8-b250-0ffb6826e4f9-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-mj2cg\" (UID: \"113011e3-c1ad-40f8-b250-0ffb6826e4f9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mj2cg"
Jul 28 16:51:18.357642 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.357590    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trvwt\" (UniqueName: \"kubernetes.io/projected/113011e3-c1ad-40f8-b250-0ffb6826e4f9-kube-api-access-trvwt\") pod \"kube-state-metrics-56d9f944b4-mj2cg\" (UID: \"113011e3-c1ad-40f8-b250-0ffb6826e4f9\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mj2cg"
Jul 28 16:51:18.358344 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.358321    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj7wt\" (UniqueName: \"kubernetes.io/projected/f00acafc-07e7-44e5-adf0-e27090651d24-kube-api-access-jj7wt\") pod \"openshift-state-metrics-b8f49f5c6-nwwnm\" (UID: \"f00acafc-07e7-44e5-adf0-e27090651d24\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nwwnm"
Jul 28 16:51:18.373513 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.373425    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:18.421325 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.421290    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nwwnm"
Jul 28 16:51:18.472631 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.472591    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:18.480386 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.480172    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fkj9s"
Jul 28 16:51:18.486672 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.486487    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mj2cg"
Jul 28 16:51:18.593063 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.592984    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:18.819573 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:18.819545    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:19.049793 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:19.049758    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:19.150357 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:19.150269    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:19.353511 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:19.353474    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:21.003384 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:21.003344    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:21.057108 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:21.057076    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6d8df69445-swr4n"]
Jul 28 16:51:21.060389 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:21.060368    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6d8df69445-swr4n"
Jul 28 16:51:21.063852 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:21.063507    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 28 16:51:21.063852 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:21.063597    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 28 16:51:21.063852 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:21.063622    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 28 16:51:21.063852 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:21.063640    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-b0r6559jtao67\""
Jul 28 16:51:21.063852 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:21.063669    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-cf6kv\""
Jul 28 16:51:21.063852 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:21.063768    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 28 16:51:21.063852 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:21.063786    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 28 16:51:21.074247 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:21.074229    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6d8df69445-swr4n"]
Jul 28 16:51:21.077049 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:21.077009    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:21.163157 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:21.163118    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec22f019-b5ce-4072-92f0-c2ddde44342d-metrics-client-ca\") pod \"thanos-querier-6d8df69445-swr4n\" (UID: \"ec22f019-b5ce-4072-92f0-c2ddde44342d\") " pod="openshift-monitoring/thanos-querier-6d8df69445-swr4n"
Jul 28 16:51:21.163303 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:21.163168    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ec22f019-b5ce-4072-92f0-c2ddde44342d-secret-thanos-querier-tls\") pod \"thanos-querier-6d8df69445-swr4n\" (UID: \"ec22f019-b5ce-4072-92f0-c2ddde44342d\") " pod="openshift-monitoring/thanos-querier-6d8df69445-swr4n"
Jul 28 16:51:21.163303 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:21.163198    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ec22f019-b5ce-4072-92f0-c2ddde44342d-secret-grpc-tls\") pod \"thanos-querier-6d8df69445-swr4n\" (UID: \"ec22f019-b5ce-4072-92f0-c2ddde44342d\") " pod="openshift-monitoring/thanos-querier-6d8df69445-swr4n"
Jul 28 16:51:21.163303 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:21.163238    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ec22f019-b5ce-4072-92f0-c2ddde44342d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6d8df69445-swr4n\" (UID: \"ec22f019-b5ce-4072-92f0-c2ddde44342d\") " pod="openshift-monitoring/thanos-querier-6d8df69445-swr4n"
Jul 28 16:51:21.163303 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:21.163273    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgz7d\" (UniqueName: \"kubernetes.io/projected/ec22f019-b5ce-4072-92f0-c2ddde44342d-kube-api-access-rgz7d\") pod \"thanos-querier-6d8df69445-swr4n\" (UID: \"ec22f019-b5ce-4072-92f0-c2ddde44342d\") " pod="openshift-monitoring/thanos-querier-6d8df69445-swr4n"
Jul 28 16:51:21.163525 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:21.163347    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ec22f019-b5ce-4072-92f0-c2ddde44342d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6d8df69445-swr4n\" (UID: \"ec22f019-b5ce-4072-92f0-c2ddde44342d\") " pod="openshift-monitoring/thanos-querier-6d8df69445-swr4n"
Jul 28 16:51:21.163525 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:21.163420    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec22f019-b5ce-4072-92f0-c2ddde44342d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6d8df69445-swr4n\" (UID: \"ec22f019-b5ce-4072-92f0-c2ddde44342d\") " pod="openshift-monitoring/thanos-querier-6d8df69445-swr4n"
Jul 28 16:51:21.163525 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:21.163456    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec22f019-b5ce-4072-92f0-c2ddde44342d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6d8df69445-swr4n\" (UID: \"ec22f019-b5ce-4072-92f0-c2ddde44342d\") " pod="openshift-monitoring/thanos-querier-6d8df69445-swr4n"
Jul 28 16:51:21.214311 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:21.214284    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6456d458d7-kkvpf"
Jul 28 16:51:21.214476 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:21.214347    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6456d458d7-kkvpf"
Jul 28 16:51:21.219907 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:21.219881    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6456d458d7-kkvpf"
Jul 28 16:51:21.232624 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:21.232602    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:21.264193 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:21.264127    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ec22f019-b5ce-4072-92f0-c2ddde44342d-secret-thanos-querier-tls\") pod \"thanos-querier-6d8df69445-swr4n\" (UID: \"ec22f019-b5ce-4072-92f0-c2ddde44342d\") " pod="openshift-monitoring/thanos-querier-6d8df69445-swr4n"
Jul 28 16:51:21.264193 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:21.264164    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ec22f019-b5ce-4072-92f0-c2ddde44342d-secret-grpc-tls\") pod \"thanos-querier-6d8df69445-swr4n\" (UID: \"ec22f019-b5ce-4072-92f0-c2ddde44342d\") " pod="openshift-monitoring/thanos-querier-6d8df69445-swr4n"
Jul 28 16:51:21.264367 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:21.264197    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ec22f019-b5ce-4072-92f0-c2ddde44342d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6d8df69445-swr4n\" (UID: \"ec22f019-b5ce-4072-92f0-c2ddde44342d\") " pod="openshift-monitoring/thanos-querier-6d8df69445-swr4n"
Jul 28 16:51:21.264367 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:21.264276    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgz7d\" (UniqueName: \"kubernetes.io/projected/ec22f019-b5ce-4072-92f0-c2ddde44342d-kube-api-access-rgz7d\") pod \"thanos-querier-6d8df69445-swr4n\" (UID: \"ec22f019-b5ce-4072-92f0-c2ddde44342d\") " pod="openshift-monitoring/thanos-querier-6d8df69445-swr4n"
Jul 28 16:51:21.264367 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:21.264331    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ec22f019-b5ce-4072-92f0-c2ddde44342d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6d8df69445-swr4n\" (UID: \"ec22f019-b5ce-4072-92f0-c2ddde44342d\") " pod="openshift-monitoring/thanos-querier-6d8df69445-swr4n"
Jul 28 16:51:21.264492 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:21.264403    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec22f019-b5ce-4072-92f0-c2ddde44342d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6d8df69445-swr4n\" (UID: \"ec22f019-b5ce-4072-92f0-c2ddde44342d\") " pod="openshift-monitoring/thanos-querier-6d8df69445-swr4n"
Jul 28 16:51:21.264492 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:21.264439    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec22f019-b5ce-4072-92f0-c2ddde44342d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6d8df69445-swr4n\" (UID: \"ec22f019-b5ce-4072-92f0-c2ddde44342d\") " pod="openshift-monitoring/thanos-querier-6d8df69445-swr4n"
Jul 28 16:51:21.264492 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:21.264471    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec22f019-b5ce-4072-92f0-c2ddde44342d-metrics-client-ca\") pod \"thanos-querier-6d8df69445-swr4n\" (UID: \"ec22f019-b5ce-4072-92f0-c2ddde44342d\") " pod="openshift-monitoring/thanos-querier-6d8df69445-swr4n"
Jul 28 16:51:21.265211 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:21.265188    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec22f019-b5ce-4072-92f0-c2ddde44342d-metrics-client-ca\") pod \"thanos-querier-6d8df69445-swr4n\" (UID: \"ec22f019-b5ce-4072-92f0-c2ddde44342d\") " pod="openshift-monitoring/thanos-querier-6d8df69445-swr4n"
Jul 28 16:51:21.267654 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:21.267481    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/ec22f019-b5ce-4072-92f0-c2ddde44342d-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6d8df69445-swr4n\" (UID: \"ec22f019-b5ce-4072-92f0-c2ddde44342d\") " pod="openshift-monitoring/thanos-querier-6d8df69445-swr4n"
Jul 28 16:51:21.267654 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:21.267531    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/ec22f019-b5ce-4072-92f0-c2ddde44342d-secret-thanos-querier-tls\") pod \"thanos-querier-6d8df69445-swr4n\" (UID: \"ec22f019-b5ce-4072-92f0-c2ddde44342d\") " pod="openshift-monitoring/thanos-querier-6d8df69445-swr4n"
Jul 28 16:51:21.267654 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:21.267593    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/ec22f019-b5ce-4072-92f0-c2ddde44342d-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6d8df69445-swr4n\" (UID: \"ec22f019-b5ce-4072-92f0-c2ddde44342d\") " pod="openshift-monitoring/thanos-querier-6d8df69445-swr4n"
Jul 28 16:51:21.267873 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:21.267815    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec22f019-b5ce-4072-92f0-c2ddde44342d-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6d8df69445-swr4n\" (UID: \"ec22f019-b5ce-4072-92f0-c2ddde44342d\") " pod="openshift-monitoring/thanos-querier-6d8df69445-swr4n"
Jul 28 16:51:21.267925 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:21.267897    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ec22f019-b5ce-4072-92f0-c2ddde44342d-secret-grpc-tls\") pod \"thanos-querier-6d8df69445-swr4n\" (UID: \"ec22f019-b5ce-4072-92f0-c2ddde44342d\") " pod="openshift-monitoring/thanos-querier-6d8df69445-swr4n"
Jul 28 16:51:21.268241 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:21.268223    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec22f019-b5ce-4072-92f0-c2ddde44342d-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6d8df69445-swr4n\" (UID: \"ec22f019-b5ce-4072-92f0-c2ddde44342d\") " pod="openshift-monitoring/thanos-querier-6d8df69445-swr4n"
Jul 28 16:51:21.274835 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:21.274813    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgz7d\" (UniqueName: \"kubernetes.io/projected/ec22f019-b5ce-4072-92f0-c2ddde44342d-kube-api-access-rgz7d\") pod \"thanos-querier-6d8df69445-swr4n\" (UID: \"ec22f019-b5ce-4072-92f0-c2ddde44342d\") " pod="openshift-monitoring/thanos-querier-6d8df69445-swr4n"
Jul 28 16:51:21.373191 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:21.373159    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6d8df69445-swr4n"
Jul 28 16:51:21.402163 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:21.402135    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-lprvh"
Jul 28 16:51:21.448524 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:21.448487    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6456d458d7-kkvpf"
Jul 28 16:51:21.573626 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:21.573544    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:21.664084 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:21.664048    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:21.743248 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:21.743211    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:21.809200 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:21.809169    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:21.946914 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:21.946824    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:22.013218 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:22.013191    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:22.415315 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:22.415278    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-66b69b8c57-lnc6c"]
Jul 28 16:51:22.418714 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:22.418686    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-66b69b8c57-lnc6c"
Jul 28 16:51:22.422729 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:22.422704    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 28 16:51:22.422848 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:22.422827    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-zfm9v\""
Jul 28 16:51:22.424151 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:22.424128    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 28 16:51:22.424255 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:22.424203    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 28 16:51:22.424255 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:22.424230    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-96hhl597mj5rk\""
Jul 28 16:51:22.424377 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:22.424323    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 28 16:51:22.430810 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:22.430789    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-66b69b8c57-lnc6c"]
Jul 28 16:51:22.576060 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:22.576027    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/97f86307-d00a-4808-ab85-141adf1e5411-audit-log\") pod \"metrics-server-66b69b8c57-lnc6c\" (UID: \"97f86307-d00a-4808-ab85-141adf1e5411\") " pod="openshift-monitoring/metrics-server-66b69b8c57-lnc6c"
Jul 28 16:51:22.576060 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:22.576064    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/97f86307-d00a-4808-ab85-141adf1e5411-secret-metrics-server-client-certs\") pod \"metrics-server-66b69b8c57-lnc6c\" (UID: \"97f86307-d00a-4808-ab85-141adf1e5411\") " pod="openshift-monitoring/metrics-server-66b69b8c57-lnc6c"
Jul 28 16:51:22.576315 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:22.576094    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/97f86307-d00a-4808-ab85-141adf1e5411-metrics-server-audit-profiles\") pod \"metrics-server-66b69b8c57-lnc6c\" (UID: \"97f86307-d00a-4808-ab85-141adf1e5411\") " pod="openshift-monitoring/metrics-server-66b69b8c57-lnc6c"
Jul 28 16:51:22.576315 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:22.576140    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwpkf\" (UniqueName: \"kubernetes.io/projected/97f86307-d00a-4808-ab85-141adf1e5411-kube-api-access-cwpkf\") pod \"metrics-server-66b69b8c57-lnc6c\" (UID: \"97f86307-d00a-4808-ab85-141adf1e5411\") " pod="openshift-monitoring/metrics-server-66b69b8c57-lnc6c"
Jul 28 16:51:22.576315 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:22.576232    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/97f86307-d00a-4808-ab85-141adf1e5411-secret-metrics-server-tls\") pod \"metrics-server-66b69b8c57-lnc6c\" (UID: \"97f86307-d00a-4808-ab85-141adf1e5411\") " pod="openshift-monitoring/metrics-server-66b69b8c57-lnc6c"
Jul 28 16:51:22.576315 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:22.576268    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/97f86307-d00a-4808-ab85-141adf1e5411-client-ca-bundle\") pod \"metrics-server-66b69b8c57-lnc6c\" (UID: \"97f86307-d00a-4808-ab85-141adf1e5411\") " pod="openshift-monitoring/metrics-server-66b69b8c57-lnc6c"
Jul 28 16:51:22.576315 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:22.576297    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97f86307-d00a-4808-ab85-141adf1e5411-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-66b69b8c57-lnc6c\" (UID: \"97f86307-d00a-4808-ab85-141adf1e5411\") " pod="openshift-monitoring/metrics-server-66b69b8c57-lnc6c"
Jul 28 16:51:22.677244 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:22.677167    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/97f86307-d00a-4808-ab85-141adf1e5411-audit-log\") pod \"metrics-server-66b69b8c57-lnc6c\" (UID: \"97f86307-d00a-4808-ab85-141adf1e5411\") " pod="openshift-monitoring/metrics-server-66b69b8c57-lnc6c"
Jul 28 16:51:22.677244 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:22.677210    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/97f86307-d00a-4808-ab85-141adf1e5411-secret-metrics-server-client-certs\") pod \"metrics-server-66b69b8c57-lnc6c\" (UID: \"97f86307-d00a-4808-ab85-141adf1e5411\") " pod="openshift-monitoring/metrics-server-66b69b8c57-lnc6c"
Jul 28 16:51:22.677460 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:22.677352    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/97f86307-d00a-4808-ab85-141adf1e5411-metrics-server-audit-profiles\") pod \"metrics-server-66b69b8c57-lnc6c\" (UID: \"97f86307-d00a-4808-ab85-141adf1e5411\") " pod="openshift-monitoring/metrics-server-66b69b8c57-lnc6c"
Jul 28 16:51:22.677460 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:22.677406    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwpkf\" (UniqueName: \"kubernetes.io/projected/97f86307-d00a-4808-ab85-141adf1e5411-kube-api-access-cwpkf\") pod \"metrics-server-66b69b8c57-lnc6c\" (UID: \"97f86307-d00a-4808-ab85-141adf1e5411\") " pod="openshift-monitoring/metrics-server-66b69b8c57-lnc6c"
Jul 28 16:51:22.677555 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:22.677459    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/97f86307-d00a-4808-ab85-141adf1e5411-secret-metrics-server-tls\") pod \"metrics-server-66b69b8c57-lnc6c\" (UID: \"97f86307-d00a-4808-ab85-141adf1e5411\") " pod="openshift-monitoring/metrics-server-66b69b8c57-lnc6c"
Jul 28 16:51:22.677555 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:22.677498    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/97f86307-d00a-4808-ab85-141adf1e5411-client-ca-bundle\") pod \"metrics-server-66b69b8c57-lnc6c\" (UID: \"97f86307-d00a-4808-ab85-141adf1e5411\") " pod="openshift-monitoring/metrics-server-66b69b8c57-lnc6c"
Jul 28 16:51:22.677555 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:22.677528    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97f86307-d00a-4808-ab85-141adf1e5411-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-66b69b8c57-lnc6c\" (UID: \"97f86307-d00a-4808-ab85-141adf1e5411\") " pod="openshift-monitoring/metrics-server-66b69b8c57-lnc6c"
Jul 28 16:51:22.677695 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:22.677548    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/97f86307-d00a-4808-ab85-141adf1e5411-audit-log\") pod \"metrics-server-66b69b8c57-lnc6c\" (UID: \"97f86307-d00a-4808-ab85-141adf1e5411\") " pod="openshift-monitoring/metrics-server-66b69b8c57-lnc6c"
Jul 28 16:51:22.678401 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:22.678217    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/97f86307-d00a-4808-ab85-141adf1e5411-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-66b69b8c57-lnc6c\" (UID: \"97f86307-d00a-4808-ab85-141adf1e5411\") " pod="openshift-monitoring/metrics-server-66b69b8c57-lnc6c"
Jul 28 16:51:22.678401 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:22.678313    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/97f86307-d00a-4808-ab85-141adf1e5411-metrics-server-audit-profiles\") pod \"metrics-server-66b69b8c57-lnc6c\" (UID: \"97f86307-d00a-4808-ab85-141adf1e5411\") " pod="openshift-monitoring/metrics-server-66b69b8c57-lnc6c"
Jul 28 16:51:22.680174 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:22.680150    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/97f86307-d00a-4808-ab85-141adf1e5411-secret-metrics-server-client-certs\") pod \"metrics-server-66b69b8c57-lnc6c\" (UID: \"97f86307-d00a-4808-ab85-141adf1e5411\") " pod="openshift-monitoring/metrics-server-66b69b8c57-lnc6c"
Jul 28 16:51:22.680349 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:22.680327    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/97f86307-d00a-4808-ab85-141adf1e5411-client-ca-bundle\") pod \"metrics-server-66b69b8c57-lnc6c\" (UID: \"97f86307-d00a-4808-ab85-141adf1e5411\") " pod="openshift-monitoring/metrics-server-66b69b8c57-lnc6c"
Jul 28 16:51:22.680824 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:22.680805    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/97f86307-d00a-4808-ab85-141adf1e5411-secret-metrics-server-tls\") pod \"metrics-server-66b69b8c57-lnc6c\" (UID: \"97f86307-d00a-4808-ab85-141adf1e5411\") " pod="openshift-monitoring/metrics-server-66b69b8c57-lnc6c"
Jul 28 16:51:22.687298 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:22.687272    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwpkf\" (UniqueName: \"kubernetes.io/projected/97f86307-d00a-4808-ab85-141adf1e5411-kube-api-access-cwpkf\") pod \"metrics-server-66b69b8c57-lnc6c\" (UID: \"97f86307-d00a-4808-ab85-141adf1e5411\") " pod="openshift-monitoring/metrics-server-66b69b8c57-lnc6c"
Jul 28 16:51:22.730108 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:22.730079    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-66b69b8c57-lnc6c"
Jul 28 16:51:22.852564 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:22.852531    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-4xqvc"]
Jul 28 16:51:22.854764 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:22.854745    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4xqvc"
Jul 28 16:51:22.857604 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:22.857583    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 28 16:51:22.857705 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:22.857621    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-hqdbl\""
Jul 28 16:51:22.863650 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:22.863623    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-4xqvc"]
Jul 28 16:51:22.884293 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:22.884264    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:22.977393 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:22.977357    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:22.979280 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:22.979248    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d3b71ec-3a67-4a76-b679-f8ac52b8e605-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-4xqvc\" (UID: \"1d3b71ec-3a67-4a76-b679-f8ac52b8e605\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4xqvc"
Jul 28 16:51:22.979401 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:22.979313    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hz26p\" (UniqueName: \"kubernetes.io/projected/1d3b71ec-3a67-4a76-b679-f8ac52b8e605-kube-api-access-hz26p\") pod \"monitoring-plugin-68b7fc9574-4xqvc\" (UID: \"1d3b71ec-3a67-4a76-b679-f8ac52b8e605\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4xqvc"
Jul 28 16:51:23.068867 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:51:23.068556    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cd2b8dd_9699_463c_94f4_1ac4a58f480c.slice/crio-d64d0cbc225105e9412ab6218854de3ab92ae30d169aa1c00c2653712a667482 WatchSource:0}: Error finding container d64d0cbc225105e9412ab6218854de3ab92ae30d169aa1c00c2653712a667482: Status 404 returned error can't find the container with id d64d0cbc225105e9412ab6218854de3ab92ae30d169aa1c00c2653712a667482
Jul 28 16:51:23.079661 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:23.079601    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz26p\" (UniqueName: \"kubernetes.io/projected/1d3b71ec-3a67-4a76-b679-f8ac52b8e605-kube-api-access-hz26p\") pod \"monitoring-plugin-68b7fc9574-4xqvc\" (UID: \"1d3b71ec-3a67-4a76-b679-f8ac52b8e605\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4xqvc"
Jul 28 16:51:23.079784 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:23.079685    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d3b71ec-3a67-4a76-b679-f8ac52b8e605-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-4xqvc\" (UID: \"1d3b71ec-3a67-4a76-b679-f8ac52b8e605\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4xqvc"
Jul 28 16:51:23.079871 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:51:23.079805    2561 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 28 16:51:23.079871 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:51:23.079861    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d3b71ec-3a67-4a76-b679-f8ac52b8e605-monitoring-plugin-cert podName:1d3b71ec-3a67-4a76-b679-f8ac52b8e605 nodeName:}" failed. No retries permitted until 2026-07-28 16:51:23.579839849 +0000 UTC m=+73.051253509 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/1d3b71ec-3a67-4a76-b679-f8ac52b8e605-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-4xqvc" (UID: "1d3b71ec-3a67-4a76-b679-f8ac52b8e605") : secret "monitoring-plugin-cert" not found
Jul 28 16:51:23.093399 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:23.093347    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz26p\" (UniqueName: \"kubernetes.io/projected/1d3b71ec-3a67-4a76-b679-f8ac52b8e605-kube-api-access-hz26p\") pod \"monitoring-plugin-68b7fc9574-4xqvc\" (UID: \"1d3b71ec-3a67-4a76-b679-f8ac52b8e605\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4xqvc"
Jul 28 16:51:23.266985 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:23.266461    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-mj2cg"]
Jul 28 16:51:23.293342 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:23.293271    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6d8df69445-swr4n"]
Jul 28 16:51:23.301916 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:51:23.301570    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec22f019_b5ce_4072_92f0_c2ddde44342d.slice/crio-b648fd6e29c8778557f9d78e7725f1a9fb7975f57ad99f6a2e77514f28955ce0 WatchSource:0}: Error finding container b648fd6e29c8778557f9d78e7725f1a9fb7975f57ad99f6a2e77514f28955ce0: Status 404 returned error can't find the container with id b648fd6e29c8778557f9d78e7725f1a9fb7975f57ad99f6a2e77514f28955ce0
Jul 28 16:51:23.309340 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:23.309309    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-nwwnm"]
Jul 28 16:51:23.312789 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:51:23.312768    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf00acafc_07e7_44e5_adf0_e27090651d24.slice/crio-84f1997facde204afa688c723a255ae58381297c3c0fbed440917ba79d61a5ae WatchSource:0}: Error finding container 84f1997facde204afa688c723a255ae58381297c3c0fbed440917ba79d61a5ae: Status 404 returned error can't find the container with id 84f1997facde204afa688c723a255ae58381297c3c0fbed440917ba79d61a5ae
Jul 28 16:51:23.321441 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:23.321308    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-66b69b8c57-lnc6c"]
Jul 28 16:51:23.335516 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:51:23.335475    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97f86307_d00a_4808_ab85_141adf1e5411.slice/crio-07fa95dec77e13e3830ff40d90d189ae499aaf6b879bda84d31338efbe4ba774 WatchSource:0}: Error finding container 07fa95dec77e13e3830ff40d90d189ae499aaf6b879bda84d31338efbe4ba774: Status 404 returned error can't find the container with id 07fa95dec77e13e3830ff40d90d189ae499aaf6b879bda84d31338efbe4ba774
Jul 28 16:51:23.457407 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:23.457374    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-d9pjq" event={"ID":"1f76d1cf-0908-4c40-9d33-50e1b6c85200","Type":"ContainerStarted","Data":"357559c45a9b018930fd9a3130175a87f2277622e94b8d3a8d7d4ad521f7ee2b"}
Jul 28 16:51:23.459257 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:23.459228    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vn69s" event={"ID":"ab2695e6-884f-4726-ba45-fe2772ee69a8","Type":"ContainerStarted","Data":"5ef8344400566e6a96f266e9cf8337d51a45a8c4bdcfeac9e2df18c1b5800887"}
Jul 28 16:51:23.459358 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:23.459289    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-vn69s" event={"ID":"ab2695e6-884f-4726-ba45-fe2772ee69a8","Type":"ContainerStarted","Data":"9a14f3bfa36e3b4053e3b7aa38824fe8dd526ba6c4e337ea7e68bd13f9bb0d08"}
Jul 28 16:51:23.460404 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:23.460384    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-66b69b8c57-lnc6c" event={"ID":"97f86307-d00a-4808-ab85-141adf1e5411","Type":"ContainerStarted","Data":"07fa95dec77e13e3830ff40d90d189ae499aaf6b879bda84d31338efbe4ba774"}
Jul 28 16:51:23.461663 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:23.461636    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d8df69445-swr4n" event={"ID":"ec22f019-b5ce-4072-92f0-c2ddde44342d","Type":"ContainerStarted","Data":"b648fd6e29c8778557f9d78e7725f1a9fb7975f57ad99f6a2e77514f28955ce0"}
Jul 28 16:51:23.462721 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:23.462699    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mj2cg" event={"ID":"113011e3-c1ad-40f8-b250-0ffb6826e4f9","Type":"ContainerStarted","Data":"4c580ab3e5fe1826bd5ae766ef7f7d3ea573ef20f427348f91ed5548819c722d"}
Jul 28 16:51:23.464193 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:23.464172    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fvtsl" event={"ID":"9a7043cc-b151-4888-90cc-f3dae8a2a91d","Type":"ContainerStarted","Data":"3c66e370a0d6a782ebc9d9a80bba9ee438bcab1868e751bf588942f95bd84759"}
Jul 28 16:51:23.465375 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:23.465357    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fkj9s" event={"ID":"6cd2b8dd-9699-463c-94f4-1ac4a58f480c","Type":"ContainerStarted","Data":"d64d0cbc225105e9412ab6218854de3ab92ae30d169aa1c00c2653712a667482"}
Jul 28 16:51:23.467044 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:23.467023    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nwwnm" event={"ID":"f00acafc-07e7-44e5-adf0-e27090651d24","Type":"ContainerStarted","Data":"d66c97367d5fcf29bb9d908b2c3848ae1c3edc4d3bd0e5d00b41863e8aa74ad2"}
Jul 28 16:51:23.467119 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:23.467074    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nwwnm" event={"ID":"f00acafc-07e7-44e5-adf0-e27090651d24","Type":"ContainerStarted","Data":"a0bef2445fc596c5cf6298b924982021e1757dcd28cb34e36f05d05f3eded38c"}
Jul 28 16:51:23.467119 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:23.467096    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nwwnm" event={"ID":"f00acafc-07e7-44e5-adf0-e27090651d24","Type":"ContainerStarted","Data":"84f1997facde204afa688c723a255ae58381297c3c0fbed440917ba79d61a5ae"}
Jul 28 16:51:23.468254 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:23.468235    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hbfct" event={"ID":"7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee","Type":"ContainerStarted","Data":"74c7471b27e86d8c363b06b1e2ad7f45b7f3218fdd62a70d00d4a23d8d2f947e"}
Jul 28 16:51:23.468473 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:23.468458    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hbfct"
Jul 28 16:51:23.476728 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:23.476693    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-d9pjq" podStartSLOduration=1.546441351 podStartE2EDuration="19.476680772s" totalImagesPullingTime="17.930239421s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 16:51:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:51:23.476075635 +0000 UTC m=+72.947489296" watchObservedRunningTime="2026-07-28 16:51:23.476680772 +0000 UTC m=+72.948094437"
Jul 28 16:51:23.499639 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:23.499561    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-vn69s" podStartSLOduration=66.505814707 podStartE2EDuration="1m12.499552057s" totalImagesPullingTime="5.99373735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:50:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:51:23.498537762 +0000 UTC m=+72.969951421" watchObservedRunningTime="2026-07-28 16:51:23.499552057 +0000 UTC m=+72.970965716"
Jul 28 16:51:23.515545 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:23.515502    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fvtsl" podStartSLOduration=65.679289158 podStartE2EDuration="1m11.515487244s" totalImagesPullingTime="5.836198086s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 16:50:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:51:23.515025304 +0000 UTC m=+72.986438965" watchObservedRunningTime="2026-07-28 16:51:23.515487244 +0000 UTC m=+72.986900903"
Jul 28 16:51:23.530549 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:23.530505    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hbfct" podStartSLOduration=66.825670798 podStartE2EDuration="1m12.530494086s" totalImagesPullingTime="5.704823288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:50:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:51:23.530489878 +0000 UTC m=+73.001903538" watchObservedRunningTime="2026-07-28 16:51:23.530494086 +0000 UTC m=+73.001907745"
Jul 28 16:51:23.583905 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:23.583867    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d3b71ec-3a67-4a76-b679-f8ac52b8e605-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-4xqvc\" (UID: \"1d3b71ec-3a67-4a76-b679-f8ac52b8e605\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4xqvc"
Jul 28 16:51:23.584058 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:51:23.584029    2561 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 28 16:51:23.584162 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:51:23.584103    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d3b71ec-3a67-4a76-b679-f8ac52b8e605-monitoring-plugin-cert podName:1d3b71ec-3a67-4a76-b679-f8ac52b8e605 nodeName:}" failed. No retries permitted until 2026-07-28 16:51:24.584084503 +0000 UTC m=+74.055498142 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/1d3b71ec-3a67-4a76-b679-f8ac52b8e605-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-4xqvc" (UID: "1d3b71ec-3a67-4a76-b679-f8ac52b8e605") : secret "monitoring-plugin-cert" not found
Jul 28 16:51:23.606896 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:23.606875    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:23.665019 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:23.664993    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:23.825519 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:23.825411    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:24.035794 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:24.035764    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-657b69cf67-jnwpg"]
Jul 28 16:51:24.038006 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:24.037969    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-657b69cf67-jnwpg"
Jul 28 16:51:24.053611 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:24.053588    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-657b69cf67-jnwpg"]
Jul 28 16:51:24.190051 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:24.189986    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f414689-5a17-42b1-9308-3f4d6aa4bcf4-service-ca\") pod \"console-657b69cf67-jnwpg\" (UID: \"1f414689-5a17-42b1-9308-3f4d6aa4bcf4\") " pod="openshift-console/console-657b69cf67-jnwpg"
Jul 28 16:51:24.190051 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:24.190026    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcbnf\" (UniqueName: \"kubernetes.io/projected/1f414689-5a17-42b1-9308-3f4d6aa4bcf4-kube-api-access-kcbnf\") pod \"console-657b69cf67-jnwpg\" (UID: \"1f414689-5a17-42b1-9308-3f4d6aa4bcf4\") " pod="openshift-console/console-657b69cf67-jnwpg"
Jul 28 16:51:24.190559 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:24.190056    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f414689-5a17-42b1-9308-3f4d6aa4bcf4-console-serving-cert\") pod \"console-657b69cf67-jnwpg\" (UID: \"1f414689-5a17-42b1-9308-3f4d6aa4bcf4\") " pod="openshift-console/console-657b69cf67-jnwpg"
Jul 28 16:51:24.190559 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:24.190096    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f414689-5a17-42b1-9308-3f4d6aa4bcf4-console-oauth-config\") pod \"console-657b69cf67-jnwpg\" (UID: \"1f414689-5a17-42b1-9308-3f4d6aa4bcf4\") " pod="openshift-console/console-657b69cf67-jnwpg"
Jul 28 16:51:24.190559 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:24.190144    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f414689-5a17-42b1-9308-3f4d6aa4bcf4-trusted-ca-bundle\") pod \"console-657b69cf67-jnwpg\" (UID: \"1f414689-5a17-42b1-9308-3f4d6aa4bcf4\") " pod="openshift-console/console-657b69cf67-jnwpg"
Jul 28 16:51:24.190559 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:24.190188    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f414689-5a17-42b1-9308-3f4d6aa4bcf4-console-config\") pod \"console-657b69cf67-jnwpg\" (UID: \"1f414689-5a17-42b1-9308-3f4d6aa4bcf4\") " pod="openshift-console/console-657b69cf67-jnwpg"
Jul 28 16:51:24.190559 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:24.190241    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f414689-5a17-42b1-9308-3f4d6aa4bcf4-oauth-serving-cert\") pod \"console-657b69cf67-jnwpg\" (UID: \"1f414689-5a17-42b1-9308-3f4d6aa4bcf4\") " pod="openshift-console/console-657b69cf67-jnwpg"
Jul 28 16:51:24.291431 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:24.291392    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f414689-5a17-42b1-9308-3f4d6aa4bcf4-console-serving-cert\") pod \"console-657b69cf67-jnwpg\" (UID: \"1f414689-5a17-42b1-9308-3f4d6aa4bcf4\") " pod="openshift-console/console-657b69cf67-jnwpg"
Jul 28 16:51:24.291584 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:24.291439    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f414689-5a17-42b1-9308-3f4d6aa4bcf4-console-oauth-config\") pod \"console-657b69cf67-jnwpg\" (UID: \"1f414689-5a17-42b1-9308-3f4d6aa4bcf4\") " pod="openshift-console/console-657b69cf67-jnwpg"
Jul 28 16:51:24.291584 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:24.291464    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f414689-5a17-42b1-9308-3f4d6aa4bcf4-trusted-ca-bundle\") pod \"console-657b69cf67-jnwpg\" (UID: \"1f414689-5a17-42b1-9308-3f4d6aa4bcf4\") " pod="openshift-console/console-657b69cf67-jnwpg"
Jul 28 16:51:24.291584 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:24.291491    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f414689-5a17-42b1-9308-3f4d6aa4bcf4-console-config\") pod \"console-657b69cf67-jnwpg\" (UID: \"1f414689-5a17-42b1-9308-3f4d6aa4bcf4\") " pod="openshift-console/console-657b69cf67-jnwpg"
Jul 28 16:51:24.291584 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:24.291524    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f414689-5a17-42b1-9308-3f4d6aa4bcf4-oauth-serving-cert\") pod \"console-657b69cf67-jnwpg\" (UID: \"1f414689-5a17-42b1-9308-3f4d6aa4bcf4\") " pod="openshift-console/console-657b69cf67-jnwpg"
Jul 28 16:51:24.291810 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:24.291617    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f414689-5a17-42b1-9308-3f4d6aa4bcf4-service-ca\") pod \"console-657b69cf67-jnwpg\" (UID: \"1f414689-5a17-42b1-9308-3f4d6aa4bcf4\") " pod="openshift-console/console-657b69cf67-jnwpg"
Jul 28 16:51:24.291810 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:24.291660    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcbnf\" (UniqueName: \"kubernetes.io/projected/1f414689-5a17-42b1-9308-3f4d6aa4bcf4-kube-api-access-kcbnf\") pod \"console-657b69cf67-jnwpg\" (UID: \"1f414689-5a17-42b1-9308-3f4d6aa4bcf4\") " pod="openshift-console/console-657b69cf67-jnwpg"
Jul 28 16:51:24.293743 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:24.293081    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f414689-5a17-42b1-9308-3f4d6aa4bcf4-console-config\") pod \"console-657b69cf67-jnwpg\" (UID: \"1f414689-5a17-42b1-9308-3f4d6aa4bcf4\") " pod="openshift-console/console-657b69cf67-jnwpg"
Jul 28 16:51:24.293743 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:24.293220    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f414689-5a17-42b1-9308-3f4d6aa4bcf4-trusted-ca-bundle\") pod \"console-657b69cf67-jnwpg\" (UID: \"1f414689-5a17-42b1-9308-3f4d6aa4bcf4\") " pod="openshift-console/console-657b69cf67-jnwpg"
Jul 28 16:51:24.293743 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:24.293668    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f414689-5a17-42b1-9308-3f4d6aa4bcf4-oauth-serving-cert\") pod \"console-657b69cf67-jnwpg\" (UID: \"1f414689-5a17-42b1-9308-3f4d6aa4bcf4\") " pod="openshift-console/console-657b69cf67-jnwpg"
Jul 28 16:51:24.294062 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:24.293794    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f414689-5a17-42b1-9308-3f4d6aa4bcf4-service-ca\") pod \"console-657b69cf67-jnwpg\" (UID: \"1f414689-5a17-42b1-9308-3f4d6aa4bcf4\") " pod="openshift-console/console-657b69cf67-jnwpg"
Jul 28 16:51:24.295731 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:24.295699    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f414689-5a17-42b1-9308-3f4d6aa4bcf4-console-oauth-config\") pod \"console-657b69cf67-jnwpg\" (UID: \"1f414689-5a17-42b1-9308-3f4d6aa4bcf4\") " pod="openshift-console/console-657b69cf67-jnwpg"
Jul 28 16:51:24.299738 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:24.299712    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f414689-5a17-42b1-9308-3f4d6aa4bcf4-console-serving-cert\") pod \"console-657b69cf67-jnwpg\" (UID: \"1f414689-5a17-42b1-9308-3f4d6aa4bcf4\") " pod="openshift-console/console-657b69cf67-jnwpg"
Jul 28 16:51:24.312875 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:24.312847    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcbnf\" (UniqueName: \"kubernetes.io/projected/1f414689-5a17-42b1-9308-3f4d6aa4bcf4-kube-api-access-kcbnf\") pod \"console-657b69cf67-jnwpg\" (UID: \"1f414689-5a17-42b1-9308-3f4d6aa4bcf4\") " pod="openshift-console/console-657b69cf67-jnwpg"
Jul 28 16:51:24.347038 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:24.347015    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-657b69cf67-jnwpg"
Jul 28 16:51:24.356999 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:24.356880    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:24.453216 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:24.453074    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:24.502581 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:24.502536    2561 generic.go:356] "Generic (PLEG): container finished" podID="6cd2b8dd-9699-463c-94f4-1ac4a58f480c" containerID="90e3d846d272f118e3dc181cd3cdca403ce19f6889b42f3fcca820819fdab2f3" exitCode=0
Jul 28 16:51:24.505183 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:24.503577    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fkj9s" event={"ID":"6cd2b8dd-9699-463c-94f4-1ac4a58f480c","Type":"ContainerDied","Data":"90e3d846d272f118e3dc181cd3cdca403ce19f6889b42f3fcca820819fdab2f3"}
Jul 28 16:51:24.551004 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:24.550977    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-657b69cf67-jnwpg"]
Jul 28 16:51:24.554672 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:51:24.554647    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f414689_5a17_42b1_9308_3f4d6aa4bcf4.slice/crio-88abbcea97c76137376f8dece104a691fab43509f686ce918be3863b36d3bb41 WatchSource:0}: Error finding container 88abbcea97c76137376f8dece104a691fab43509f686ce918be3863b36d3bb41: Status 404 returned error can't find the container with id 88abbcea97c76137376f8dece104a691fab43509f686ce918be3863b36d3bb41
Jul 28 16:51:24.599313 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:24.599270    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d3b71ec-3a67-4a76-b679-f8ac52b8e605-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-4xqvc\" (UID: \"1d3b71ec-3a67-4a76-b679-f8ac52b8e605\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4xqvc"
Jul 28 16:51:24.602752 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:24.602665    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d3b71ec-3a67-4a76-b679-f8ac52b8e605-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-4xqvc\" (UID: \"1d3b71ec-3a67-4a76-b679-f8ac52b8e605\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4xqvc"
Jul 28 16:51:24.666404 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:24.666381    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4xqvc"
Jul 28 16:51:24.844496 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:24.844417    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-4xqvc"]
Jul 28 16:51:24.848869 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:24.848842    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:24.913920 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:24.913826    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:25.071869 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:51:25.071781    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d3b71ec_3a67_4a76_b679_f8ac52b8e605.slice/crio-30e92d0af6bd40b511783e730054195f1dd21e654949c362dff2f797daab9180 WatchSource:0}: Error finding container 30e92d0af6bd40b511783e730054195f1dd21e654949c362dff2f797daab9180: Status 404 returned error can't find the container with id 30e92d0af6bd40b511783e730054195f1dd21e654949c362dff2f797daab9180
Jul 28 16:51:25.512665 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:25.512621    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fkj9s" event={"ID":"6cd2b8dd-9699-463c-94f4-1ac4a58f480c","Type":"ContainerStarted","Data":"e5abd2bff0af84afa50c29bd7af338dcde581fed63b9ed4f67acaca0f00d3e59"}
Jul 28 16:51:25.513108 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:25.512728    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fkj9s" event={"ID":"6cd2b8dd-9699-463c-94f4-1ac4a58f480c","Type":"ContainerStarted","Data":"3675fc725a2c8e3d58f5fa16c4ba92f0c016c8bd5906181eee70f7249191f953"}
Jul 28 16:51:25.514094 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:25.514064    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4xqvc" event={"ID":"1d3b71ec-3a67-4a76-b679-f8ac52b8e605","Type":"ContainerStarted","Data":"30e92d0af6bd40b511783e730054195f1dd21e654949c362dff2f797daab9180"}
Jul 28 16:51:25.515759 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:25.515734    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-657b69cf67-jnwpg" event={"ID":"1f414689-5a17-42b1-9308-3f4d6aa4bcf4","Type":"ContainerStarted","Data":"c966f85b3cad75f871a0a0719be7d97df493c68003793549908d260060511723"}
Jul 28 16:51:25.515759 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:25.515773    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-657b69cf67-jnwpg" event={"ID":"1f414689-5a17-42b1-9308-3f4d6aa4bcf4","Type":"ContainerStarted","Data":"88abbcea97c76137376f8dece104a691fab43509f686ce918be3863b36d3bb41"}
Jul 28 16:51:25.537601 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:25.537557    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fkj9s" podStartSLOduration=6.611638323 podStartE2EDuration="7.537542023s" totalImagesPullingTime="852.945471ms" totalInitContainerRuntime="72.958229ms" isStatefulPod=true podCreationTimestamp="2026-07-28 16:51:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:51:25.536010304 +0000 UTC m=+75.007423964" watchObservedRunningTime="2026-07-28 16:51:25.537542023 +0000 UTC m=+75.008955683"
Jul 28 16:51:25.555732 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:25.555676    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-657b69cf67-jnwpg" podStartSLOduration=1.555656848 podStartE2EDuration="1.555656848s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:51:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:51:25.555292357 +0000 UTC m=+75.026706018" watchObservedRunningTime="2026-07-28 16:51:25.555656848 +0000 UTC m=+75.027070506"
Jul 28 16:51:26.039429 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:26.039390    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:26.137881 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:26.137842    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:26.526213 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:26.525891    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-66b69b8c57-lnc6c" event={"ID":"97f86307-d00a-4808-ab85-141adf1e5411","Type":"ContainerStarted","Data":"af40de1fa61711c7ea5ecd8172da3fa5cd3a95aa4795a1b17e3414b829a7e67e"}
Jul 28 16:51:26.530337 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:26.528215    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d8df69445-swr4n" event={"ID":"ec22f019-b5ce-4072-92f0-c2ddde44342d","Type":"ContainerStarted","Data":"59702b17071e3c4b26d41f2e9797ce64031bab7023c30e4a2478128e126535e7"}
Jul 28 16:51:26.536828 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:26.534204    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mj2cg" event={"ID":"113011e3-c1ad-40f8-b250-0ffb6826e4f9","Type":"ContainerStarted","Data":"0434740b9d2c4d97b69d4cb1b105cc7e240e21f7a7601ebab938c1488428c353"}
Jul 28 16:51:26.542065 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:26.540884    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nwwnm" event={"ID":"f00acafc-07e7-44e5-adf0-e27090651d24","Type":"ContainerStarted","Data":"a3ed206562eb1f2f89033c7b7f173ac68df3b56fa9a6edf96f00cef9abeb131a"}
Jul 28 16:51:26.553189 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:26.553129    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-66b69b8c57-lnc6c" podStartSLOduration=1.5348168370000002 podStartE2EDuration="4.553105742s" totalImagesPullingTime="3.018288905s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:51:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:51:26.550498846 +0000 UTC m=+76.021912522" watchObservedRunningTime="2026-07-28 16:51:26.553105742 +0000 UTC m=+76.024519387"
Jul 28 16:51:27.546098 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:27.546052    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d8df69445-swr4n" event={"ID":"ec22f019-b5ce-4072-92f0-c2ddde44342d","Type":"ContainerStarted","Data":"d9967b4998f9b62a8f1e4c486aadb5b32356d9bf7f52bd4ef14101d8b097743e"}
Jul 28 16:51:27.546567 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:27.546184    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d8df69445-swr4n" event={"ID":"ec22f019-b5ce-4072-92f0-c2ddde44342d","Type":"ContainerStarted","Data":"f0a88baeef305ecc513b4906fb04d7524e8c26a9624834f4c41cc9ee9bfbf386"}
Jul 28 16:51:27.548561 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:27.548533    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mj2cg" event={"ID":"113011e3-c1ad-40f8-b250-0ffb6826e4f9","Type":"ContainerStarted","Data":"fee72e2e0a2ad2034f8577add504df45d4e118af7dec57fb27a8e49b721acf28"}
Jul 28 16:51:27.548681 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:27.548588    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mj2cg" event={"ID":"113011e3-c1ad-40f8-b250-0ffb6826e4f9","Type":"ContainerStarted","Data":"a0064cdf4c06af441187643dfa4191a2d67740445c9f565b4070a6015791ff02"}
Jul 28 16:51:27.550395 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:27.550368    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4xqvc" event={"ID":"1d3b71ec-3a67-4a76-b679-f8ac52b8e605","Type":"ContainerStarted","Data":"a899610e1fa07735edffb4333ba6dc5f2c2bca6b5154f3110c049db309157999"}
Jul 28 16:51:27.550925 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:27.550897    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4xqvc"
Jul 28 16:51:27.556563 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:27.556529    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4xqvc"
Jul 28 16:51:27.562111 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:27.562087    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:27.582918 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:27.582871    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-nwwnm" podStartSLOduration=6.673034235 podStartE2EDuration="9.582854923s" totalImagesPullingTime="2.909820688s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:51:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:51:26.575187592 +0000 UTC m=+76.046601253" watchObservedRunningTime="2026-07-28 16:51:27.582854923 +0000 UTC m=+77.054268584"
Jul 28 16:51:27.607010 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:27.606955    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-mj2cg" podStartSLOduration=6.5292281370000005 podStartE2EDuration="9.606924194s" totalImagesPullingTime="3.077696057s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:51:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:51:27.582824347 +0000 UTC m=+77.054238008" watchObservedRunningTime="2026-07-28 16:51:27.606924194 +0000 UTC m=+77.078337855"
Jul 28 16:51:27.607139 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:27.607073    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-4xqvc" podStartSLOduration=3.30295619 podStartE2EDuration="5.607068134s" totalImagesPullingTime="2.304111944s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:51:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:51:27.60547068 +0000 UTC m=+77.076884343" watchObservedRunningTime="2026-07-28 16:51:27.607068134 +0000 UTC m=+77.078481794"
Jul 28 16:51:27.659573 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:27.659494    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:28.444684 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:28.444650    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:28.544175 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:28.544142    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:28.557204 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:28.557169    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d8df69445-swr4n" event={"ID":"ec22f019-b5ce-4072-92f0-c2ddde44342d","Type":"ContainerStarted","Data":"7ba534f8136c90f1ee6f1d736a42d2fdb481913f11e717083f8c3a81944b9db9"}
Jul 28 16:51:28.557520 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:28.557237    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d8df69445-swr4n" event={"ID":"ec22f019-b5ce-4072-92f0-c2ddde44342d","Type":"ContainerStarted","Data":"2e831931c0e4c1e52412ebc984a9e349cf40f069bcaf6ba754bc77ef7399390f"}
Jul 28 16:51:28.557520 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:28.557267    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6d8df69445-swr4n" event={"ID":"ec22f019-b5ce-4072-92f0-c2ddde44342d","Type":"ContainerStarted","Data":"08315577aa6686fcac986686eb08bef9ab1b190b1fa2fb5c2b89b34aad5c09de"}
Jul 28 16:51:28.587369 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:28.587325    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6d8df69445-swr4n" podStartSLOduration=3.384535366 podStartE2EDuration="7.58731053s" totalImagesPullingTime="4.202775164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:51:21 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:51:28.585543892 +0000 UTC m=+78.056957575" watchObservedRunningTime="2026-07-28 16:51:28.58731053 +0000 UTC m=+78.058724190"
Jul 28 16:51:29.557811 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:29.557760    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:29.561873 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:29.561850    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6d8df69445-swr4n"
Jul 28 16:51:29.640590 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:29.640556    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:30.173229 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:30.173196    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:30.274913 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:30.274886    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:33.864314 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:33.864203    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:33.964977 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:33.964946    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:34.348321 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:34.348281    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-657b69cf67-jnwpg"
Jul 28 16:51:34.348499 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:34.348346    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-657b69cf67-jnwpg"
Jul 28 16:51:34.353049 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:34.353028    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-657b69cf67-jnwpg"
Jul 28 16:51:34.583533 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:34.583509    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-657b69cf67-jnwpg"
Jul 28 16:51:34.632869 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:34.632791    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6456d458d7-kkvpf"]
Jul 28 16:51:34.746979 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:34.746927    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:34.940067 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:34.939989    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:35.043975 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:35.043919    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:35.571850 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:35.571825    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6d8df69445-swr4n"
Jul 28 16:51:37.525963 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:37.525909    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:37.588954 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:37.588913    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:39.332135 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:39.332104    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:39.430708 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:39.430686    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:42.730223 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:42.730195    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-66b69b8c57-lnc6c"
Jul 28 16:51:42.730590 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:42.730278    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-66b69b8c57-lnc6c"
Jul 28 16:51:54.347110 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:54.347005    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:54.435657 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:54.435627    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:51:54.507384 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:54.507339    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hbfct"
Jul 28 16:51:59.652303 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:59.652231    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6456d458d7-kkvpf" podUID="708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1" containerName="console" containerID="cri-o://295c0ae8f0565dccbd734d3596bde2ee4c2e22ed4797ffd50b4dbce815081c22" gracePeriod=15
Jul 28 16:51:59.933748 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:59.933693    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6456d458d7-kkvpf"
Jul 28 16:51:59.959469 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:59.959442    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1-console-serving-cert\") pod \"708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1\" (UID: \"708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1\") "
Jul 28 16:51:59.959596 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:59.959502    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1-console-config\") pod \"708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1\" (UID: \"708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1\") "
Jul 28 16:51:59.959596 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:59.959533    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1-oauth-serving-cert\") pod \"708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1\" (UID: \"708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1\") "
Jul 28 16:51:59.959596 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:59.959547    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1-trusted-ca-bundle\") pod \"708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1\" (UID: \"708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1\") "
Jul 28 16:51:59.959596 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:59.959568    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1-console-oauth-config\") pod \"708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1\" (UID: \"708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1\") "
Jul 28 16:51:59.959812 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:59.959622    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vv7r7\" (UniqueName: \"kubernetes.io/projected/708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1-kube-api-access-vv7r7\") pod \"708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1\" (UID: \"708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1\") "
Jul 28 16:51:59.959812 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:59.959646    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1-service-ca\") pod \"708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1\" (UID: \"708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1\") "
Jul 28 16:51:59.960135 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:59.959987    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1" (UID: "708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 16:51:59.960244 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:59.960225    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1-service-ca" (OuterVolumeSpecName: "service-ca") pod "708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1" (UID: "708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 16:51:59.960303 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:59.960253    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1-console-config" (OuterVolumeSpecName: "console-config") pod "708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1" (UID: "708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 16:51:59.960377 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:59.960347    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1" (UID: "708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 16:51:59.962606 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:59.962582    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1" (UID: "708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 16:51:59.962675 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:59.962655    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1" (UID: "708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 16:51:59.962880 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:51:59.962862    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1-kube-api-access-vv7r7" (OuterVolumeSpecName: "kube-api-access-vv7r7") pod "708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1" (UID: "708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1"). InnerVolumeSpecName "kube-api-access-vv7r7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 16:52:00.060312 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:00.060284    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1-console-config\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 16:52:00.060312 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:00.060307    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1-oauth-serving-cert\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 16:52:00.060312 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:00.060317    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1-trusted-ca-bundle\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 16:52:00.060483 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:00.060325    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1-console-oauth-config\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 16:52:00.060483 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:00.060333    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vv7r7\" (UniqueName: \"kubernetes.io/projected/708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1-kube-api-access-vv7r7\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 16:52:00.060483 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:00.060342    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1-service-ca\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 16:52:00.060483 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:00.060350    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1-console-serving-cert\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 16:52:00.284316 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:00.284287    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:52:00.385984 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:00.385953    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:52:00.677299 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:00.677224    2561 generic.go:356] "Generic (PLEG): container finished" podID="708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1" containerID="295c0ae8f0565dccbd734d3596bde2ee4c2e22ed4797ffd50b4dbce815081c22" exitCode=0
Jul 28 16:52:00.677299 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:00.677275    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6456d458d7-kkvpf"
Jul 28 16:52:00.677697 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:00.677308    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6456d458d7-kkvpf" event={"ID":"708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1","Type":"ContainerDied","Data":"295c0ae8f0565dccbd734d3596bde2ee4c2e22ed4797ffd50b4dbce815081c22"}
Jul 28 16:52:00.677697 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:00.677358    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6456d458d7-kkvpf" event={"ID":"708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1","Type":"ContainerDied","Data":"04ac7ea2ee9a1b9d0b0292be0472e66c5a64d8d8cd794eeb8514a6c044f5e43f"}
Jul 28 16:52:00.677697 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:00.677388    2561 scope.go:117] "RemoveContainer" containerID="295c0ae8f0565dccbd734d3596bde2ee4c2e22ed4797ffd50b4dbce815081c22"
Jul 28 16:52:00.687979 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:00.687961    2561 scope.go:117] "RemoveContainer" containerID="295c0ae8f0565dccbd734d3596bde2ee4c2e22ed4797ffd50b4dbce815081c22"
Jul 28 16:52:00.688234 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:52:00.688215    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"295c0ae8f0565dccbd734d3596bde2ee4c2e22ed4797ffd50b4dbce815081c22\": container with ID starting with 295c0ae8f0565dccbd734d3596bde2ee4c2e22ed4797ffd50b4dbce815081c22 not found: ID does not exist" containerID="295c0ae8f0565dccbd734d3596bde2ee4c2e22ed4797ffd50b4dbce815081c22"
Jul 28 16:52:00.688279 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:00.688243    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"295c0ae8f0565dccbd734d3596bde2ee4c2e22ed4797ffd50b4dbce815081c22"} err="failed to get container status \"295c0ae8f0565dccbd734d3596bde2ee4c2e22ed4797ffd50b4dbce815081c22\": rpc error: code = NotFound desc = could not find container \"295c0ae8f0565dccbd734d3596bde2ee4c2e22ed4797ffd50b4dbce815081c22\": container with ID starting with 295c0ae8f0565dccbd734d3596bde2ee4c2e22ed4797ffd50b4dbce815081c22 not found: ID does not exist"
Jul 28 16:52:00.701111 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:00.701090    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6456d458d7-kkvpf"]
Jul 28 16:52:00.706184 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:00.706166    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6456d458d7-kkvpf"]
Jul 28 16:52:01.079037 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:01.079008    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1" path="/var/lib/kubelet/pods/708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1/volumes"
Jul 28 16:52:02.735610 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:02.735581    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-66b69b8c57-lnc6c"
Jul 28 16:52:02.739272 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:02.739250    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-66b69b8c57-lnc6c"
Jul 28 16:52:37.411204 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:37.411173    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:52:37.892090 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:37.892061    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:52:42.520806 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:42.520774    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5776dd99b4-d8tzt"]
Jul 28 16:52:42.521219 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:42.521056    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1" containerName="console"
Jul 28 16:52:42.521219 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:42.521069    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1" containerName="console"
Jul 28 16:52:42.521219 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:42.521133    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="708ed4ad-c0ab-4c2e-957f-6641e0b5c2e1" containerName="console"
Jul 28 16:52:42.523379 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:42.523364    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5776dd99b4-d8tzt"
Jul 28 16:52:42.526627 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:42.526608    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 28 16:52:42.526784 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:42.526763    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 28 16:52:42.527276 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:42.527262    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 28 16:52:42.527415 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:42.527397    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 28 16:52:42.527537 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:42.527520    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 28 16:52:42.528682 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:42.528667    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-srzxh\""
Jul 28 16:52:42.533187 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:42.533171    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 28 16:52:42.543884 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:42.543866    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5776dd99b4-d8tzt"]
Jul 28 16:52:42.673885 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:42.673858    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5776dd99b4-d8tzt\" (UID: \"13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7\") " pod="openshift-monitoring/telemeter-client-5776dd99b4-d8tzt"
Jul 28 16:52:42.674042 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:42.673898    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7-secret-telemeter-client\") pod \"telemeter-client-5776dd99b4-d8tzt\" (UID: \"13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7\") " pod="openshift-monitoring/telemeter-client-5776dd99b4-d8tzt"
Jul 28 16:52:42.674042 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:42.673957    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5776dd99b4-d8tzt\" (UID: \"13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7\") " pod="openshift-monitoring/telemeter-client-5776dd99b4-d8tzt"
Jul 28 16:52:42.674042 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:42.673983    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7-telemeter-client-tls\") pod \"telemeter-client-5776dd99b4-d8tzt\" (UID: \"13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7\") " pod="openshift-monitoring/telemeter-client-5776dd99b4-d8tzt"
Jul 28 16:52:42.674042 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:42.674007    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stq8z\" (UniqueName: \"kubernetes.io/projected/13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7-kube-api-access-stq8z\") pod \"telemeter-client-5776dd99b4-d8tzt\" (UID: \"13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7\") " pod="openshift-monitoring/telemeter-client-5776dd99b4-d8tzt"
Jul 28 16:52:42.674220 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:42.674067    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7-metrics-client-ca\") pod \"telemeter-client-5776dd99b4-d8tzt\" (UID: \"13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7\") " pod="openshift-monitoring/telemeter-client-5776dd99b4-d8tzt"
Jul 28 16:52:42.674220 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:42.674095    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7-federate-client-tls\") pod \"telemeter-client-5776dd99b4-d8tzt\" (UID: \"13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7\") " pod="openshift-monitoring/telemeter-client-5776dd99b4-d8tzt"
Jul 28 16:52:42.674220 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:42.674121    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7-serving-certs-ca-bundle\") pod \"telemeter-client-5776dd99b4-d8tzt\" (UID: \"13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7\") " pod="openshift-monitoring/telemeter-client-5776dd99b4-d8tzt"
Jul 28 16:52:42.774676 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:42.774604    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7-serving-certs-ca-bundle\") pod \"telemeter-client-5776dd99b4-d8tzt\" (UID: \"13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7\") " pod="openshift-monitoring/telemeter-client-5776dd99b4-d8tzt"
Jul 28 16:52:42.774676 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:42.774655    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5776dd99b4-d8tzt\" (UID: \"13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7\") " pod="openshift-monitoring/telemeter-client-5776dd99b4-d8tzt"
Jul 28 16:52:42.774831 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:42.774685    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7-secret-telemeter-client\") pod \"telemeter-client-5776dd99b4-d8tzt\" (UID: \"13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7\") " pod="openshift-monitoring/telemeter-client-5776dd99b4-d8tzt"
Jul 28 16:52:42.774831 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:42.774721    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5776dd99b4-d8tzt\" (UID: \"13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7\") " pod="openshift-monitoring/telemeter-client-5776dd99b4-d8tzt"
Jul 28 16:52:42.774831 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:42.774749    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7-telemeter-client-tls\") pod \"telemeter-client-5776dd99b4-d8tzt\" (UID: \"13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7\") " pod="openshift-monitoring/telemeter-client-5776dd99b4-d8tzt"
Jul 28 16:52:42.774831 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:42.774774    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stq8z\" (UniqueName: \"kubernetes.io/projected/13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7-kube-api-access-stq8z\") pod \"telemeter-client-5776dd99b4-d8tzt\" (UID: \"13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7\") " pod="openshift-monitoring/telemeter-client-5776dd99b4-d8tzt"
Jul 28 16:52:42.774831 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:42.774829    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7-metrics-client-ca\") pod \"telemeter-client-5776dd99b4-d8tzt\" (UID: \"13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7\") " pod="openshift-monitoring/telemeter-client-5776dd99b4-d8tzt"
Jul 28 16:52:42.775112 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:42.774856    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7-federate-client-tls\") pod \"telemeter-client-5776dd99b4-d8tzt\" (UID: \"13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7\") " pod="openshift-monitoring/telemeter-client-5776dd99b4-d8tzt"
Jul 28 16:52:42.775611 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:42.775444    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7-serving-certs-ca-bundle\") pod \"telemeter-client-5776dd99b4-d8tzt\" (UID: \"13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7\") " pod="openshift-monitoring/telemeter-client-5776dd99b4-d8tzt"
Jul 28 16:52:42.775764 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:42.775526    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5776dd99b4-d8tzt\" (UID: \"13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7\") " pod="openshift-monitoring/telemeter-client-5776dd99b4-d8tzt"
Jul 28 16:52:42.775882 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:42.775740    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7-metrics-client-ca\") pod \"telemeter-client-5776dd99b4-d8tzt\" (UID: \"13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7\") " pod="openshift-monitoring/telemeter-client-5776dd99b4-d8tzt"
Jul 28 16:52:42.777458 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:42.777429    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5776dd99b4-d8tzt\" (UID: \"13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7\") " pod="openshift-monitoring/telemeter-client-5776dd99b4-d8tzt"
Jul 28 16:52:42.777634 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:42.777615    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7-federate-client-tls\") pod \"telemeter-client-5776dd99b4-d8tzt\" (UID: \"13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7\") " pod="openshift-monitoring/telemeter-client-5776dd99b4-d8tzt"
Jul 28 16:52:42.777684 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:42.777619    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7-secret-telemeter-client\") pod \"telemeter-client-5776dd99b4-d8tzt\" (UID: \"13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7\") " pod="openshift-monitoring/telemeter-client-5776dd99b4-d8tzt"
Jul 28 16:52:42.777890 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:42.777868    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7-telemeter-client-tls\") pod \"telemeter-client-5776dd99b4-d8tzt\" (UID: \"13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7\") " pod="openshift-monitoring/telemeter-client-5776dd99b4-d8tzt"
Jul 28 16:52:42.787747 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:42.787725    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stq8z\" (UniqueName: \"kubernetes.io/projected/13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7-kube-api-access-stq8z\") pod \"telemeter-client-5776dd99b4-d8tzt\" (UID: \"13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7\") " pod="openshift-monitoring/telemeter-client-5776dd99b4-d8tzt"
Jul 28 16:52:42.833365 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:42.833343    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5776dd99b4-d8tzt"
Jul 28 16:52:42.981769 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:42.981747    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5776dd99b4-d8tzt"]
Jul 28 16:52:42.983180 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:52:42.983150    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13c3fd52_0ffd_4126_a1f5_ad1e03ae28b7.slice/crio-8c0154485d6445322750fdfb9bd6445ac195acdf02358c6696b3ea1891e555b5 WatchSource:0}: Error finding container 8c0154485d6445322750fdfb9bd6445ac195acdf02358c6696b3ea1891e555b5: Status 404 returned error can't find the container with id 8c0154485d6445322750fdfb9bd6445ac195acdf02358c6696b3ea1891e555b5
Jul 28 16:52:43.834317 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:43.834264    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5776dd99b4-d8tzt" event={"ID":"13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7","Type":"ContainerStarted","Data":"8c0154485d6445322750fdfb9bd6445ac195acdf02358c6696b3ea1891e555b5"}
Jul 28 16:52:45.842585 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:45.842554    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5776dd99b4-d8tzt" event={"ID":"13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7","Type":"ContainerStarted","Data":"e8413e884f32489d44e66dff126666b50ee8bf4fe8c9a9429832bf772c107a10"}
Jul 28 16:52:46.849238 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:46.849202    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5776dd99b4-d8tzt" event={"ID":"13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7","Type":"ContainerStarted","Data":"5be3e96d70f732f1004c83a9492806ed8766843eaff6c637d8928e2a34f27833"}
Jul 28 16:52:46.849620 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:46.849265    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5776dd99b4-d8tzt" event={"ID":"13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7","Type":"ContainerStarted","Data":"3e4115813bb52399de8739aa406a9d85493aa3f5bb72cdf9e726d7f3b917620e"}
Jul 28 16:52:46.877381 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:46.877336    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5776dd99b4-d8tzt" podStartSLOduration=2.09043039 podStartE2EDuration="4.877320622s" totalImagesPullingTime="2.786890232s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:52:42 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:52:46.876014756 +0000 UTC m=+156.347428417" watchObservedRunningTime="2026-07-28 16:52:46.877320622 +0000 UTC m=+156.348734281"
Jul 28 16:52:48.515911 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:48.515877    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6bc694d6c7-dd2cm"]
Jul 28 16:52:48.518188 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:48.518171    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bc694d6c7-dd2cm"
Jul 28 16:52:48.533099 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:48.533078    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bc694d6c7-dd2cm"]
Jul 28 16:52:48.590720 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:48.590681    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:52:48.619562 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:48.619533    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/94d18705-9c74-4cba-af10-4567f24cd258-console-config\") pod \"console-6bc694d6c7-dd2cm\" (UID: \"94d18705-9c74-4cba-af10-4567f24cd258\") " pod="openshift-console/console-6bc694d6c7-dd2cm"
Jul 28 16:52:48.619647 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:48.619567    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/94d18705-9c74-4cba-af10-4567f24cd258-service-ca\") pod \"console-6bc694d6c7-dd2cm\" (UID: \"94d18705-9c74-4cba-af10-4567f24cd258\") " pod="openshift-console/console-6bc694d6c7-dd2cm"
Jul 28 16:52:48.619647 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:48.619587    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/94d18705-9c74-4cba-af10-4567f24cd258-oauth-serving-cert\") pod \"console-6bc694d6c7-dd2cm\" (UID: \"94d18705-9c74-4cba-af10-4567f24cd258\") " pod="openshift-console/console-6bc694d6c7-dd2cm"
Jul 28 16:52:48.619647 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:48.619609    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trcl4\" (UniqueName: \"kubernetes.io/projected/94d18705-9c74-4cba-af10-4567f24cd258-kube-api-access-trcl4\") pod \"console-6bc694d6c7-dd2cm\" (UID: \"94d18705-9c74-4cba-af10-4567f24cd258\") " pod="openshift-console/console-6bc694d6c7-dd2cm"
Jul 28 16:52:48.619647 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:48.619632    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/94d18705-9c74-4cba-af10-4567f24cd258-console-serving-cert\") pod \"console-6bc694d6c7-dd2cm\" (UID: \"94d18705-9c74-4cba-af10-4567f24cd258\") " pod="openshift-console/console-6bc694d6c7-dd2cm"
Jul 28 16:52:48.619791 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:48.619656    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/94d18705-9c74-4cba-af10-4567f24cd258-console-oauth-config\") pod \"console-6bc694d6c7-dd2cm\" (UID: \"94d18705-9c74-4cba-af10-4567f24cd258\") " pod="openshift-console/console-6bc694d6c7-dd2cm"
Jul 28 16:52:48.619791 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:48.619682    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94d18705-9c74-4cba-af10-4567f24cd258-trusted-ca-bundle\") pod \"console-6bc694d6c7-dd2cm\" (UID: \"94d18705-9c74-4cba-af10-4567f24cd258\") " pod="openshift-console/console-6bc694d6c7-dd2cm"
Jul 28 16:52:48.649794 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:48.649764    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:52:48.720994 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:48.720964    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/94d18705-9c74-4cba-af10-4567f24cd258-console-config\") pod \"console-6bc694d6c7-dd2cm\" (UID: \"94d18705-9c74-4cba-af10-4567f24cd258\") " pod="openshift-console/console-6bc694d6c7-dd2cm"
Jul 28 16:52:48.721082 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:48.720999    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/94d18705-9c74-4cba-af10-4567f24cd258-service-ca\") pod \"console-6bc694d6c7-dd2cm\" (UID: \"94d18705-9c74-4cba-af10-4567f24cd258\") " pod="openshift-console/console-6bc694d6c7-dd2cm"
Jul 28 16:52:48.721082 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:48.721019    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/94d18705-9c74-4cba-af10-4567f24cd258-oauth-serving-cert\") pod \"console-6bc694d6c7-dd2cm\" (UID: \"94d18705-9c74-4cba-af10-4567f24cd258\") " pod="openshift-console/console-6bc694d6c7-dd2cm"
Jul 28 16:52:48.721082 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:48.721051    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-trcl4\" (UniqueName: \"kubernetes.io/projected/94d18705-9c74-4cba-af10-4567f24cd258-kube-api-access-trcl4\") pod \"console-6bc694d6c7-dd2cm\" (UID: \"94d18705-9c74-4cba-af10-4567f24cd258\") " pod="openshift-console/console-6bc694d6c7-dd2cm"
Jul 28 16:52:48.721082 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:48.721076    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/94d18705-9c74-4cba-af10-4567f24cd258-console-serving-cert\") pod \"console-6bc694d6c7-dd2cm\" (UID: \"94d18705-9c74-4cba-af10-4567f24cd258\") " pod="openshift-console/console-6bc694d6c7-dd2cm"
Jul 28 16:52:48.721227 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:48.721114    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/94d18705-9c74-4cba-af10-4567f24cd258-console-oauth-config\") pod \"console-6bc694d6c7-dd2cm\" (UID: \"94d18705-9c74-4cba-af10-4567f24cd258\") " pod="openshift-console/console-6bc694d6c7-dd2cm"
Jul 28 16:52:48.721227 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:48.721171    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94d18705-9c74-4cba-af10-4567f24cd258-trusted-ca-bundle\") pod \"console-6bc694d6c7-dd2cm\" (UID: \"94d18705-9c74-4cba-af10-4567f24cd258\") " pod="openshift-console/console-6bc694d6c7-dd2cm"
Jul 28 16:52:48.721750 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:48.721728    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/94d18705-9c74-4cba-af10-4567f24cd258-oauth-serving-cert\") pod \"console-6bc694d6c7-dd2cm\" (UID: \"94d18705-9c74-4cba-af10-4567f24cd258\") " pod="openshift-console/console-6bc694d6c7-dd2cm"
Jul 28 16:52:48.721878 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:48.721861    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/94d18705-9c74-4cba-af10-4567f24cd258-service-ca\") pod \"console-6bc694d6c7-dd2cm\" (UID: \"94d18705-9c74-4cba-af10-4567f24cd258\") " pod="openshift-console/console-6bc694d6c7-dd2cm"
Jul 28 16:52:48.721995 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:48.721858    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/94d18705-9c74-4cba-af10-4567f24cd258-console-config\") pod \"console-6bc694d6c7-dd2cm\" (UID: \"94d18705-9c74-4cba-af10-4567f24cd258\") " pod="openshift-console/console-6bc694d6c7-dd2cm"
Jul 28 16:52:48.722238 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:48.722217    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94d18705-9c74-4cba-af10-4567f24cd258-trusted-ca-bundle\") pod \"console-6bc694d6c7-dd2cm\" (UID: \"94d18705-9c74-4cba-af10-4567f24cd258\") " pod="openshift-console/console-6bc694d6c7-dd2cm"
Jul 28 16:52:48.723620 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:48.723603    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/94d18705-9c74-4cba-af10-4567f24cd258-console-serving-cert\") pod \"console-6bc694d6c7-dd2cm\" (UID: \"94d18705-9c74-4cba-af10-4567f24cd258\") " pod="openshift-console/console-6bc694d6c7-dd2cm"
Jul 28 16:52:48.723791 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:48.723772    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/94d18705-9c74-4cba-af10-4567f24cd258-console-oauth-config\") pod \"console-6bc694d6c7-dd2cm\" (UID: \"94d18705-9c74-4cba-af10-4567f24cd258\") " pod="openshift-console/console-6bc694d6c7-dd2cm"
Jul 28 16:52:48.731211 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:48.731187    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-trcl4\" (UniqueName: \"kubernetes.io/projected/94d18705-9c74-4cba-af10-4567f24cd258-kube-api-access-trcl4\") pod \"console-6bc694d6c7-dd2cm\" (UID: \"94d18705-9c74-4cba-af10-4567f24cd258\") " pod="openshift-console/console-6bc694d6c7-dd2cm"
Jul 28 16:52:48.827578 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:48.827517    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bc694d6c7-dd2cm"
Jul 28 16:52:48.952916 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:48.952878    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bc694d6c7-dd2cm"]
Jul 28 16:52:48.954971 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:52:48.954945    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94d18705_9c74_4cba_af10_4567f24cd258.slice/crio-36944a25334ce0d2e4c8e488b0ef0b020aea93a02d67046514aebc0752742fb4 WatchSource:0}: Error finding container 36944a25334ce0d2e4c8e488b0ef0b020aea93a02d67046514aebc0752742fb4: Status 404 returned error can't find the container with id 36944a25334ce0d2e4c8e488b0ef0b020aea93a02d67046514aebc0752742fb4
Jul 28 16:52:49.868957 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:49.868911    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bc694d6c7-dd2cm" event={"ID":"94d18705-9c74-4cba-af10-4567f24cd258","Type":"ContainerStarted","Data":"2bb11b0bf4f80c9c65765a2013fdde443261e6b164539ac22d4decbeff4d5a61"}
Jul 28 16:52:49.869319 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:49.868972    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bc694d6c7-dd2cm" event={"ID":"94d18705-9c74-4cba-af10-4567f24cd258","Type":"ContainerStarted","Data":"36944a25334ce0d2e4c8e488b0ef0b020aea93a02d67046514aebc0752742fb4"}
Jul 28 16:52:49.890827 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:49.890780    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6bc694d6c7-dd2cm" podStartSLOduration=1.890766203 podStartE2EDuration="1.890766203s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:52:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:52:49.889899418 +0000 UTC m=+159.361313105" watchObservedRunningTime="2026-07-28 16:52:49.890766203 +0000 UTC m=+159.362179863"
Jul 28 16:52:52.661334 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:52.661289    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:52:52.758400 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:52.758370    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:52:54.752678 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:54.752643    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bc694d6c7-dd2cm"]
Jul 28 16:52:54.802389 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:54.802361    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56bdd6688f-24jfr"]
Jul 28 16:52:54.804613 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:54.804598    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56bdd6688f-24jfr"
Jul 28 16:52:54.822148 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:54.822123    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56bdd6688f-24jfr"]
Jul 28 16:52:54.967320 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:54.967292    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6fce490-92b7-4b0a-9821-cdebf3531138-oauth-serving-cert\") pod \"console-56bdd6688f-24jfr\" (UID: \"e6fce490-92b7-4b0a-9821-cdebf3531138\") " pod="openshift-console/console-56bdd6688f-24jfr"
Jul 28 16:52:54.967320 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:54.967326    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc296\" (UniqueName: \"kubernetes.io/projected/e6fce490-92b7-4b0a-9821-cdebf3531138-kube-api-access-wc296\") pod \"console-56bdd6688f-24jfr\" (UID: \"e6fce490-92b7-4b0a-9821-cdebf3531138\") " pod="openshift-console/console-56bdd6688f-24jfr"
Jul 28 16:52:54.967508 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:54.967342    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6fce490-92b7-4b0a-9821-cdebf3531138-trusted-ca-bundle\") pod \"console-56bdd6688f-24jfr\" (UID: \"e6fce490-92b7-4b0a-9821-cdebf3531138\") " pod="openshift-console/console-56bdd6688f-24jfr"
Jul 28 16:52:54.967508 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:54.967417    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6fce490-92b7-4b0a-9821-cdebf3531138-console-oauth-config\") pod \"console-56bdd6688f-24jfr\" (UID: \"e6fce490-92b7-4b0a-9821-cdebf3531138\") " pod="openshift-console/console-56bdd6688f-24jfr"
Jul 28 16:52:54.967508 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:54.967450    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6fce490-92b7-4b0a-9821-cdebf3531138-console-serving-cert\") pod \"console-56bdd6688f-24jfr\" (UID: \"e6fce490-92b7-4b0a-9821-cdebf3531138\") " pod="openshift-console/console-56bdd6688f-24jfr"
Jul 28 16:52:54.967508 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:54.967470    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6fce490-92b7-4b0a-9821-cdebf3531138-service-ca\") pod \"console-56bdd6688f-24jfr\" (UID: \"e6fce490-92b7-4b0a-9821-cdebf3531138\") " pod="openshift-console/console-56bdd6688f-24jfr"
Jul 28 16:52:54.967630 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:54.967505    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6fce490-92b7-4b0a-9821-cdebf3531138-console-config\") pod \"console-56bdd6688f-24jfr\" (UID: \"e6fce490-92b7-4b0a-9821-cdebf3531138\") " pod="openshift-console/console-56bdd6688f-24jfr"
Jul 28 16:52:55.068285 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:55.068216    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6fce490-92b7-4b0a-9821-cdebf3531138-console-serving-cert\") pod \"console-56bdd6688f-24jfr\" (UID: \"e6fce490-92b7-4b0a-9821-cdebf3531138\") " pod="openshift-console/console-56bdd6688f-24jfr"
Jul 28 16:52:55.068285 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:55.068246    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6fce490-92b7-4b0a-9821-cdebf3531138-service-ca\") pod \"console-56bdd6688f-24jfr\" (UID: \"e6fce490-92b7-4b0a-9821-cdebf3531138\") " pod="openshift-console/console-56bdd6688f-24jfr"
Jul 28 16:52:55.068285 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:55.068270    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6fce490-92b7-4b0a-9821-cdebf3531138-console-config\") pod \"console-56bdd6688f-24jfr\" (UID: \"e6fce490-92b7-4b0a-9821-cdebf3531138\") " pod="openshift-console/console-56bdd6688f-24jfr"
Jul 28 16:52:55.068461 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:55.068313    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6fce490-92b7-4b0a-9821-cdebf3531138-oauth-serving-cert\") pod \"console-56bdd6688f-24jfr\" (UID: \"e6fce490-92b7-4b0a-9821-cdebf3531138\") " pod="openshift-console/console-56bdd6688f-24jfr"
Jul 28 16:52:55.068461 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:55.068341    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wc296\" (UniqueName: \"kubernetes.io/projected/e6fce490-92b7-4b0a-9821-cdebf3531138-kube-api-access-wc296\") pod \"console-56bdd6688f-24jfr\" (UID: \"e6fce490-92b7-4b0a-9821-cdebf3531138\") " pod="openshift-console/console-56bdd6688f-24jfr"
Jul 28 16:52:55.068461 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:55.068367    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6fce490-92b7-4b0a-9821-cdebf3531138-trusted-ca-bundle\") pod \"console-56bdd6688f-24jfr\" (UID: \"e6fce490-92b7-4b0a-9821-cdebf3531138\") " pod="openshift-console/console-56bdd6688f-24jfr"
Jul 28 16:52:55.068461 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:55.068425    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6fce490-92b7-4b0a-9821-cdebf3531138-console-oauth-config\") pod \"console-56bdd6688f-24jfr\" (UID: \"e6fce490-92b7-4b0a-9821-cdebf3531138\") " pod="openshift-console/console-56bdd6688f-24jfr"
Jul 28 16:52:55.069049 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:55.069024    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6fce490-92b7-4b0a-9821-cdebf3531138-service-ca\") pod \"console-56bdd6688f-24jfr\" (UID: \"e6fce490-92b7-4b0a-9821-cdebf3531138\") " pod="openshift-console/console-56bdd6688f-24jfr"
Jul 28 16:52:55.069265 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:55.069233    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6fce490-92b7-4b0a-9821-cdebf3531138-trusted-ca-bundle\") pod \"console-56bdd6688f-24jfr\" (UID: \"e6fce490-92b7-4b0a-9821-cdebf3531138\") " pod="openshift-console/console-56bdd6688f-24jfr"
Jul 28 16:52:55.069327 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:55.069308    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6fce490-92b7-4b0a-9821-cdebf3531138-console-config\") pod \"console-56bdd6688f-24jfr\" (UID: \"e6fce490-92b7-4b0a-9821-cdebf3531138\") " pod="openshift-console/console-56bdd6688f-24jfr"
Jul 28 16:52:55.069365 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:55.069350    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6fce490-92b7-4b0a-9821-cdebf3531138-oauth-serving-cert\") pod \"console-56bdd6688f-24jfr\" (UID: \"e6fce490-92b7-4b0a-9821-cdebf3531138\") " pod="openshift-console/console-56bdd6688f-24jfr"
Jul 28 16:52:55.071074 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:55.071046    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6fce490-92b7-4b0a-9821-cdebf3531138-console-oauth-config\") pod \"console-56bdd6688f-24jfr\" (UID: \"e6fce490-92b7-4b0a-9821-cdebf3531138\") " pod="openshift-console/console-56bdd6688f-24jfr"
Jul 28 16:52:55.071074 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:55.071054    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6fce490-92b7-4b0a-9821-cdebf3531138-console-serving-cert\") pod \"console-56bdd6688f-24jfr\" (UID: \"e6fce490-92b7-4b0a-9821-cdebf3531138\") " pod="openshift-console/console-56bdd6688f-24jfr"
Jul 28 16:52:55.078189 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:55.078165    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc296\" (UniqueName: \"kubernetes.io/projected/e6fce490-92b7-4b0a-9821-cdebf3531138-kube-api-access-wc296\") pod \"console-56bdd6688f-24jfr\" (UID: \"e6fce490-92b7-4b0a-9821-cdebf3531138\") " pod="openshift-console/console-56bdd6688f-24jfr"
Jul 28 16:52:55.113834 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:55.113810    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56bdd6688f-24jfr"
Jul 28 16:52:55.241641 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:55.241616    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56bdd6688f-24jfr"]
Jul 28 16:52:55.243267 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:52:55.243238    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6fce490_92b7_4b0a_9821_cdebf3531138.slice/crio-880d5dd51d68996b058e040469b93f087e179429b5f7a017c57e17c040bc3574 WatchSource:0}: Error finding container 880d5dd51d68996b058e040469b93f087e179429b5f7a017c57e17c040bc3574: Status 404 returned error can't find the container with id 880d5dd51d68996b058e040469b93f087e179429b5f7a017c57e17c040bc3574
Jul 28 16:52:55.893584 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:55.893548    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56bdd6688f-24jfr" event={"ID":"e6fce490-92b7-4b0a-9821-cdebf3531138","Type":"ContainerStarted","Data":"7a76a477b0092ab389e88558e5dc76e92b5d19513b0617cc05f7f05dd4183ecd"}
Jul 28 16:52:55.894003 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:55.893623    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56bdd6688f-24jfr" event={"ID":"e6fce490-92b7-4b0a-9821-cdebf3531138","Type":"ContainerStarted","Data":"880d5dd51d68996b058e040469b93f087e179429b5f7a017c57e17c040bc3574"}
Jul 28 16:52:55.920583 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:55.920535    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56bdd6688f-24jfr" podStartSLOduration=1.920522542 podStartE2EDuration="1.920522542s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:52:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:52:55.919159357 +0000 UTC m=+165.390573031" watchObservedRunningTime="2026-07-28 16:52:55.920522542 +0000 UTC m=+165.391936202"
Jul 28 16:52:58.827982 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:52:58.827930    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6bc694d6c7-dd2cm"
Jul 28 16:53:04.637053 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:04.636927    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:53:04.709237 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:04.709206    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:53:05.114125 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:05.114095    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56bdd6688f-24jfr"
Jul 28 16:53:05.114295 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:05.114154    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56bdd6688f-24jfr"
Jul 28 16:53:05.118628 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:05.118612    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56bdd6688f-24jfr"
Jul 28 16:53:05.935745 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:05.935720    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56bdd6688f-24jfr"
Jul 28 16:53:05.983264 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:05.983208    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-657b69cf67-jnwpg"]
Jul 28 16:53:06.098872 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:06.098838    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:53:06.198870 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:06.198810    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:53:06.258397 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:06.258374    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:53:09.352118 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:09.352079    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:53:09.451969 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:09.451920    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:53:12.505199 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:12.505156    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:53:12.567655 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:12.567626    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:53:19.771625 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:19.771583    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6bc694d6c7-dd2cm" podUID="94d18705-9c74-4cba-af10-4567f24cd258" containerName="console" containerID="cri-o://2bb11b0bf4f80c9c65765a2013fdde443261e6b164539ac22d4decbeff4d5a61" gracePeriod=15
Jul 28 16:53:19.986529 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:19.986498    2561 generic.go:356] "Generic (PLEG): container finished" podID="94d18705-9c74-4cba-af10-4567f24cd258" containerID="2bb11b0bf4f80c9c65765a2013fdde443261e6b164539ac22d4decbeff4d5a61" exitCode=0
Jul 28 16:53:19.986683 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:19.986576    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bc694d6c7-dd2cm" event={"ID":"94d18705-9c74-4cba-af10-4567f24cd258","Type":"ContainerDied","Data":"2bb11b0bf4f80c9c65765a2013fdde443261e6b164539ac22d4decbeff4d5a61"}
Jul 28 16:53:20.015814 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:20.015791    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bc694d6c7-dd2cm"
Jul 28 16:53:20.057038 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:20.056962    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-trcl4\" (UniqueName: \"kubernetes.io/projected/94d18705-9c74-4cba-af10-4567f24cd258-kube-api-access-trcl4\") pod \"94d18705-9c74-4cba-af10-4567f24cd258\" (UID: \"94d18705-9c74-4cba-af10-4567f24cd258\") "
Jul 28 16:53:20.057038 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:20.056996    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/94d18705-9c74-4cba-af10-4567f24cd258-console-serving-cert\") pod \"94d18705-9c74-4cba-af10-4567f24cd258\" (UID: \"94d18705-9c74-4cba-af10-4567f24cd258\") "
Jul 28 16:53:20.057038 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:20.057021    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/94d18705-9c74-4cba-af10-4567f24cd258-console-oauth-config\") pod \"94d18705-9c74-4cba-af10-4567f24cd258\" (UID: \"94d18705-9c74-4cba-af10-4567f24cd258\") "
Jul 28 16:53:20.057318 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:20.057083    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/94d18705-9c74-4cba-af10-4567f24cd258-console-config\") pod \"94d18705-9c74-4cba-af10-4567f24cd258\" (UID: \"94d18705-9c74-4cba-af10-4567f24cd258\") "
Jul 28 16:53:20.057318 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:20.057104    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/94d18705-9c74-4cba-af10-4567f24cd258-oauth-serving-cert\") pod \"94d18705-9c74-4cba-af10-4567f24cd258\" (UID: \"94d18705-9c74-4cba-af10-4567f24cd258\") "
Jul 28 16:53:20.057318 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:20.057140    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94d18705-9c74-4cba-af10-4567f24cd258-trusted-ca-bundle\") pod \"94d18705-9c74-4cba-af10-4567f24cd258\" (UID: \"94d18705-9c74-4cba-af10-4567f24cd258\") "
Jul 28 16:53:20.057462 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:20.057446    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/94d18705-9c74-4cba-af10-4567f24cd258-service-ca\") pod \"94d18705-9c74-4cba-af10-4567f24cd258\" (UID: \"94d18705-9c74-4cba-af10-4567f24cd258\") "
Jul 28 16:53:20.057590 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:20.057542    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94d18705-9c74-4cba-af10-4567f24cd258-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "94d18705-9c74-4cba-af10-4567f24cd258" (UID: "94d18705-9c74-4cba-af10-4567f24cd258"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 16:53:20.057590 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:20.057553    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94d18705-9c74-4cba-af10-4567f24cd258-console-config" (OuterVolumeSpecName: "console-config") pod "94d18705-9c74-4cba-af10-4567f24cd258" (UID: "94d18705-9c74-4cba-af10-4567f24cd258"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 16:53:20.057590 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:20.057566    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94d18705-9c74-4cba-af10-4567f24cd258-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "94d18705-9c74-4cba-af10-4567f24cd258" (UID: "94d18705-9c74-4cba-af10-4567f24cd258"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 16:53:20.058106 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:20.057740    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/94d18705-9c74-4cba-af10-4567f24cd258-console-config\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 16:53:20.058106 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:20.057764    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/94d18705-9c74-4cba-af10-4567f24cd258-oauth-serving-cert\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 16:53:20.058106 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:20.057780    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/94d18705-9c74-4cba-af10-4567f24cd258-trusted-ca-bundle\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 16:53:20.058106 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:20.057915    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94d18705-9c74-4cba-af10-4567f24cd258-service-ca" (OuterVolumeSpecName: "service-ca") pod "94d18705-9c74-4cba-af10-4567f24cd258" (UID: "94d18705-9c74-4cba-af10-4567f24cd258"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 16:53:20.059380 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:20.059361    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94d18705-9c74-4cba-af10-4567f24cd258-kube-api-access-trcl4" (OuterVolumeSpecName: "kube-api-access-trcl4") pod "94d18705-9c74-4cba-af10-4567f24cd258" (UID: "94d18705-9c74-4cba-af10-4567f24cd258"). InnerVolumeSpecName "kube-api-access-trcl4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 16:53:20.059480 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:20.059401    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94d18705-9c74-4cba-af10-4567f24cd258-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "94d18705-9c74-4cba-af10-4567f24cd258" (UID: "94d18705-9c74-4cba-af10-4567f24cd258"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 16:53:20.059531 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:20.059474    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/94d18705-9c74-4cba-af10-4567f24cd258-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "94d18705-9c74-4cba-af10-4567f24cd258" (UID: "94d18705-9c74-4cba-af10-4567f24cd258"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 16:53:20.158755 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:20.158712    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/94d18705-9c74-4cba-af10-4567f24cd258-service-ca\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 16:53:20.158755 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:20.158745    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trcl4\" (UniqueName: \"kubernetes.io/projected/94d18705-9c74-4cba-af10-4567f24cd258-kube-api-access-trcl4\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 16:53:20.158755 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:20.158762    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/94d18705-9c74-4cba-af10-4567f24cd258-console-serving-cert\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 16:53:20.159030 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:20.158774    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/94d18705-9c74-4cba-af10-4567f24cd258-console-oauth-config\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 16:53:20.991163 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:20.991130    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bc694d6c7-dd2cm"
Jul 28 16:53:20.991163 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:20.991146    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bc694d6c7-dd2cm" event={"ID":"94d18705-9c74-4cba-af10-4567f24cd258","Type":"ContainerDied","Data":"36944a25334ce0d2e4c8e488b0ef0b020aea93a02d67046514aebc0752742fb4"}
Jul 28 16:53:20.991721 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:20.991219    2561 scope.go:117] "RemoveContainer" containerID="2bb11b0bf4f80c9c65765a2013fdde443261e6b164539ac22d4decbeff4d5a61"
Jul 28 16:53:21.015326 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:21.015297    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bc694d6c7-dd2cm"]
Jul 28 16:53:21.020609 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:21.020586    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6bc694d6c7-dd2cm"]
Jul 28 16:53:21.078361 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:21.075845    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94d18705-9c74-4cba-af10-4567f24cd258" path="/var/lib/kubelet/pods/94d18705-9c74-4cba-af10-4567f24cd258/volumes"
Jul 28 16:53:31.002452 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:31.002394    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-657b69cf67-jnwpg" podUID="1f414689-5a17-42b1-9308-3f4d6aa4bcf4" containerName="console" containerID="cri-o://c966f85b3cad75f871a0a0719be7d97df493c68003793549908d260060511723" gracePeriod=15
Jul 28 16:53:31.245650 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:31.245622    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-657b69cf67-jnwpg"
Jul 28 16:53:31.342101 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:31.342023    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f414689-5a17-42b1-9308-3f4d6aa4bcf4-trusted-ca-bundle\") pod \"1f414689-5a17-42b1-9308-3f4d6aa4bcf4\" (UID: \"1f414689-5a17-42b1-9308-3f4d6aa4bcf4\") "
Jul 28 16:53:31.342101 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:31.342058    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f414689-5a17-42b1-9308-3f4d6aa4bcf4-oauth-serving-cert\") pod \"1f414689-5a17-42b1-9308-3f4d6aa4bcf4\" (UID: \"1f414689-5a17-42b1-9308-3f4d6aa4bcf4\") "
Jul 28 16:53:31.342101 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:31.342088    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f414689-5a17-42b1-9308-3f4d6aa4bcf4-console-serving-cert\") pod \"1f414689-5a17-42b1-9308-3f4d6aa4bcf4\" (UID: \"1f414689-5a17-42b1-9308-3f4d6aa4bcf4\") "
Jul 28 16:53:31.342356 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:31.342122    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f414689-5a17-42b1-9308-3f4d6aa4bcf4-service-ca\") pod \"1f414689-5a17-42b1-9308-3f4d6aa4bcf4\" (UID: \"1f414689-5a17-42b1-9308-3f4d6aa4bcf4\") "
Jul 28 16:53:31.342356 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:31.342155    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f414689-5a17-42b1-9308-3f4d6aa4bcf4-console-oauth-config\") pod \"1f414689-5a17-42b1-9308-3f4d6aa4bcf4\" (UID: \"1f414689-5a17-42b1-9308-3f4d6aa4bcf4\") "
Jul 28 16:53:31.342356 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:31.342190    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f414689-5a17-42b1-9308-3f4d6aa4bcf4-console-config\") pod \"1f414689-5a17-42b1-9308-3f4d6aa4bcf4\" (UID: \"1f414689-5a17-42b1-9308-3f4d6aa4bcf4\") "
Jul 28 16:53:31.342356 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:31.342245    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kcbnf\" (UniqueName: \"kubernetes.io/projected/1f414689-5a17-42b1-9308-3f4d6aa4bcf4-kube-api-access-kcbnf\") pod \"1f414689-5a17-42b1-9308-3f4d6aa4bcf4\" (UID: \"1f414689-5a17-42b1-9308-3f4d6aa4bcf4\") "
Jul 28 16:53:31.342568 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:31.342551    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f414689-5a17-42b1-9308-3f4d6aa4bcf4-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1f414689-5a17-42b1-9308-3f4d6aa4bcf4" (UID: "1f414689-5a17-42b1-9308-3f4d6aa4bcf4"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 16:53:31.342704 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:31.342679    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f414689-5a17-42b1-9308-3f4d6aa4bcf4-console-config" (OuterVolumeSpecName: "console-config") pod "1f414689-5a17-42b1-9308-3f4d6aa4bcf4" (UID: "1f414689-5a17-42b1-9308-3f4d6aa4bcf4"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 16:53:31.342765 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:31.342685    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f414689-5a17-42b1-9308-3f4d6aa4bcf4-service-ca" (OuterVolumeSpecName: "service-ca") pod "1f414689-5a17-42b1-9308-3f4d6aa4bcf4" (UID: "1f414689-5a17-42b1-9308-3f4d6aa4bcf4"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 16:53:31.342765 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:31.342509    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f414689-5a17-42b1-9308-3f4d6aa4bcf4-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1f414689-5a17-42b1-9308-3f4d6aa4bcf4" (UID: "1f414689-5a17-42b1-9308-3f4d6aa4bcf4"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 16:53:31.344385 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:31.344365    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f414689-5a17-42b1-9308-3f4d6aa4bcf4-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1f414689-5a17-42b1-9308-3f4d6aa4bcf4" (UID: "1f414689-5a17-42b1-9308-3f4d6aa4bcf4"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 16:53:31.344511 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:31.344492    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f414689-5a17-42b1-9308-3f4d6aa4bcf4-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1f414689-5a17-42b1-9308-3f4d6aa4bcf4" (UID: "1f414689-5a17-42b1-9308-3f4d6aa4bcf4"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 16:53:31.344600 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:31.344583    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f414689-5a17-42b1-9308-3f4d6aa4bcf4-kube-api-access-kcbnf" (OuterVolumeSpecName: "kube-api-access-kcbnf") pod "1f414689-5a17-42b1-9308-3f4d6aa4bcf4" (UID: "1f414689-5a17-42b1-9308-3f4d6aa4bcf4"). InnerVolumeSpecName "kube-api-access-kcbnf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 16:53:31.443463 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:31.443426    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kcbnf\" (UniqueName: \"kubernetes.io/projected/1f414689-5a17-42b1-9308-3f4d6aa4bcf4-kube-api-access-kcbnf\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 16:53:31.443463 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:31.443459    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f414689-5a17-42b1-9308-3f4d6aa4bcf4-trusted-ca-bundle\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 16:53:31.443463 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:31.443468    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f414689-5a17-42b1-9308-3f4d6aa4bcf4-oauth-serving-cert\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 16:53:31.443631 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:31.443476    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f414689-5a17-42b1-9308-3f4d6aa4bcf4-console-serving-cert\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 16:53:31.443631 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:31.443485    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f414689-5a17-42b1-9308-3f4d6aa4bcf4-service-ca\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 16:53:31.443631 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:31.443495    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f414689-5a17-42b1-9308-3f4d6aa4bcf4-console-oauth-config\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 16:53:31.443631 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:31.443504    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f414689-5a17-42b1-9308-3f4d6aa4bcf4-console-config\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 16:53:32.032014 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:32.031979    2561 generic.go:356] "Generic (PLEG): container finished" podID="1f414689-5a17-42b1-9308-3f4d6aa4bcf4" containerID="c966f85b3cad75f871a0a0719be7d97df493c68003793549908d260060511723" exitCode=0
Jul 28 16:53:32.032014 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:32.032021    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-657b69cf67-jnwpg"
Jul 28 16:53:32.032486 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:32.032065    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-657b69cf67-jnwpg" event={"ID":"1f414689-5a17-42b1-9308-3f4d6aa4bcf4","Type":"ContainerDied","Data":"c966f85b3cad75f871a0a0719be7d97df493c68003793549908d260060511723"}
Jul 28 16:53:32.032486 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:32.032115    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-657b69cf67-jnwpg" event={"ID":"1f414689-5a17-42b1-9308-3f4d6aa4bcf4","Type":"ContainerDied","Data":"88abbcea97c76137376f8dece104a691fab43509f686ce918be3863b36d3bb41"}
Jul 28 16:53:32.032486 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:32.032136    2561 scope.go:117] "RemoveContainer" containerID="c966f85b3cad75f871a0a0719be7d97df493c68003793549908d260060511723"
Jul 28 16:53:32.041145 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:32.041130    2561 scope.go:117] "RemoveContainer" containerID="c966f85b3cad75f871a0a0719be7d97df493c68003793549908d260060511723"
Jul 28 16:53:32.041427 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:53:32.041409    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c966f85b3cad75f871a0a0719be7d97df493c68003793549908d260060511723\": container with ID starting with c966f85b3cad75f871a0a0719be7d97df493c68003793549908d260060511723 not found: ID does not exist" containerID="c966f85b3cad75f871a0a0719be7d97df493c68003793549908d260060511723"
Jul 28 16:53:32.041478 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:32.041436    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c966f85b3cad75f871a0a0719be7d97df493c68003793549908d260060511723"} err="failed to get container status \"c966f85b3cad75f871a0a0719be7d97df493c68003793549908d260060511723\": rpc error: code = NotFound desc = could not find container \"c966f85b3cad75f871a0a0719be7d97df493c68003793549908d260060511723\": container with ID starting with c966f85b3cad75f871a0a0719be7d97df493c68003793549908d260060511723 not found: ID does not exist"
Jul 28 16:53:32.056015 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:32.055993    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-657b69cf67-jnwpg"]
Jul 28 16:53:32.058245 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:32.058223    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-657b69cf67-jnwpg"]
Jul 28 16:53:33.074217 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:53:33.074186    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f414689-5a17-42b1-9308-3f4d6aa4bcf4" path="/var/lib/kubelet/pods/1f414689-5a17-42b1-9308-3f4d6aa4bcf4/volumes"
Jul 28 16:54:32.226312 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:54:32.226233    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:54:34.512363 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:54:34.512293    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:55:10.902368 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:10.902342    2561 kubelet.go:1648] "Image garbage collection succeeded"
Jul 28 16:55:12.258999 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:12.258966    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:55:13.136524 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:13.136490    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7b7db985fb-sxkpr"]
Jul 28 16:55:13.136765 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:13.136753    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f414689-5a17-42b1-9308-3f4d6aa4bcf4" containerName="console"
Jul 28 16:55:13.136831 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:13.136767    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f414689-5a17-42b1-9308-3f4d6aa4bcf4" containerName="console"
Jul 28 16:55:13.136831 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:13.136779    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94d18705-9c74-4cba-af10-4567f24cd258" containerName="console"
Jul 28 16:55:13.136831 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:13.136784    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="94d18705-9c74-4cba-af10-4567f24cd258" containerName="console"
Jul 28 16:55:13.136919 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:13.136839    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f414689-5a17-42b1-9308-3f4d6aa4bcf4" containerName="console"
Jul 28 16:55:13.136919 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:13.136846    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="94d18705-9c74-4cba-af10-4567f24cd258" containerName="console"
Jul 28 16:55:13.139548 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:13.139533    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7b7db985fb-sxkpr"
Jul 28 16:55:13.142452 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:13.142430    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
Jul 28 16:55:13.142452 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:13.142444    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
Jul 28 16:55:13.142601 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:13.142442    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-tg2nk\""
Jul 28 16:55:13.157061 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:13.157039    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7b7db985fb-sxkpr"]
Jul 28 16:55:13.246740 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:13.246717    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgcws\" (UniqueName: \"kubernetes.io/projected/41b4d2c6-ccf8-4710-a1d5-f2c2cbd5b4c2-kube-api-access-tgcws\") pod \"feast-operator-controller-manager-7b7db985fb-sxkpr\" (UID: \"41b4d2c6-ccf8-4710-a1d5-f2c2cbd5b4c2\") " pod="feast-operator-system/feast-operator-controller-manager-7b7db985fb-sxkpr"
Jul 28 16:55:13.347341 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:13.347312    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgcws\" (UniqueName: \"kubernetes.io/projected/41b4d2c6-ccf8-4710-a1d5-f2c2cbd5b4c2-kube-api-access-tgcws\") pod \"feast-operator-controller-manager-7b7db985fb-sxkpr\" (UID: \"41b4d2c6-ccf8-4710-a1d5-f2c2cbd5b4c2\") " pod="feast-operator-system/feast-operator-controller-manager-7b7db985fb-sxkpr"
Jul 28 16:55:13.357677 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:13.357652    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgcws\" (UniqueName: \"kubernetes.io/projected/41b4d2c6-ccf8-4710-a1d5-f2c2cbd5b4c2-kube-api-access-tgcws\") pod \"feast-operator-controller-manager-7b7db985fb-sxkpr\" (UID: \"41b4d2c6-ccf8-4710-a1d5-f2c2cbd5b4c2\") " pod="feast-operator-system/feast-operator-controller-manager-7b7db985fb-sxkpr"
Jul 28 16:55:13.449529 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:13.449439    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7b7db985fb-sxkpr"
Jul 28 16:55:13.575977 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:13.575929    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7b7db985fb-sxkpr"]
Jul 28 16:55:13.579017 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:55:13.578989    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41b4d2c6_ccf8_4710_a1d5_f2c2cbd5b4c2.slice/crio-bb9fed872591ed66ca7477eef6ee406a760248d9b5e577113a6d43edcce28d28 WatchSource:0}: Error finding container bb9fed872591ed66ca7477eef6ee406a760248d9b5e577113a6d43edcce28d28: Status 404 returned error can't find the container with id bb9fed872591ed66ca7477eef6ee406a760248d9b5e577113a6d43edcce28d28
Jul 28 16:55:13.580884 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:13.580868    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 16:55:14.147414 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:14.147365    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:55:14.393703 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:14.393661    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7b7db985fb-sxkpr" event={"ID":"41b4d2c6-ccf8-4710-a1d5-f2c2cbd5b4c2","Type":"ContainerStarted","Data":"bb9fed872591ed66ca7477eef6ee406a760248d9b5e577113a6d43edcce28d28"}
Jul 28 16:55:16.403385 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:16.403345    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7b7db985fb-sxkpr" event={"ID":"41b4d2c6-ccf8-4710-a1d5-f2c2cbd5b4c2","Type":"ContainerStarted","Data":"0c5a4c1416dfe4fedb307fe4e34710f596154aedc80caed4f2268dd8888de9dc"}
Jul 28 16:55:16.403784 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:16.403498    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-7b7db985fb-sxkpr"
Jul 28 16:55:16.423646 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:16.423605    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-7b7db985fb-sxkpr" podStartSLOduration=1.117859307 podStartE2EDuration="3.423593002s" totalImagesPullingTime="2.305733695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:55:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:55:16.423006992 +0000 UTC m=+305.894420651" watchObservedRunningTime="2026-07-28 16:55:16.423593002 +0000 UTC m=+305.895006662"
Jul 28 16:55:27.409730 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:27.409694    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-7b7db985fb-sxkpr"
Jul 28 16:55:41.392888 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:41.392853    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:55:41.457112 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:41.457080    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:55:50.940521 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:50.940482    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:55:51.042033 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:51.041990    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:55:51.274766 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:51.274736    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:55:51.376137 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:51.376095    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:55:51.420087 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:51.420054    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m"]
Jul 28 16:55:51.428372 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:51.428346    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m"
Jul 28 16:55:51.430986 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:51.430964    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/398f3a66-df04-4187-a9ba-b9facd365764-offline-tls\") pod \"feast-simple-feast-setup-56cb884f74-m6t7m\" (UID: \"398f3a66-df04-4187-a9ba-b9facd365764\") " pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m"
Jul 28 16:55:51.431096 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:51.430992    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxd7k\" (UniqueName: \"kubernetes.io/projected/398f3a66-df04-4187-a9ba-b9facd365764-kube-api-access-vxd7k\") pod \"feast-simple-feast-setup-56cb884f74-m6t7m\" (UID: \"398f3a66-df04-4187-a9ba-b9facd365764\") " pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m"
Jul 28 16:55:51.431096 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:51.431016    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/398f3a66-df04-4187-a9ba-b9facd365764-registry-tls\") pod \"feast-simple-feast-setup-56cb884f74-m6t7m\" (UID: \"398f3a66-df04-4187-a9ba-b9facd365764\") " pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m"
Jul 28 16:55:51.431096 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:51.431069    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/398f3a66-df04-4187-a9ba-b9facd365764-online-tls\") pod \"feast-simple-feast-setup-56cb884f74-m6t7m\" (UID: \"398f3a66-df04-4187-a9ba-b9facd365764\") " pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m"
Jul 28 16:55:51.431096 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:51.431086    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/398f3a66-df04-4187-a9ba-b9facd365764-ui-tls\") pod \"feast-simple-feast-setup-56cb884f74-m6t7m\" (UID: \"398f3a66-df04-4187-a9ba-b9facd365764\") " pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m"
Jul 28 16:55:51.431259 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:51.431100    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/398f3a66-df04-4187-a9ba-b9facd365764-feast-data\") pod \"feast-simple-feast-setup-56cb884f74-m6t7m\" (UID: \"398f3a66-df04-4187-a9ba-b9facd365764\") " pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m"
Jul 28 16:55:51.431313 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:51.431285    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Jul 28 16:55:51.431313 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:51.431297    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Jul 28 16:55:51.431458 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:51.431440    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Jul 28 16:55:51.431907 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:51.431890    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-xjmh4\""
Jul 28 16:55:51.432081 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:51.432063    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Jul 28 16:55:51.432156 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:51.432142    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Jul 28 16:55:51.432212 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:51.432174    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Jul 28 16:55:51.432507 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:51.432493    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
Jul 28 16:55:51.437505 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:51.437487    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m"]
Jul 28 16:55:51.532015 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:51.531963    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/398f3a66-df04-4187-a9ba-b9facd365764-offline-tls\") pod \"feast-simple-feast-setup-56cb884f74-m6t7m\" (UID: \"398f3a66-df04-4187-a9ba-b9facd365764\") " pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m"
Jul 28 16:55:51.532015 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:51.531990    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxd7k\" (UniqueName: \"kubernetes.io/projected/398f3a66-df04-4187-a9ba-b9facd365764-kube-api-access-vxd7k\") pod \"feast-simple-feast-setup-56cb884f74-m6t7m\" (UID: \"398f3a66-df04-4187-a9ba-b9facd365764\") " pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m"
Jul 28 16:55:51.532015 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:51.532008    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/398f3a66-df04-4187-a9ba-b9facd365764-registry-tls\") pod \"feast-simple-feast-setup-56cb884f74-m6t7m\" (UID: \"398f3a66-df04-4187-a9ba-b9facd365764\") " pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m"
Jul 28 16:55:51.532230 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:51.532037    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/398f3a66-df04-4187-a9ba-b9facd365764-online-tls\") pod \"feast-simple-feast-setup-56cb884f74-m6t7m\" (UID: \"398f3a66-df04-4187-a9ba-b9facd365764\") " pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m"
Jul 28 16:55:51.532230 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:51.532065    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/398f3a66-df04-4187-a9ba-b9facd365764-ui-tls\") pod \"feast-simple-feast-setup-56cb884f74-m6t7m\" (UID: \"398f3a66-df04-4187-a9ba-b9facd365764\") " pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m"
Jul 28 16:55:51.532230 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:51.532088    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/398f3a66-df04-4187-a9ba-b9facd365764-feast-data\") pod \"feast-simple-feast-setup-56cb884f74-m6t7m\" (UID: \"398f3a66-df04-4187-a9ba-b9facd365764\") " pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m"
Jul 28 16:55:51.532230 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:55:51.532090    2561 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found
Jul 28 16:55:51.532230 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:55:51.532193    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/398f3a66-df04-4187-a9ba-b9facd365764-offline-tls podName:398f3a66-df04-4187-a9ba-b9facd365764 nodeName:}" failed. No retries permitted until 2026-07-28 16:55:52.032172794 +0000 UTC m=+341.503586450 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/398f3a66-df04-4187-a9ba-b9facd365764-offline-tls") pod "feast-simple-feast-setup-56cb884f74-m6t7m" (UID: "398f3a66-df04-4187-a9ba-b9facd365764") : secret "feast-simple-feast-setup-offline-tls" not found
Jul 28 16:55:51.532230 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:55:51.532209    2561 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Jul 28 16:55:51.532486 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:55:51.532132    2561 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
Jul 28 16:55:51.532486 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:55:51.532302    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/398f3a66-df04-4187-a9ba-b9facd365764-online-tls podName:398f3a66-df04-4187-a9ba-b9facd365764 nodeName:}" failed. No retries permitted until 2026-07-28 16:55:52.032281588 +0000 UTC m=+341.503695227 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/398f3a66-df04-4187-a9ba-b9facd365764-online-tls") pod "feast-simple-feast-setup-56cb884f74-m6t7m" (UID: "398f3a66-df04-4187-a9ba-b9facd365764") : secret "feast-simple-feast-setup-online-tls" not found
Jul 28 16:55:51.532486 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:55:51.532340    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/398f3a66-df04-4187-a9ba-b9facd365764-ui-tls podName:398f3a66-df04-4187-a9ba-b9facd365764 nodeName:}" failed. No retries permitted until 2026-07-28 16:55:52.032322115 +0000 UTC m=+341.503735768 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/398f3a66-df04-4187-a9ba-b9facd365764-ui-tls") pod "feast-simple-feast-setup-56cb884f74-m6t7m" (UID: "398f3a66-df04-4187-a9ba-b9facd365764") : secret "feast-simple-feast-setup-ui-tls" not found
Jul 28 16:55:51.532486 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:51.532471    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/398f3a66-df04-4187-a9ba-b9facd365764-feast-data\") pod \"feast-simple-feast-setup-56cb884f74-m6t7m\" (UID: \"398f3a66-df04-4187-a9ba-b9facd365764\") " pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m"
Jul 28 16:55:51.534519 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:51.534491    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/398f3a66-df04-4187-a9ba-b9facd365764-registry-tls\") pod \"feast-simple-feast-setup-56cb884f74-m6t7m\" (UID: \"398f3a66-df04-4187-a9ba-b9facd365764\") " pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m"
Jul 28 16:55:51.536870 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:51.536841    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:55:51.541258 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:51.541237    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxd7k\" (UniqueName: \"kubernetes.io/projected/398f3a66-df04-4187-a9ba-b9facd365764-kube-api-access-vxd7k\") pod \"feast-simple-feast-setup-56cb884f74-m6t7m\" (UID: \"398f3a66-df04-4187-a9ba-b9facd365764\") " pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m"
Jul 28 16:55:51.781961 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:51.781911    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:55:51.884617 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:51.884522    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:55:51.985912 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:51.985885    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:55:52.035048 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:52.035019    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/398f3a66-df04-4187-a9ba-b9facd365764-online-tls\") pod \"feast-simple-feast-setup-56cb884f74-m6t7m\" (UID: \"398f3a66-df04-4187-a9ba-b9facd365764\") " pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m"
Jul 28 16:55:52.035194 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:52.035059    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/398f3a66-df04-4187-a9ba-b9facd365764-ui-tls\") pod \"feast-simple-feast-setup-56cb884f74-m6t7m\" (UID: \"398f3a66-df04-4187-a9ba-b9facd365764\") " pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m"
Jul 28 16:55:52.035194 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:52.035156    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/398f3a66-df04-4187-a9ba-b9facd365764-offline-tls\") pod \"feast-simple-feast-setup-56cb884f74-m6t7m\" (UID: \"398f3a66-df04-4187-a9ba-b9facd365764\") " pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m"
Jul 28 16:55:52.037517 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:52.037494    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/398f3a66-df04-4187-a9ba-b9facd365764-offline-tls\") pod \"feast-simple-feast-setup-56cb884f74-m6t7m\" (UID: \"398f3a66-df04-4187-a9ba-b9facd365764\") " pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m"
Jul 28 16:55:52.037608 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:52.037540    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/398f3a66-df04-4187-a9ba-b9facd365764-online-tls\") pod \"feast-simple-feast-setup-56cb884f74-m6t7m\" (UID: \"398f3a66-df04-4187-a9ba-b9facd365764\") " pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m"
Jul 28 16:55:52.037646 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:52.037606    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/398f3a66-df04-4187-a9ba-b9facd365764-ui-tls\") pod \"feast-simple-feast-setup-56cb884f74-m6t7m\" (UID: \"398f3a66-df04-4187-a9ba-b9facd365764\") " pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m"
Jul 28 16:55:52.050576 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:52.050556    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m"
Jul 28 16:55:52.184242 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:52.184206    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m"]
Jul 28 16:55:52.186797 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:55:52.186769    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod398f3a66_df04_4187_a9ba_b9facd365764.slice/crio-f4f53d22b350c0f83dc5314cc5bbf2ec47d9a7a58548e6075ebb435d95297b33 WatchSource:0}: Error finding container f4f53d22b350c0f83dc5314cc5bbf2ec47d9a7a58548e6075ebb435d95297b33: Status 404 returned error can't find the container with id f4f53d22b350c0f83dc5314cc5bbf2ec47d9a7a58548e6075ebb435d95297b33
Jul 28 16:55:52.537794 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:55:52.537765    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m" event={"ID":"398f3a66-df04-4187-a9ba-b9facd365764","Type":"ContainerStarted","Data":"f4f53d22b350c0f83dc5314cc5bbf2ec47d9a7a58548e6075ebb435d95297b33"}
Jul 28 16:56:10.348822 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:56:10.348676    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:56:18.649327 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:56:18.649287    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m" event={"ID":"398f3a66-df04-4187-a9ba-b9facd365764","Type":"ContainerStarted","Data":"21c63077be63576b347adf7d097470fdaeb663393d5b34984982570685b7b35b"}
Jul 28 16:56:23.670105 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:56:23.670067    2561 generic.go:356] "Generic (PLEG): container finished" podID="398f3a66-df04-4187-a9ba-b9facd365764" containerID="21c63077be63576b347adf7d097470fdaeb663393d5b34984982570685b7b35b" exitCode=0
Jul 28 16:56:23.670655 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:56:23.670139    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m" event={"ID":"398f3a66-df04-4187-a9ba-b9facd365764","Type":"ContainerDied","Data":"21c63077be63576b347adf7d097470fdaeb663393d5b34984982570685b7b35b"}
Jul 28 16:56:24.675444 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:56:24.675401    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m" event={"ID":"398f3a66-df04-4187-a9ba-b9facd365764","Type":"ContainerStarted","Data":"c52886cf40b9b4ec7bd334681b2fc52e050b969b0f7e7c2ce9f761a38be1f513"}
Jul 28 16:56:29.695691 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:56:29.695598    2561 generic.go:356] "Generic (PLEG): container finished" podID="398f3a66-df04-4187-a9ba-b9facd365764" containerID="c52886cf40b9b4ec7bd334681b2fc52e050b969b0f7e7c2ce9f761a38be1f513" exitCode=0
Jul 28 16:56:29.695691 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:56:29.695661    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m" event={"ID":"398f3a66-df04-4187-a9ba-b9facd365764","Type":"ContainerDied","Data":"c52886cf40b9b4ec7bd334681b2fc52e050b969b0f7e7c2ce9f761a38be1f513"}
Jul 28 16:56:29.707346 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:56:29.707322    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
Jul 28 16:56:30.706018 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:56:30.705978    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m" event={"ID":"398f3a66-df04-4187-a9ba-b9facd365764","Type":"ContainerStarted","Data":"25980e4e2a66b97afd6a4864f9d40cdc45a41bbf8e50c21097d914f9528c216a"}
Jul 28 16:56:30.706465 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:56:30.706048    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m" event={"ID":"398f3a66-df04-4187-a9ba-b9facd365764","Type":"ContainerStarted","Data":"351b88e6ed728f51ad40ba758cae073c0769f9b205c522101192d1682cd308eb"}
Jul 28 16:56:30.706465 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:56:30.706072    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m" event={"ID":"398f3a66-df04-4187-a9ba-b9facd365764","Type":"ContainerStarted","Data":"edcf86c32b2124f7f0f681781d736d56b55e4dce1abb4d95a47fae6d621319b7"}
Jul 28 16:56:30.706465 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:56:30.706092    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m" event={"ID":"398f3a66-df04-4187-a9ba-b9facd365764","Type":"ContainerStarted","Data":"3268ce03c4a1f88d3f821e8ff303accc96e31f98cf34273ac7235cd637de0a81"}
Jul 28 16:56:30.737021 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:56:30.736927    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m" podStartSLOduration=13.831176475 podStartE2EDuration="39.736902946s" totalImagesPullingTime="25.905726471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:55:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:56:30.734794613 +0000 UTC m=+380.206208300" watchObservedRunningTime="2026-07-28 16:56:30.736902946 +0000 UTC m=+380.208316607"
Jul 28 16:56:31.050864 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:56:31.050835    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m"
Jul 28 16:56:31.051537 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:56:31.051519    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m"
Jul 28 16:56:31.051685 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:56:31.051672    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m"
Jul 28 16:56:31.051794 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:56:31.051781    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m"
Jul 28 16:56:31.052406 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:56:31.052351    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m" podUID="398f3a66-df04-4187-a9ba-b9facd365764" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.21:6571: connect: connection refused"
Jul 28 16:56:31.052558 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:56:31.052536    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m" podUID="398f3a66-df04-4187-a9ba-b9facd365764" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.21:8443: connect: connection refused"
Jul 28 16:56:31.052703 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:56:31.052368    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m" podUID="398f3a66-df04-4187-a9ba-b9facd365764" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.21:8816: connect: connection refused"
Jul 28 16:56:31.052817 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:56:31.052745    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m" podUID="398f3a66-df04-4187-a9ba-b9facd365764" containerName="online" probeResult="failure" output="Get \"https://10.134.0.21:6567/health\": dial tcp 10.134.0.21:6567: connect: connection refused"
Jul 28 16:56:32.050671 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:56:32.050625    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m"
Jul 28 16:56:32.051167 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:56:32.050691    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m"
Jul 28 16:56:32.051167 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:56:32.050719    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m"
Jul 28 16:56:32.051167 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:56:32.050742    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m"
Jul 28 16:56:34.051346 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:56:34.051299    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m" podUID="398f3a66-df04-4187-a9ba-b9facd365764" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.21:8443: connect: connection refused"
Jul 28 16:56:34.051973 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:56:34.051314    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m" podUID="398f3a66-df04-4187-a9ba-b9facd365764" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.21:8816: connect: connection refused"
Jul 28 16:56:34.051973 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:56:34.051338    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m" podUID="398f3a66-df04-4187-a9ba-b9facd365764" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.21:6571: connect: connection refused"
Jul 28 16:56:34.052180 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:56:34.051353    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m" podUID="398f3a66-df04-4187-a9ba-b9facd365764" containerName="online" probeResult="failure" output="Get \"https://10.134.0.21:6567/health\": dial tcp 10.134.0.21:6567: connect: connection refused"
Jul 28 16:56:37.052683 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:56:37.052654    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m"
Jul 28 16:56:37.053114 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:56:37.052748    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m"
Jul 28 16:56:37.053114 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:56:37.052992    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m"
Jul 28 16:56:37.053726 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:56:37.053702    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m"
Jul 28 16:56:37.053849 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:56:37.053776    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m"
Jul 28 16:56:37.054096 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:56:37.054075    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m"
Jul 28 16:56:37.057798 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:56:37.057779    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m"
Jul 28 16:56:37.744844 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:56:37.744818    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m"
Jul 28 16:56:38.230849 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:56:38.230797    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:56:43.305953 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:56:43.305915    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:56:43.365695 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:56:43.365666    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:56:45.052816 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:56:45.052779    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:56:45.113547 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:56:45.113517    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:57:40.882392 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:40.882307    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:57:40.908340 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:40.908308    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m"]
Jul 28 16:57:40.908588 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:40.908551    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m" podUID="398f3a66-df04-4187-a9ba-b9facd365764" containerName="registry" containerID="cri-o://3268ce03c4a1f88d3f821e8ff303accc96e31f98cf34273ac7235cd637de0a81" gracePeriod=30
Jul 28 16:57:40.908736 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:40.908590    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m" podUID="398f3a66-df04-4187-a9ba-b9facd365764" containerName="ui" containerID="cri-o://25980e4e2a66b97afd6a4864f9d40cdc45a41bbf8e50c21097d914f9528c216a" gracePeriod=30
Jul 28 16:57:40.908830 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:40.908597    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m" podUID="398f3a66-df04-4187-a9ba-b9facd365764" containerName="online" containerID="cri-o://edcf86c32b2124f7f0f681781d736d56b55e4dce1abb4d95a47fae6d621319b7" gracePeriod=30
Jul 28 16:57:40.908971 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:40.908915    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m" podUID="398f3a66-df04-4187-a9ba-b9facd365764" containerName="offline" containerID="cri-o://351b88e6ed728f51ad40ba758cae073c0769f9b205c522101192d1682cd308eb" gracePeriod=30
Jul 28 16:57:40.981574 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:40.981543    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:57:41.083567 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:41.083535    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:57:41.181424 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:41.181331    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:57:41.199179 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:41.199149    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd"]
Jul 28 16:57:41.202740 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:41.202722    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd"
Jul 28 16:57:41.205506 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:41.205480    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-jjt2v\""
Jul 28 16:57:41.217479 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:41.217456    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd"]
Jul 28 16:57:41.283561 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:41.283523    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:57:41.295631 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:41.295599    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/88a760bb-d8a8-449e-9517-ab57697b9b42-registry-tls\") pod \"feast-simple-feast-setup-56cb884f74-tjvzd\" (UID: \"88a760bb-d8a8-449e-9517-ab57697b9b42\") " pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd"
Jul 28 16:57:41.295762 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:41.295644    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/88a760bb-d8a8-449e-9517-ab57697b9b42-feast-data\") pod \"feast-simple-feast-setup-56cb884f74-tjvzd\" (UID: \"88a760bb-d8a8-449e-9517-ab57697b9b42\") " pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd"
Jul 28 16:57:41.295762 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:41.295666    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/88a760bb-d8a8-449e-9517-ab57697b9b42-ui-tls\") pod \"feast-simple-feast-setup-56cb884f74-tjvzd\" (UID: \"88a760bb-d8a8-449e-9517-ab57697b9b42\") " pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd"
Jul 28 16:57:41.295836 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:41.295797    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbbjz\" (UniqueName: \"kubernetes.io/projected/88a760bb-d8a8-449e-9517-ab57697b9b42-kube-api-access-jbbjz\") pod \"feast-simple-feast-setup-56cb884f74-tjvzd\" (UID: \"88a760bb-d8a8-449e-9517-ab57697b9b42\") " pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd"
Jul 28 16:57:41.295877 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:41.295848    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/88a760bb-d8a8-449e-9517-ab57697b9b42-offline-tls\") pod \"feast-simple-feast-setup-56cb884f74-tjvzd\" (UID: \"88a760bb-d8a8-449e-9517-ab57697b9b42\") " pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd"
Jul 28 16:57:41.295915 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:41.295879    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/88a760bb-d8a8-449e-9517-ab57697b9b42-online-tls\") pod \"feast-simple-feast-setup-56cb884f74-tjvzd\" (UID: \"88a760bb-d8a8-449e-9517-ab57697b9b42\") " pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd"
Jul 28 16:57:41.344778 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:41.344740    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:57:41.396727 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:41.396698    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/88a760bb-d8a8-449e-9517-ab57697b9b42-offline-tls\") pod \"feast-simple-feast-setup-56cb884f74-tjvzd\" (UID: \"88a760bb-d8a8-449e-9517-ab57697b9b42\") " pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd"
Jul 28 16:57:41.396727 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:41.396734    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/88a760bb-d8a8-449e-9517-ab57697b9b42-online-tls\") pod \"feast-simple-feast-setup-56cb884f74-tjvzd\" (UID: \"88a760bb-d8a8-449e-9517-ab57697b9b42\") " pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd"
Jul 28 16:57:41.397027 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:41.396790    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/88a760bb-d8a8-449e-9517-ab57697b9b42-registry-tls\") pod \"feast-simple-feast-setup-56cb884f74-tjvzd\" (UID: \"88a760bb-d8a8-449e-9517-ab57697b9b42\") " pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd"
Jul 28 16:57:41.397027 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:41.396822    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/88a760bb-d8a8-449e-9517-ab57697b9b42-feast-data\") pod \"feast-simple-feast-setup-56cb884f74-tjvzd\" (UID: \"88a760bb-d8a8-449e-9517-ab57697b9b42\") " pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd"
Jul 28 16:57:41.397027 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:41.396852    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/88a760bb-d8a8-449e-9517-ab57697b9b42-ui-tls\") pod \"feast-simple-feast-setup-56cb884f74-tjvzd\" (UID: \"88a760bb-d8a8-449e-9517-ab57697b9b42\") " pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd"
Jul 28 16:57:41.397027 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:57:41.396862    2561 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found
Jul 28 16:57:41.397027 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:57:41.396958    2561 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
Jul 28 16:57:41.397289 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:57:41.397048    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88a760bb-d8a8-449e-9517-ab57697b9b42-registry-tls podName:88a760bb-d8a8-449e-9517-ab57697b9b42 nodeName:}" failed. No retries permitted until 2026-07-28 16:57:41.897010085 +0000 UTC m=+451.368423737 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/88a760bb-d8a8-449e-9517-ab57697b9b42-registry-tls") pod "feast-simple-feast-setup-56cb884f74-tjvzd" (UID: "88a760bb-d8a8-449e-9517-ab57697b9b42") : secret "feast-simple-feast-setup-registry-tls" not found
Jul 28 16:57:41.397289 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:57:41.397071    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88a760bb-d8a8-449e-9517-ab57697b9b42-offline-tls podName:88a760bb-d8a8-449e-9517-ab57697b9b42 nodeName:}" failed. No retries permitted until 2026-07-28 16:57:41.897060325 +0000 UTC m=+451.368473970 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/88a760bb-d8a8-449e-9517-ab57697b9b42-offline-tls") pod "feast-simple-feast-setup-56cb884f74-tjvzd" (UID: "88a760bb-d8a8-449e-9517-ab57697b9b42") : secret "feast-simple-feast-setup-offline-tls" not found
Jul 28 16:57:41.397404 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:41.397308    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/88a760bb-d8a8-449e-9517-ab57697b9b42-feast-data\") pod \"feast-simple-feast-setup-56cb884f74-tjvzd\" (UID: \"88a760bb-d8a8-449e-9517-ab57697b9b42\") " pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd"
Jul 28 16:57:41.397460 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:41.397417    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jbbjz\" (UniqueName: \"kubernetes.io/projected/88a760bb-d8a8-449e-9517-ab57697b9b42-kube-api-access-jbbjz\") pod \"feast-simple-feast-setup-56cb884f74-tjvzd\" (UID: \"88a760bb-d8a8-449e-9517-ab57697b9b42\") " pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd"
Jul 28 16:57:41.399790 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:41.399764    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/88a760bb-d8a8-449e-9517-ab57697b9b42-online-tls\") pod \"feast-simple-feast-setup-56cb884f74-tjvzd\" (UID: \"88a760bb-d8a8-449e-9517-ab57697b9b42\") " pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd"
Jul 28 16:57:41.399790 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:41.399784    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/88a760bb-d8a8-449e-9517-ab57697b9b42-ui-tls\") pod \"feast-simple-feast-setup-56cb884f74-tjvzd\" (UID: \"88a760bb-d8a8-449e-9517-ab57697b9b42\") " pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd"
Jul 28 16:57:41.406619 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:41.406593    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbbjz\" (UniqueName: \"kubernetes.io/projected/88a760bb-d8a8-449e-9517-ab57697b9b42-kube-api-access-jbbjz\") pod \"feast-simple-feast-setup-56cb884f74-tjvzd\" (UID: \"88a760bb-d8a8-449e-9517-ab57697b9b42\") " pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd"
Jul 28 16:57:41.529062 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:41.528992    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:57:41.628058 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:41.628010    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:57:41.903347 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:41.903256    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/88a760bb-d8a8-449e-9517-ab57697b9b42-offline-tls\") pod \"feast-simple-feast-setup-56cb884f74-tjvzd\" (UID: \"88a760bb-d8a8-449e-9517-ab57697b9b42\") " pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd"
Jul 28 16:57:41.903721 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:41.903347    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/88a760bb-d8a8-449e-9517-ab57697b9b42-registry-tls\") pod \"feast-simple-feast-setup-56cb884f74-tjvzd\" (UID: \"88a760bb-d8a8-449e-9517-ab57697b9b42\") " pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd"
Jul 28 16:57:41.905805 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:41.905783    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/88a760bb-d8a8-449e-9517-ab57697b9b42-registry-tls\") pod \"feast-simple-feast-setup-56cb884f74-tjvzd\" (UID: \"88a760bb-d8a8-449e-9517-ab57697b9b42\") " pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd"
Jul 28 16:57:41.905965 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:41.905928    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/88a760bb-d8a8-449e-9517-ab57697b9b42-offline-tls\") pod \"feast-simple-feast-setup-56cb884f74-tjvzd\" (UID: \"88a760bb-d8a8-449e-9517-ab57697b9b42\") " pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd"
Jul 28 16:57:41.980844 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:41.980807    2561 generic.go:356] "Generic (PLEG): container finished" podID="398f3a66-df04-4187-a9ba-b9facd365764" containerID="25980e4e2a66b97afd6a4864f9d40cdc45a41bbf8e50c21097d914f9528c216a" exitCode=0
Jul 28 16:57:41.980844 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:41.980836    2561 generic.go:356] "Generic (PLEG): container finished" podID="398f3a66-df04-4187-a9ba-b9facd365764" containerID="edcf86c32b2124f7f0f681781d736d56b55e4dce1abb4d95a47fae6d621319b7" exitCode=0
Jul 28 16:57:41.981058 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:41.980880    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m" event={"ID":"398f3a66-df04-4187-a9ba-b9facd365764","Type":"ContainerDied","Data":"25980e4e2a66b97afd6a4864f9d40cdc45a41bbf8e50c21097d914f9528c216a"}
Jul 28 16:57:41.981058 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:41.980923    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m" event={"ID":"398f3a66-df04-4187-a9ba-b9facd365764","Type":"ContainerDied","Data":"edcf86c32b2124f7f0f681781d736d56b55e4dce1abb4d95a47fae6d621319b7"}
Jul 28 16:57:42.112227 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:42.112192    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd"
Jul 28 16:57:42.245114 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:42.245092    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd"]
Jul 28 16:57:42.246823 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:57:42.246783    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod88a760bb_d8a8_449e_9517_ab57697b9b42.slice/crio-11d68966ec27d7e00c5722722ab43f73a4ea49f1933303faeea67377f9738c8d WatchSource:0}: Error finding container 11d68966ec27d7e00c5722722ab43f73a4ea49f1933303faeea67377f9738c8d: Status 404 returned error can't find the container with id 11d68966ec27d7e00c5722722ab43f73a4ea49f1933303faeea67377f9738c8d
Jul 28 16:57:42.986735 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:42.986697    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd" event={"ID":"88a760bb-d8a8-449e-9517-ab57697b9b42","Type":"ContainerStarted","Data":"aa0a997a792aa971ac3aae5eff886eb09ba8f02289c9c97a44016869041a4a46"}
Jul 28 16:57:42.987137 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:42.986745    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd" event={"ID":"88a760bb-d8a8-449e-9517-ab57697b9b42","Type":"ContainerStarted","Data":"11d68966ec27d7e00c5722722ab43f73a4ea49f1933303faeea67377f9738c8d"}
Jul 28 16:57:47.054358 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:47.054313    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m" podUID="398f3a66-df04-4187-a9ba-b9facd365764" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.21:8443: connect: connection refused"
Jul 28 16:57:47.741809 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:47.741769    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m" podUID="398f3a66-df04-4187-a9ba-b9facd365764" containerName="online" probeResult="failure" output="Get \"https://10.134.0.21:6567/health\": dial tcp 10.134.0.21:6567: connect: connection refused"
Jul 28 16:57:48.010427 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:48.010335    2561 generic.go:356] "Generic (PLEG): container finished" podID="88a760bb-d8a8-449e-9517-ab57697b9b42" containerID="aa0a997a792aa971ac3aae5eff886eb09ba8f02289c9c97a44016869041a4a46" exitCode=0
Jul 28 16:57:48.010427 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:48.010375    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd" event={"ID":"88a760bb-d8a8-449e-9517-ab57697b9b42","Type":"ContainerDied","Data":"aa0a997a792aa971ac3aae5eff886eb09ba8f02289c9c97a44016869041a4a46"}
Jul 28 16:57:48.975142 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:48.975086    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:57:49.016355 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:49.016324    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd" event={"ID":"88a760bb-d8a8-449e-9517-ab57697b9b42","Type":"ContainerStarted","Data":"5bb0b41ef8240ed1b18cbca3c606915ce62fdb43271b2428632c6a8e4d152cad"}
Jul 28 16:57:49.030412 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:49.030384    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:57:54.039077 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:54.039040    2561 generic.go:356] "Generic (PLEG): container finished" podID="88a760bb-d8a8-449e-9517-ab57697b9b42" containerID="5bb0b41ef8240ed1b18cbca3c606915ce62fdb43271b2428632c6a8e4d152cad" exitCode=0
Jul 28 16:57:54.039464 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:54.039109    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd" event={"ID":"88a760bb-d8a8-449e-9517-ab57697b9b42","Type":"ContainerDied","Data":"5bb0b41ef8240ed1b18cbca3c606915ce62fdb43271b2428632c6a8e4d152cad"}
Jul 28 16:57:55.049622 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:55.049582    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd" event={"ID":"88a760bb-d8a8-449e-9517-ab57697b9b42","Type":"ContainerStarted","Data":"e45f596232af771fe3e12a129d8f7f65b17de723d15dfe11f6b6a517ffaf536e"}
Jul 28 16:57:55.050133 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:55.049644    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd" event={"ID":"88a760bb-d8a8-449e-9517-ab57697b9b42","Type":"ContainerStarted","Data":"82d90d9ad864cea34053b0f4a88879c8050257771a984366874d1a9ed15aec07"}
Jul 28 16:57:55.050133 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:55.049665    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd" event={"ID":"88a760bb-d8a8-449e-9517-ab57697b9b42","Type":"ContainerStarted","Data":"33cd678fa89d32813d52686c4831715ede9e96b860cf565dba07a5a6c70483b4"}
Jul 28 16:57:55.050133 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:55.049683    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd" event={"ID":"88a760bb-d8a8-449e-9517-ab57697b9b42","Type":"ContainerStarted","Data":"5f5aa749881169c87ca1d04e917d10c2191817a2bbae8e297cdb3de2a37c5c54"}
Jul 28 16:57:55.078416 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:55.078352    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd" podStartSLOduration=14.078300317 podStartE2EDuration="14.078300317s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:57:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:57:55.076540736 +0000 UTC m=+464.547954424" watchObservedRunningTime="2026-07-28 16:57:55.078300317 +0000 UTC m=+464.549713978"
Jul 28 16:57:57.054494 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:57.054450    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m" podUID="398f3a66-df04-4187-a9ba-b9facd365764" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.21:8443: connect: connection refused"
Jul 28 16:57:57.112862 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:57.112827    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd"
Jul 28 16:57:57.113155 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:57.113130    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd"
Jul 28 16:57:57.113155 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:57.113159    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd"
Jul 28 16:57:57.113343 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:57.113177    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd"
Jul 28 16:57:57.115090 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:57.115056    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd" podUID="88a760bb-d8a8-449e-9517-ab57697b9b42" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.22:6571: connect: connection refused"
Jul 28 16:57:57.115090 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:57.115074    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd" podUID="88a760bb-d8a8-449e-9517-ab57697b9b42" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.22:8816: connect: connection refused"
Jul 28 16:57:57.115255 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:57.115155    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd" podUID="88a760bb-d8a8-449e-9517-ab57697b9b42" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.22:8443: connect: connection refused"
Jul 28 16:57:57.115255 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:57.115240    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd" podUID="88a760bb-d8a8-449e-9517-ab57697b9b42" containerName="online" probeResult="failure" output="Get \"https://10.134.0.22:6567/health\": dial tcp 10.134.0.22:6567: connect: connection refused"
Jul 28 16:57:57.741983 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:57.741902    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m" podUID="398f3a66-df04-4187-a9ba-b9facd365764" containerName="online" probeResult="failure" output="Get \"https://10.134.0.21:6567/health\": dial tcp 10.134.0.21:6567: connect: connection refused"
Jul 28 16:57:59.426819 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:59.426780    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56bdd6688f-24jfr"]
Jul 28 16:57:59.544420 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:59.544370    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:57:59.641716 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:59.641679    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:57:59.700244 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:57:59.700160    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:58:00.113122 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:00.113082    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd" podUID="88a760bb-d8a8-449e-9517-ab57697b9b42" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.22:8443: connect: connection refused"
Jul 28 16:58:00.114005 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:00.113984    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd"
Jul 28 16:58:00.114115 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:00.114089    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd"
Jul 28 16:58:00.114756 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:00.114548    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd"
Jul 28 16:58:00.114756 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:00.114585    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd"
Jul 28 16:58:00.114756 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:00.114697    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd"
Jul 28 16:58:00.114756 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:00.114748    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd"
Jul 28 16:58:00.120921 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:00.120903    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd"
Jul 28 16:58:01.083402 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:01.083373    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd"
Jul 28 16:58:01.086603 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:01.086584    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd"
Jul 28 16:58:02.113185 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:02.113157    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd"
Jul 28 16:58:03.113173 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:03.113149    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd"
Jul 28 16:58:04.094714 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:04.094683    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd"
Jul 28 16:58:04.399495 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:04.399378    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:58:04.560213 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:04.560177    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:58:07.054481 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:07.054441    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m" podUID="398f3a66-df04-4187-a9ba-b9facd365764" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.21:8443: connect: connection refused"
Jul 28 16:58:07.054973 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:07.054594    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m"
Jul 28 16:58:07.742860 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:07.742810    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m" podUID="398f3a66-df04-4187-a9ba-b9facd365764" containerName="online" probeResult="failure" output="Get \"https://10.134.0.21:6567/health\": dial tcp 10.134.0.21:6567: connect: connection refused"
Jul 28 16:58:07.743072 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:07.742994    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m"
Jul 28 16:58:11.124856 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:11.124822    2561 generic.go:356] "Generic (PLEG): container finished" podID="398f3a66-df04-4187-a9ba-b9facd365764" containerID="351b88e6ed728f51ad40ba758cae073c0769f9b205c522101192d1682cd308eb" exitCode=137
Jul 28 16:58:11.124856 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:11.124848    2561 generic.go:356] "Generic (PLEG): container finished" podID="398f3a66-df04-4187-a9ba-b9facd365764" containerID="3268ce03c4a1f88d3f821e8ff303accc96e31f98cf34273ac7235cd637de0a81" exitCode=137
Jul 28 16:58:11.125284 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:11.124870    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m" event={"ID":"398f3a66-df04-4187-a9ba-b9facd365764","Type":"ContainerDied","Data":"351b88e6ed728f51ad40ba758cae073c0769f9b205c522101192d1682cd308eb"}
Jul 28 16:58:11.125284 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:11.124897    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m" event={"ID":"398f3a66-df04-4187-a9ba-b9facd365764","Type":"ContainerDied","Data":"3268ce03c4a1f88d3f821e8ff303accc96e31f98cf34273ac7235cd637de0a81"}
Jul 28 16:58:11.565747 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:11.565722    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m"
Jul 28 16:58:11.643983 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:11.643949    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/398f3a66-df04-4187-a9ba-b9facd365764-online-tls\") pod \"398f3a66-df04-4187-a9ba-b9facd365764\" (UID: \"398f3a66-df04-4187-a9ba-b9facd365764\") "
Jul 28 16:58:11.644277 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:11.644001    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/398f3a66-df04-4187-a9ba-b9facd365764-registry-tls\") pod \"398f3a66-df04-4187-a9ba-b9facd365764\" (UID: \"398f3a66-df04-4187-a9ba-b9facd365764\") "
Jul 28 16:58:11.644277 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:11.644037    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/398f3a66-df04-4187-a9ba-b9facd365764-feast-data\") pod \"398f3a66-df04-4187-a9ba-b9facd365764\" (UID: \"398f3a66-df04-4187-a9ba-b9facd365764\") "
Jul 28 16:58:11.644277 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:11.644064    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vxd7k\" (UniqueName: \"kubernetes.io/projected/398f3a66-df04-4187-a9ba-b9facd365764-kube-api-access-vxd7k\") pod \"398f3a66-df04-4187-a9ba-b9facd365764\" (UID: \"398f3a66-df04-4187-a9ba-b9facd365764\") "
Jul 28 16:58:11.644277 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:11.644116    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/398f3a66-df04-4187-a9ba-b9facd365764-ui-tls\") pod \"398f3a66-df04-4187-a9ba-b9facd365764\" (UID: \"398f3a66-df04-4187-a9ba-b9facd365764\") "
Jul 28 16:58:11.644277 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:11.644171    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/398f3a66-df04-4187-a9ba-b9facd365764-offline-tls\") pod \"398f3a66-df04-4187-a9ba-b9facd365764\" (UID: \"398f3a66-df04-4187-a9ba-b9facd365764\") "
Jul 28 16:58:11.644643 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:11.644616    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/398f3a66-df04-4187-a9ba-b9facd365764-feast-data" (OuterVolumeSpecName: "feast-data") pod "398f3a66-df04-4187-a9ba-b9facd365764" (UID: "398f3a66-df04-4187-a9ba-b9facd365764"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 16:58:11.646433 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:11.646408    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/398f3a66-df04-4187-a9ba-b9facd365764-online-tls" (OuterVolumeSpecName: "online-tls") pod "398f3a66-df04-4187-a9ba-b9facd365764" (UID: "398f3a66-df04-4187-a9ba-b9facd365764"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 16:58:11.646550 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:11.646434    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/398f3a66-df04-4187-a9ba-b9facd365764-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "398f3a66-df04-4187-a9ba-b9facd365764" (UID: "398f3a66-df04-4187-a9ba-b9facd365764"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 16:58:11.646665 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:11.646639    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/398f3a66-df04-4187-a9ba-b9facd365764-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "398f3a66-df04-4187-a9ba-b9facd365764" (UID: "398f3a66-df04-4187-a9ba-b9facd365764"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 16:58:11.646746 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:11.646724    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/398f3a66-df04-4187-a9ba-b9facd365764-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "398f3a66-df04-4187-a9ba-b9facd365764" (UID: "398f3a66-df04-4187-a9ba-b9facd365764"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 16:58:11.646794 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:11.646777    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/398f3a66-df04-4187-a9ba-b9facd365764-kube-api-access-vxd7k" (OuterVolumeSpecName: "kube-api-access-vxd7k") pod "398f3a66-df04-4187-a9ba-b9facd365764" (UID: "398f3a66-df04-4187-a9ba-b9facd365764"). InnerVolumeSpecName "kube-api-access-vxd7k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 16:58:11.745534 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:11.745506    2561 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/398f3a66-df04-4187-a9ba-b9facd365764-feast-data\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 16:58:11.745534 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:11.745531    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxd7k\" (UniqueName: \"kubernetes.io/projected/398f3a66-df04-4187-a9ba-b9facd365764-kube-api-access-vxd7k\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 16:58:11.745725 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:11.745540    2561 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/398f3a66-df04-4187-a9ba-b9facd365764-ui-tls\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 16:58:11.745725 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:11.745549    2561 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/398f3a66-df04-4187-a9ba-b9facd365764-offline-tls\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 16:58:11.745725 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:11.745557    2561 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/398f3a66-df04-4187-a9ba-b9facd365764-online-tls\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 16:58:11.745725 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:11.745566    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/398f3a66-df04-4187-a9ba-b9facd365764-registry-tls\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 16:58:12.131290 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:12.131198    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m" event={"ID":"398f3a66-df04-4187-a9ba-b9facd365764","Type":"ContainerDied","Data":"f4f53d22b350c0f83dc5314cc5bbf2ec47d9a7a58548e6075ebb435d95297b33"}
Jul 28 16:58:12.131290 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:12.131225    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m"
Jul 28 16:58:12.131290 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:12.131253    2561 scope.go:117] "RemoveContainer" containerID="25980e4e2a66b97afd6a4864f9d40cdc45a41bbf8e50c21097d914f9528c216a"
Jul 28 16:58:12.140638 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:12.140622    2561 scope.go:117] "RemoveContainer" containerID="351b88e6ed728f51ad40ba758cae073c0769f9b205c522101192d1682cd308eb"
Jul 28 16:58:12.148021 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:12.147984    2561 scope.go:117] "RemoveContainer" containerID="edcf86c32b2124f7f0f681781d736d56b55e4dce1abb4d95a47fae6d621319b7"
Jul 28 16:58:12.156347 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:12.156253    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m"]
Jul 28 16:58:12.156402 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:12.156372    2561 scope.go:117] "RemoveContainer" containerID="3268ce03c4a1f88d3f821e8ff303accc96e31f98cf34273ac7235cd637de0a81"
Jul 28 16:58:12.164206 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:12.164181    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-56cb884f74-m6t7m"]
Jul 28 16:58:12.164838 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:12.164823    2561 scope.go:117] "RemoveContainer" containerID="c52886cf40b9b4ec7bd334681b2fc52e050b969b0f7e7c2ce9f761a38be1f513"
Jul 28 16:58:12.172493 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:12.172475    2561 scope.go:117] "RemoveContainer" containerID="21c63077be63576b347adf7d097470fdaeb663393d5b34984982570685b7b35b"
Jul 28 16:58:13.075322 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:13.075292    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="398f3a66-df04-4187-a9ba-b9facd365764" path="/var/lib/kubelet/pods/398f3a66-df04-4187-a9ba-b9facd365764/volumes"
Jul 28 16:58:24.455731 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:24.455668    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-56bdd6688f-24jfr" podUID="e6fce490-92b7-4b0a-9821-cdebf3531138" containerName="console" containerID="cri-o://7a76a477b0092ab389e88558e5dc76e92b5d19513b0617cc05f7f05dd4183ecd" gracePeriod=15
Jul 28 16:58:24.697312 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:24.697291    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56bdd6688f-24jfr"
Jul 28 16:58:24.752226 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:24.752197    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wc296\" (UniqueName: \"kubernetes.io/projected/e6fce490-92b7-4b0a-9821-cdebf3531138-kube-api-access-wc296\") pod \"e6fce490-92b7-4b0a-9821-cdebf3531138\" (UID: \"e6fce490-92b7-4b0a-9821-cdebf3531138\") "
Jul 28 16:58:24.752378 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:24.752246    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6fce490-92b7-4b0a-9821-cdebf3531138-trusted-ca-bundle\") pod \"e6fce490-92b7-4b0a-9821-cdebf3531138\" (UID: \"e6fce490-92b7-4b0a-9821-cdebf3531138\") "
Jul 28 16:58:24.752378 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:24.752265    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6fce490-92b7-4b0a-9821-cdebf3531138-service-ca\") pod \"e6fce490-92b7-4b0a-9821-cdebf3531138\" (UID: \"e6fce490-92b7-4b0a-9821-cdebf3531138\") "
Jul 28 16:58:24.752499 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:24.752475    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6fce490-92b7-4b0a-9821-cdebf3531138-oauth-serving-cert\") pod \"e6fce490-92b7-4b0a-9821-cdebf3531138\" (UID: \"e6fce490-92b7-4b0a-9821-cdebf3531138\") "
Jul 28 16:58:24.752663 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:24.752624    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6fce490-92b7-4b0a-9821-cdebf3531138-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e6fce490-92b7-4b0a-9821-cdebf3531138" (UID: "e6fce490-92b7-4b0a-9821-cdebf3531138"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 16:58:24.752663 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:24.752652    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6fce490-92b7-4b0a-9821-cdebf3531138-console-oauth-config\") pod \"e6fce490-92b7-4b0a-9821-cdebf3531138\" (UID: \"e6fce490-92b7-4b0a-9821-cdebf3531138\") "
Jul 28 16:58:24.752842 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:24.752662    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6fce490-92b7-4b0a-9821-cdebf3531138-service-ca" (OuterVolumeSpecName: "service-ca") pod "e6fce490-92b7-4b0a-9821-cdebf3531138" (UID: "e6fce490-92b7-4b0a-9821-cdebf3531138"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 16:58:24.752842 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:24.752712    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6fce490-92b7-4b0a-9821-cdebf3531138-console-serving-cert\") pod \"e6fce490-92b7-4b0a-9821-cdebf3531138\" (UID: \"e6fce490-92b7-4b0a-9821-cdebf3531138\") "
Jul 28 16:58:24.752842 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:24.752782    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6fce490-92b7-4b0a-9821-cdebf3531138-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e6fce490-92b7-4b0a-9821-cdebf3531138" (UID: "e6fce490-92b7-4b0a-9821-cdebf3531138"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 16:58:24.752842 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:24.752809    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6fce490-92b7-4b0a-9821-cdebf3531138-console-config\") pod \"e6fce490-92b7-4b0a-9821-cdebf3531138\" (UID: \"e6fce490-92b7-4b0a-9821-cdebf3531138\") "
Jul 28 16:58:24.753192 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:24.753145    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6fce490-92b7-4b0a-9821-cdebf3531138-console-config" (OuterVolumeSpecName: "console-config") pod "e6fce490-92b7-4b0a-9821-cdebf3531138" (UID: "e6fce490-92b7-4b0a-9821-cdebf3531138"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 16:58:24.753286 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:24.753253    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6fce490-92b7-4b0a-9821-cdebf3531138-trusted-ca-bundle\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 16:58:24.753286 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:24.753272    2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6fce490-92b7-4b0a-9821-cdebf3531138-service-ca\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 16:58:24.753558 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:24.753286    2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6fce490-92b7-4b0a-9821-cdebf3531138-oauth-serving-cert\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 16:58:24.753558 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:24.753299    2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6fce490-92b7-4b0a-9821-cdebf3531138-console-config\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 16:58:24.754726 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:24.754703    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6fce490-92b7-4b0a-9821-cdebf3531138-kube-api-access-wc296" (OuterVolumeSpecName: "kube-api-access-wc296") pod "e6fce490-92b7-4b0a-9821-cdebf3531138" (UID: "e6fce490-92b7-4b0a-9821-cdebf3531138"). InnerVolumeSpecName "kube-api-access-wc296". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 16:58:24.754922 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:24.754901    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6fce490-92b7-4b0a-9821-cdebf3531138-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e6fce490-92b7-4b0a-9821-cdebf3531138" (UID: "e6fce490-92b7-4b0a-9821-cdebf3531138"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 16:58:24.755048 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:24.754960    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6fce490-92b7-4b0a-9821-cdebf3531138-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e6fce490-92b7-4b0a-9821-cdebf3531138" (UID: "e6fce490-92b7-4b0a-9821-cdebf3531138"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 16:58:24.854272 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:24.854241    2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6fce490-92b7-4b0a-9821-cdebf3531138-console-oauth-config\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 16:58:24.854272 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:24.854265    2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6fce490-92b7-4b0a-9821-cdebf3531138-console-serving-cert\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 16:58:24.854272 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:24.854274    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wc296\" (UniqueName: \"kubernetes.io/projected/e6fce490-92b7-4b0a-9821-cdebf3531138-kube-api-access-wc296\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 16:58:25.181101 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:25.181073    2561 generic.go:356] "Generic (PLEG): container finished" podID="e6fce490-92b7-4b0a-9821-cdebf3531138" containerID="7a76a477b0092ab389e88558e5dc76e92b5d19513b0617cc05f7f05dd4183ecd" exitCode=0
Jul 28 16:58:25.181277 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:25.181109    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56bdd6688f-24jfr" event={"ID":"e6fce490-92b7-4b0a-9821-cdebf3531138","Type":"ContainerDied","Data":"7a76a477b0092ab389e88558e5dc76e92b5d19513b0617cc05f7f05dd4183ecd"}
Jul 28 16:58:25.181277 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:25.181129    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56bdd6688f-24jfr"
Jul 28 16:58:25.181277 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:25.181140    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56bdd6688f-24jfr" event={"ID":"e6fce490-92b7-4b0a-9821-cdebf3531138","Type":"ContainerDied","Data":"880d5dd51d68996b058e040469b93f087e179429b5f7a017c57e17c040bc3574"}
Jul 28 16:58:25.181277 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:25.181158    2561 scope.go:117] "RemoveContainer" containerID="7a76a477b0092ab389e88558e5dc76e92b5d19513b0617cc05f7f05dd4183ecd"
Jul 28 16:58:25.189174 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:25.189157    2561 scope.go:117] "RemoveContainer" containerID="7a76a477b0092ab389e88558e5dc76e92b5d19513b0617cc05f7f05dd4183ecd"
Jul 28 16:58:25.189435 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:58:25.189416    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a76a477b0092ab389e88558e5dc76e92b5d19513b0617cc05f7f05dd4183ecd\": container with ID starting with 7a76a477b0092ab389e88558e5dc76e92b5d19513b0617cc05f7f05dd4183ecd not found: ID does not exist" containerID="7a76a477b0092ab389e88558e5dc76e92b5d19513b0617cc05f7f05dd4183ecd"
Jul 28 16:58:25.189482 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:25.189443    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a76a477b0092ab389e88558e5dc76e92b5d19513b0617cc05f7f05dd4183ecd"} err="failed to get container status \"7a76a477b0092ab389e88558e5dc76e92b5d19513b0617cc05f7f05dd4183ecd\": rpc error: code = NotFound desc = could not find container \"7a76a477b0092ab389e88558e5dc76e92b5d19513b0617cc05f7f05dd4183ecd\": container with ID starting with 7a76a477b0092ab389e88558e5dc76e92b5d19513b0617cc05f7f05dd4183ecd not found: ID does not exist"
Jul 28 16:58:25.203706 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:25.203685    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56bdd6688f-24jfr"]
Jul 28 16:58:25.209079 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:25.209062    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-56bdd6688f-24jfr"]
Jul 28 16:58:27.075550 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:27.075516    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6fce490-92b7-4b0a-9821-cdebf3531138" path="/var/lib/kubelet/pods/e6fce490-92b7-4b0a-9821-cdebf3531138/volumes"
Jul 28 16:58:45.047205 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:58:45.047168    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:59:06.647962 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:06.647853    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:59:06.743829 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:06.743794    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:59:06.875207 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:06.875176    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:59:06.975153 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:06.975120    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:59:07.059125 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.059093    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w"]
Jul 28 16:59:07.059412 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.059400    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6fce490-92b7-4b0a-9821-cdebf3531138" containerName="console"
Jul 28 16:59:07.059458 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.059414    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6fce490-92b7-4b0a-9821-cdebf3531138" containerName="console"
Jul 28 16:59:07.059458 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.059439    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="398f3a66-df04-4187-a9ba-b9facd365764" containerName="feast-init"
Jul 28 16:59:07.059458 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.059446    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="398f3a66-df04-4187-a9ba-b9facd365764" containerName="feast-init"
Jul 28 16:59:07.059458 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.059453    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="398f3a66-df04-4187-a9ba-b9facd365764" containerName="registry"
Jul 28 16:59:07.059458 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.059458    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="398f3a66-df04-4187-a9ba-b9facd365764" containerName="registry"
Jul 28 16:59:07.059600 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.059465    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="398f3a66-df04-4187-a9ba-b9facd365764" containerName="ui"
Jul 28 16:59:07.059600 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.059470    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="398f3a66-df04-4187-a9ba-b9facd365764" containerName="ui"
Jul 28 16:59:07.059600 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.059478    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="398f3a66-df04-4187-a9ba-b9facd365764" containerName="online"
Jul 28 16:59:07.059600 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.059482    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="398f3a66-df04-4187-a9ba-b9facd365764" containerName="online"
Jul 28 16:59:07.059600 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.059490    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="398f3a66-df04-4187-a9ba-b9facd365764" containerName="offline"
Jul 28 16:59:07.059600 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.059496    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="398f3a66-df04-4187-a9ba-b9facd365764" containerName="offline"
Jul 28 16:59:07.059600 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.059502    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="398f3a66-df04-4187-a9ba-b9facd365764" containerName="feast-apply"
Jul 28 16:59:07.059600 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.059507    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="398f3a66-df04-4187-a9ba-b9facd365764" containerName="feast-apply"
Jul 28 16:59:07.059600 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.059557    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="398f3a66-df04-4187-a9ba-b9facd365764" containerName="online"
Jul 28 16:59:07.059600 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.059564    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6fce490-92b7-4b0a-9821-cdebf3531138" containerName="console"
Jul 28 16:59:07.059600 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.059569    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="398f3a66-df04-4187-a9ba-b9facd365764" containerName="registry"
Jul 28 16:59:07.059600 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.059574    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="398f3a66-df04-4187-a9ba-b9facd365764" containerName="offline"
Jul 28 16:59:07.059600 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.059583    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="398f3a66-df04-4187-a9ba-b9facd365764" containerName="ui"
Jul 28 16:59:07.062673 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.062655    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w"
Jul 28 16:59:07.068370 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.068349    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Jul 28 16:59:07.068626 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.068608    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Jul 28 16:59:07.068730 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.068671    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Jul 28 16:59:07.069142 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.068640    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\""
Jul 28 16:59:07.069142 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.068749    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Jul 28 16:59:07.069142 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.069015    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Jul 28 16:59:07.069142 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.069112    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-7xx9q\""
Jul 28 16:59:07.069876 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.069861    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Jul 28 16:59:07.085537 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.085515    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w"]
Jul 28 16:59:07.100786 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.100764    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:59:07.162225 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.162198    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1f1a702f-8990-4f3a-9084-7dbfd2e8eee4-offline-tls\") pod \"feast-simple-feast-remote-setup-578b464648-jms2w\" (UID: \"1f1a702f-8990-4f3a-9084-7dbfd2e8eee4\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w"
Jul 28 16:59:07.162225 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.162225    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1f1a702f-8990-4f3a-9084-7dbfd2e8eee4-feast-data\") pod \"feast-simple-feast-remote-setup-578b464648-jms2w\" (UID: \"1f1a702f-8990-4f3a-9084-7dbfd2e8eee4\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w"
Jul 28 16:59:07.162374 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.162247    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29sjr\" (UniqueName: \"kubernetes.io/projected/1f1a702f-8990-4f3a-9084-7dbfd2e8eee4-kube-api-access-29sjr\") pod \"feast-simple-feast-remote-setup-578b464648-jms2w\" (UID: \"1f1a702f-8990-4f3a-9084-7dbfd2e8eee4\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w"
Jul 28 16:59:07.162374 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.162299    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/1f1a702f-8990-4f3a-9084-7dbfd2e8eee4-registry-tls\") pod \"feast-simple-feast-remote-setup-578b464648-jms2w\" (UID: \"1f1a702f-8990-4f3a-9084-7dbfd2e8eee4\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w"
Jul 28 16:59:07.162374 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.162327    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1f1a702f-8990-4f3a-9084-7dbfd2e8eee4-online-tls\") pod \"feast-simple-feast-remote-setup-578b464648-jms2w\" (UID: \"1f1a702f-8990-4f3a-9084-7dbfd2e8eee4\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w"
Jul 28 16:59:07.162482 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.162398    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1f1a702f-8990-4f3a-9084-7dbfd2e8eee4-ui-tls\") pod \"feast-simple-feast-remote-setup-578b464648-jms2w\" (UID: \"1f1a702f-8990-4f3a-9084-7dbfd2e8eee4\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w"
Jul 28 16:59:07.200977 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.200952    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:59:07.263701 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.263651    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1f1a702f-8990-4f3a-9084-7dbfd2e8eee4-ui-tls\") pod \"feast-simple-feast-remote-setup-578b464648-jms2w\" (UID: \"1f1a702f-8990-4f3a-9084-7dbfd2e8eee4\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w"
Jul 28 16:59:07.263701 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.263684    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1f1a702f-8990-4f3a-9084-7dbfd2e8eee4-offline-tls\") pod \"feast-simple-feast-remote-setup-578b464648-jms2w\" (UID: \"1f1a702f-8990-4f3a-9084-7dbfd2e8eee4\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w"
Jul 28 16:59:07.263826 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.263705    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1f1a702f-8990-4f3a-9084-7dbfd2e8eee4-feast-data\") pod \"feast-simple-feast-remote-setup-578b464648-jms2w\" (UID: \"1f1a702f-8990-4f3a-9084-7dbfd2e8eee4\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w"
Jul 28 16:59:07.263826 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.263742    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29sjr\" (UniqueName: \"kubernetes.io/projected/1f1a702f-8990-4f3a-9084-7dbfd2e8eee4-kube-api-access-29sjr\") pod \"feast-simple-feast-remote-setup-578b464648-jms2w\" (UID: \"1f1a702f-8990-4f3a-9084-7dbfd2e8eee4\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w"
Jul 28 16:59:07.263826 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.263775    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/1f1a702f-8990-4f3a-9084-7dbfd2e8eee4-registry-tls\") pod \"feast-simple-feast-remote-setup-578b464648-jms2w\" (UID: \"1f1a702f-8990-4f3a-9084-7dbfd2e8eee4\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w"
Jul 28 16:59:07.263826 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:59:07.263792    2561 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-offline-tls: secret "feast-simple-feast-remote-setup-offline-tls" not found
Jul 28 16:59:07.263826 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.263798    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1f1a702f-8990-4f3a-9084-7dbfd2e8eee4-online-tls\") pod \"feast-simple-feast-remote-setup-578b464648-jms2w\" (UID: \"1f1a702f-8990-4f3a-9084-7dbfd2e8eee4\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w"
Jul 28 16:59:07.264068 ip-10-0-128-92 kubenswrapper[2561]: E0728 16:59:07.263862    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f1a702f-8990-4f3a-9084-7dbfd2e8eee4-offline-tls podName:1f1a702f-8990-4f3a-9084-7dbfd2e8eee4 nodeName:}" failed. No retries permitted until 2026-07-28 16:59:07.763839982 +0000 UTC m=+537.235253622 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/1f1a702f-8990-4f3a-9084-7dbfd2e8eee4-offline-tls") pod "feast-simple-feast-remote-setup-578b464648-jms2w" (UID: "1f1a702f-8990-4f3a-9084-7dbfd2e8eee4") : secret "feast-simple-feast-remote-setup-offline-tls" not found
Jul 28 16:59:07.264140 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.264124    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1f1a702f-8990-4f3a-9084-7dbfd2e8eee4-feast-data\") pod \"feast-simple-feast-remote-setup-578b464648-jms2w\" (UID: \"1f1a702f-8990-4f3a-9084-7dbfd2e8eee4\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w"
Jul 28 16:59:07.264465 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.264445    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/1f1a702f-8990-4f3a-9084-7dbfd2e8eee4-registry-tls\") pod \"feast-simple-feast-remote-setup-578b464648-jms2w\" (UID: \"1f1a702f-8990-4f3a-9084-7dbfd2e8eee4\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w"
Jul 28 16:59:07.266431 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.266411    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1f1a702f-8990-4f3a-9084-7dbfd2e8eee4-ui-tls\") pod \"feast-simple-feast-remote-setup-578b464648-jms2w\" (UID: \"1f1a702f-8990-4f3a-9084-7dbfd2e8eee4\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w"
Jul 28 16:59:07.266507 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.266422    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1f1a702f-8990-4f3a-9084-7dbfd2e8eee4-online-tls\") pod \"feast-simple-feast-remote-setup-578b464648-jms2w\" (UID: \"1f1a702f-8990-4f3a-9084-7dbfd2e8eee4\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w"
Jul 28 16:59:07.275102 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.275084    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29sjr\" (UniqueName: \"kubernetes.io/projected/1f1a702f-8990-4f3a-9084-7dbfd2e8eee4-kube-api-access-29sjr\") pod \"feast-simple-feast-remote-setup-578b464648-jms2w\" (UID: \"1f1a702f-8990-4f3a-9084-7dbfd2e8eee4\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w"
Jul 28 16:59:07.332552 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.332532    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 16:59:07.767662 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.767630    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1f1a702f-8990-4f3a-9084-7dbfd2e8eee4-offline-tls\") pod \"feast-simple-feast-remote-setup-578b464648-jms2w\" (UID: \"1f1a702f-8990-4f3a-9084-7dbfd2e8eee4\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w"
Jul 28 16:59:07.770105 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.770083    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1f1a702f-8990-4f3a-9084-7dbfd2e8eee4-offline-tls\") pod \"feast-simple-feast-remote-setup-578b464648-jms2w\" (UID: \"1f1a702f-8990-4f3a-9084-7dbfd2e8eee4\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w"
Jul 28 16:59:07.972071 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:07.972044    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w"
Jul 28 16:59:08.112559 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:08.112530    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w"]
Jul 28 16:59:08.113626 ip-10-0-128-92 kubenswrapper[2561]: W0728 16:59:08.113599    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1f1a702f_8990_4f3a_9084_7dbfd2e8eee4.slice/crio-4b5a6b60891be3987dbad44268a5543f8e2e98306483db0064aa8be68cd3f43b WatchSource:0}: Error finding container 4b5a6b60891be3987dbad44268a5543f8e2e98306483db0064aa8be68cd3f43b: Status 404 returned error can't find the container with id 4b5a6b60891be3987dbad44268a5543f8e2e98306483db0064aa8be68cd3f43b
Jul 28 16:59:08.343690 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:08.343605    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w" event={"ID":"1f1a702f-8990-4f3a-9084-7dbfd2e8eee4","Type":"ContainerStarted","Data":"e1e25a0e5030160c0eb4c9ea0194c707c85b60ca19092cb4f76617b87a37108f"}
Jul 28 16:59:08.343690 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:08.343658    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w" event={"ID":"1f1a702f-8990-4f3a-9084-7dbfd2e8eee4","Type":"ContainerStarted","Data":"4b5a6b60891be3987dbad44268a5543f8e2e98306483db0064aa8be68cd3f43b"}
Jul 28 16:59:13.362274 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:13.362241    2561 generic.go:356] "Generic (PLEG): container finished" podID="1f1a702f-8990-4f3a-9084-7dbfd2e8eee4" containerID="e1e25a0e5030160c0eb4c9ea0194c707c85b60ca19092cb4f76617b87a37108f" exitCode=0
Jul 28 16:59:13.362688 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:13.362316    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w" event={"ID":"1f1a702f-8990-4f3a-9084-7dbfd2e8eee4","Type":"ContainerDied","Data":"e1e25a0e5030160c0eb4c9ea0194c707c85b60ca19092cb4f76617b87a37108f"}
Jul 28 16:59:14.368171 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:14.368128    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w" event={"ID":"1f1a702f-8990-4f3a-9084-7dbfd2e8eee4","Type":"ContainerStarted","Data":"4c607c6e324b800ed4c350e4f675219135d9b5de679952c1d8556710f3dee4b2"}
Jul 28 16:59:19.389149 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:19.389064    2561 generic.go:356] "Generic (PLEG): container finished" podID="1f1a702f-8990-4f3a-9084-7dbfd2e8eee4" containerID="4c607c6e324b800ed4c350e4f675219135d9b5de679952c1d8556710f3dee4b2" exitCode=0
Jul 28 16:59:19.389149 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:19.389125    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w" event={"ID":"1f1a702f-8990-4f3a-9084-7dbfd2e8eee4","Type":"ContainerDied","Data":"4c607c6e324b800ed4c350e4f675219135d9b5de679952c1d8556710f3dee4b2"}
Jul 28 16:59:19.392673 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:19.392651    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\""
Jul 28 16:59:20.397405 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:20.397370    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w" event={"ID":"1f1a702f-8990-4f3a-9084-7dbfd2e8eee4","Type":"ContainerStarted","Data":"3d0f646b28497cbce242a8e19ec3b553e1e3b65142144bc7019877a5b4b96955"}
Jul 28 16:59:20.397405 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:20.397419    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w" event={"ID":"1f1a702f-8990-4f3a-9084-7dbfd2e8eee4","Type":"ContainerStarted","Data":"acda8cf8a05afa274d32ae225940bf7150ede4b815da68baa3fa800c5501bfbd"}
Jul 28 16:59:20.398033 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:20.397432    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w" event={"ID":"1f1a702f-8990-4f3a-9084-7dbfd2e8eee4","Type":"ContainerStarted","Data":"26e2650dc67dedeb548a4652c93ba15481f577ec0b46d3a28741856bfe95922d"}
Jul 28 16:59:22.972309 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:22.972248    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w"
Jul 28 16:59:22.972780 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:22.972327    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w"
Jul 28 16:59:22.972780 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:22.972343    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w"
Jul 28 16:59:22.974210 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:22.974167    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w" podUID="1f1a702f-8990-4f3a-9084-7dbfd2e8eee4" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.23:8816: connect: connection refused"
Jul 28 16:59:22.974210 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:22.974193    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w" podUID="1f1a702f-8990-4f3a-9084-7dbfd2e8eee4" containerName="online" probeResult="failure" output="Get \"https://10.134.0.23:6567/health\": dial tcp 10.134.0.23:6567: connect: connection refused"
Jul 28 16:59:22.974413 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:22.974188    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w" podUID="1f1a702f-8990-4f3a-9084-7dbfd2e8eee4" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.23:8443: connect: connection refused"
Jul 28 16:59:25.974021 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:25.973992    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w"
Jul 28 16:59:25.974477 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:25.974092    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w"
Jul 28 16:59:25.974477 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:25.974455    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w"
Jul 28 16:59:25.974566 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:25.974487    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w"
Jul 28 16:59:25.974857 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:25.974836    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w"
Jul 28 16:59:25.975006 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:25.974957    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w"
Jul 28 16:59:25.980380 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:25.980361    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w"
Jul 28 16:59:26.003737 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:26.003692    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w" podStartSLOduration=19.003678531 podStartE2EDuration="19.003678531s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 16:59:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 16:59:20.430367806 +0000 UTC m=+549.901781489" watchObservedRunningTime="2026-07-28 16:59:26.003678531 +0000 UTC m=+555.475092191"
Jul 28 16:59:26.423980 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:26.423874    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w"
Jul 28 16:59:26.428350 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:26.428329    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w"
Jul 28 16:59:26.743209 ip-10-0-128-92 kubenswrapper[2561]: I0728 16:59:26.743178    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:00:28.454866 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:28.454838    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:00:28.475669 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:28.475634    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w"]
Jul 28 17:00:28.475952 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:28.475910    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w" podUID="1f1a702f-8990-4f3a-9084-7dbfd2e8eee4" containerName="online" containerID="cri-o://26e2650dc67dedeb548a4652c93ba15481f577ec0b46d3a28741856bfe95922d" gracePeriod=30
Jul 28 17:00:28.476050 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:28.475927    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w" podUID="1f1a702f-8990-4f3a-9084-7dbfd2e8eee4" containerName="offline" containerID="cri-o://acda8cf8a05afa274d32ae225940bf7150ede4b815da68baa3fa800c5501bfbd" gracePeriod=30
Jul 28 17:00:28.476050 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:28.475927    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w" podUID="1f1a702f-8990-4f3a-9084-7dbfd2e8eee4" containerName="ui" containerID="cri-o://3d0f646b28497cbce242a8e19ec3b553e1e3b65142144bc7019877a5b4b96955" gracePeriod=30
Jul 28 17:00:28.597869 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:28.597843    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd"]
Jul 28 17:00:28.598118 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:28.598082    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd" podUID="88a760bb-d8a8-449e-9517-ab57697b9b42" containerName="registry" containerID="cri-o://5f5aa749881169c87ca1d04e917d10c2191817a2bbae8e297cdb3de2a37c5c54" gracePeriod=30
Jul 28 17:00:28.598245 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:28.598181    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd" podUID="88a760bb-d8a8-449e-9517-ab57697b9b42" containerName="offline" containerID="cri-o://82d90d9ad864cea34053b0f4a88879c8050257771a984366874d1a9ed15aec07" gracePeriod=30
Jul 28 17:00:28.598309 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:28.598178    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd" podUID="88a760bb-d8a8-449e-9517-ab57697b9b42" containerName="online" containerID="cri-o://33cd678fa89d32813d52686c4831715ede9e96b860cf565dba07a5a6c70483b4" gracePeriod=30
Jul 28 17:00:28.598364 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:28.598189    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd" podUID="88a760bb-d8a8-449e-9517-ab57697b9b42" containerName="ui" containerID="cri-o://e45f596232af771fe3e12a129d8f7f65b17de723d15dfe11f6b6a517ffaf536e" gracePeriod=30
Jul 28 17:00:29.664832 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:29.664804    2561 generic.go:356] "Generic (PLEG): container finished" podID="88a760bb-d8a8-449e-9517-ab57697b9b42" containerID="e45f596232af771fe3e12a129d8f7f65b17de723d15dfe11f6b6a517ffaf536e" exitCode=0
Jul 28 17:00:29.664832 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:29.664829    2561 generic.go:356] "Generic (PLEG): container finished" podID="88a760bb-d8a8-449e-9517-ab57697b9b42" containerID="33cd678fa89d32813d52686c4831715ede9e96b860cf565dba07a5a6c70483b4" exitCode=0
Jul 28 17:00:29.665313 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:29.664873    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd" event={"ID":"88a760bb-d8a8-449e-9517-ab57697b9b42","Type":"ContainerDied","Data":"e45f596232af771fe3e12a129d8f7f65b17de723d15dfe11f6b6a517ffaf536e"}
Jul 28 17:00:29.665313 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:29.664912    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd" event={"ID":"88a760bb-d8a8-449e-9517-ab57697b9b42","Type":"ContainerDied","Data":"33cd678fa89d32813d52686c4831715ede9e96b860cf565dba07a5a6c70483b4"}
Jul 28 17:00:29.667376 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:29.667355    2561 generic.go:356] "Generic (PLEG): container finished" podID="1f1a702f-8990-4f3a-9084-7dbfd2e8eee4" containerID="3d0f646b28497cbce242a8e19ec3b553e1e3b65142144bc7019877a5b4b96955" exitCode=0
Jul 28 17:00:29.667376 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:29.667375    2561 generic.go:356] "Generic (PLEG): container finished" podID="1f1a702f-8990-4f3a-9084-7dbfd2e8eee4" containerID="26e2650dc67dedeb548a4652c93ba15481f577ec0b46d3a28741856bfe95922d" exitCode=0
Jul 28 17:00:29.667514 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:29.667418    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w" event={"ID":"1f1a702f-8990-4f3a-9084-7dbfd2e8eee4","Type":"ContainerDied","Data":"3d0f646b28497cbce242a8e19ec3b553e1e3b65142144bc7019877a5b4b96955"}
Jul 28 17:00:29.667514 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:29.667444    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w" event={"ID":"1f1a702f-8990-4f3a-9084-7dbfd2e8eee4","Type":"ContainerDied","Data":"26e2650dc67dedeb548a4652c93ba15481f577ec0b46d3a28741856bfe95922d"}
Jul 28 17:00:29.849805 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:29.849760    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:00:31.084523 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:31.084490    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd" podUID="88a760bb-d8a8-449e-9517-ab57697b9b42" containerName="online" probeResult="failure" output="Get \"https://10.134.0.22:6567/health\": dial tcp 10.134.0.22:6567: connect: connection refused"
Jul 28 17:00:33.732245 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:33.732210    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:00:34.095203 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:34.095117    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd" podUID="88a760bb-d8a8-449e-9517-ab57697b9b42" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.22:8443: connect: connection refused"
Jul 28 17:00:35.975472 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:35.975433    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w" podUID="1f1a702f-8990-4f3a-9084-7dbfd2e8eee4" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.23:8443: connect: connection refused"
Jul 28 17:00:36.424072 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:36.423974    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w" podUID="1f1a702f-8990-4f3a-9084-7dbfd2e8eee4" containerName="online" probeResult="failure" output="Get \"https://10.134.0.23:6567/health\": dial tcp 10.134.0.23:6567: connect: connection refused"
Jul 28 17:00:41.083840 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:41.083799    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd" podUID="88a760bb-d8a8-449e-9517-ab57697b9b42" containerName="online" probeResult="failure" output="Get \"https://10.134.0.22:6567/health\": dial tcp 10.134.0.22:6567: connect: connection refused"
Jul 28 17:00:44.094992 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:44.094926    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd" podUID="88a760bb-d8a8-449e-9517-ab57697b9b42" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.22:8443: connect: connection refused"
Jul 28 17:00:45.975299 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:45.975251    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w" podUID="1f1a702f-8990-4f3a-9084-7dbfd2e8eee4" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.23:8443: connect: connection refused"
Jul 28 17:00:46.424964 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:46.424856    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w" podUID="1f1a702f-8990-4f3a-9084-7dbfd2e8eee4" containerName="online" probeResult="failure" output="Get \"https://10.134.0.23:6567/health\": dial tcp 10.134.0.23:6567: connect: connection refused"
Jul 28 17:00:51.084000 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:51.083924    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd" podUID="88a760bb-d8a8-449e-9517-ab57697b9b42" containerName="online" probeResult="failure" output="Get \"https://10.134.0.22:6567/health\": dial tcp 10.134.0.22:6567: connect: connection refused"
Jul 28 17:00:51.084389 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:51.084066    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd"
Jul 28 17:00:54.094696 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:54.094660    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd" podUID="88a760bb-d8a8-449e-9517-ab57697b9b42" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.22:8443: connect: connection refused"
Jul 28 17:00:54.095099 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:54.094780    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd"
Jul 28 17:00:55.975045 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:55.974997    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w" podUID="1f1a702f-8990-4f3a-9084-7dbfd2e8eee4" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.23:8443: connect: connection refused"
Jul 28 17:00:55.975447 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:55.975099    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w"
Jul 28 17:00:56.424706 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:56.424614    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w" podUID="1f1a702f-8990-4f3a-9084-7dbfd2e8eee4" containerName="online" probeResult="failure" output="Get \"https://10.134.0.23:6567/health\": dial tcp 10.134.0.23:6567: connect: connection refused"
Jul 28 17:00:56.424873 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:56.424735    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w"
Jul 28 17:00:58.781445 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:58.781361    2561 generic.go:356] "Generic (PLEG): container finished" podID="1f1a702f-8990-4f3a-9084-7dbfd2e8eee4" containerID="acda8cf8a05afa274d32ae225940bf7150ede4b815da68baa3fa800c5501bfbd" exitCode=137
Jul 28 17:00:58.781831 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:58.781442    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w" event={"ID":"1f1a702f-8990-4f3a-9084-7dbfd2e8eee4","Type":"ContainerDied","Data":"acda8cf8a05afa274d32ae225940bf7150ede4b815da68baa3fa800c5501bfbd"}
Jul 28 17:00:58.784387 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:58.784364    2561 generic.go:356] "Generic (PLEG): container finished" podID="88a760bb-d8a8-449e-9517-ab57697b9b42" containerID="82d90d9ad864cea34053b0f4a88879c8050257771a984366874d1a9ed15aec07" exitCode=137
Jul 28 17:00:58.784387 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:58.784384    2561 generic.go:356] "Generic (PLEG): container finished" podID="88a760bb-d8a8-449e-9517-ab57697b9b42" containerID="5f5aa749881169c87ca1d04e917d10c2191817a2bbae8e297cdb3de2a37c5c54" exitCode=137
Jul 28 17:00:58.784534 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:58.784409    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd" event={"ID":"88a760bb-d8a8-449e-9517-ab57697b9b42","Type":"ContainerDied","Data":"82d90d9ad864cea34053b0f4a88879c8050257771a984366874d1a9ed15aec07"}
Jul 28 17:00:58.784534 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:58.784438    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd" event={"ID":"88a760bb-d8a8-449e-9517-ab57697b9b42","Type":"ContainerDied","Data":"5f5aa749881169c87ca1d04e917d10c2191817a2bbae8e297cdb3de2a37c5c54"}
Jul 28 17:00:59.123974 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.123922    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w"
Jul 28 17:00:59.238049 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.238027    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-29sjr\" (UniqueName: \"kubernetes.io/projected/1f1a702f-8990-4f3a-9084-7dbfd2e8eee4-kube-api-access-29sjr\") pod \"1f1a702f-8990-4f3a-9084-7dbfd2e8eee4\" (UID: \"1f1a702f-8990-4f3a-9084-7dbfd2e8eee4\") "
Jul 28 17:00:59.238193 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.238076    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/1f1a702f-8990-4f3a-9084-7dbfd2e8eee4-registry-tls\") pod \"1f1a702f-8990-4f3a-9084-7dbfd2e8eee4\" (UID: \"1f1a702f-8990-4f3a-9084-7dbfd2e8eee4\") "
Jul 28 17:00:59.238193 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.238123    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1f1a702f-8990-4f3a-9084-7dbfd2e8eee4-offline-tls\") pod \"1f1a702f-8990-4f3a-9084-7dbfd2e8eee4\" (UID: \"1f1a702f-8990-4f3a-9084-7dbfd2e8eee4\") "
Jul 28 17:00:59.238193 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.238175    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1f1a702f-8990-4f3a-9084-7dbfd2e8eee4-online-tls\") pod \"1f1a702f-8990-4f3a-9084-7dbfd2e8eee4\" (UID: \"1f1a702f-8990-4f3a-9084-7dbfd2e8eee4\") "
Jul 28 17:00:59.238358 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.238199    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1f1a702f-8990-4f3a-9084-7dbfd2e8eee4-ui-tls\") pod \"1f1a702f-8990-4f3a-9084-7dbfd2e8eee4\" (UID: \"1f1a702f-8990-4f3a-9084-7dbfd2e8eee4\") "
Jul 28 17:00:59.238358 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.238237    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1f1a702f-8990-4f3a-9084-7dbfd2e8eee4-feast-data\") pod \"1f1a702f-8990-4f3a-9084-7dbfd2e8eee4\" (UID: \"1f1a702f-8990-4f3a-9084-7dbfd2e8eee4\") "
Jul 28 17:00:59.238465 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.238408    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f1a702f-8990-4f3a-9084-7dbfd2e8eee4-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1f1a702f-8990-4f3a-9084-7dbfd2e8eee4" (UID: "1f1a702f-8990-4f3a-9084-7dbfd2e8eee4"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:00:59.238519 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.238491    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/1f1a702f-8990-4f3a-9084-7dbfd2e8eee4-registry-tls\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:00:59.238900 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.238813    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f1a702f-8990-4f3a-9084-7dbfd2e8eee4-feast-data" (OuterVolumeSpecName: "feast-data") pod "1f1a702f-8990-4f3a-9084-7dbfd2e8eee4" (UID: "1f1a702f-8990-4f3a-9084-7dbfd2e8eee4"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:00:59.240443 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.240418    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f1a702f-8990-4f3a-9084-7dbfd2e8eee4-online-tls" (OuterVolumeSpecName: "online-tls") pod "1f1a702f-8990-4f3a-9084-7dbfd2e8eee4" (UID: "1f1a702f-8990-4f3a-9084-7dbfd2e8eee4"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:00:59.240662 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.240644    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f1a702f-8990-4f3a-9084-7dbfd2e8eee4-kube-api-access-29sjr" (OuterVolumeSpecName: "kube-api-access-29sjr") pod "1f1a702f-8990-4f3a-9084-7dbfd2e8eee4" (UID: "1f1a702f-8990-4f3a-9084-7dbfd2e8eee4"). InnerVolumeSpecName "kube-api-access-29sjr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:00:59.240892 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.240875    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f1a702f-8990-4f3a-9084-7dbfd2e8eee4-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "1f1a702f-8990-4f3a-9084-7dbfd2e8eee4" (UID: "1f1a702f-8990-4f3a-9084-7dbfd2e8eee4"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:00:59.240986 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.240898    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f1a702f-8990-4f3a-9084-7dbfd2e8eee4-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "1f1a702f-8990-4f3a-9084-7dbfd2e8eee4" (UID: "1f1a702f-8990-4f3a-9084-7dbfd2e8eee4"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:00:59.242598 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.242583    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd"
Jul 28 17:00:59.339770 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.339678    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/88a760bb-d8a8-449e-9517-ab57697b9b42-registry-tls\") pod \"88a760bb-d8a8-449e-9517-ab57697b9b42\" (UID: \"88a760bb-d8a8-449e-9517-ab57697b9b42\") "
Jul 28 17:00:59.339770 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.339713    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/88a760bb-d8a8-449e-9517-ab57697b9b42-offline-tls\") pod \"88a760bb-d8a8-449e-9517-ab57697b9b42\" (UID: \"88a760bb-d8a8-449e-9517-ab57697b9b42\") "
Jul 28 17:00:59.339770 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.339755    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/88a760bb-d8a8-449e-9517-ab57697b9b42-feast-data\") pod \"88a760bb-d8a8-449e-9517-ab57697b9b42\" (UID: \"88a760bb-d8a8-449e-9517-ab57697b9b42\") "
Jul 28 17:00:59.339770 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.339773    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/88a760bb-d8a8-449e-9517-ab57697b9b42-online-tls\") pod \"88a760bb-d8a8-449e-9517-ab57697b9b42\" (UID: \"88a760bb-d8a8-449e-9517-ab57697b9b42\") "
Jul 28 17:00:59.340128 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.339833    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/88a760bb-d8a8-449e-9517-ab57697b9b42-ui-tls\") pod \"88a760bb-d8a8-449e-9517-ab57697b9b42\" (UID: \"88a760bb-d8a8-449e-9517-ab57697b9b42\") "
Jul 28 17:00:59.340128 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.339888    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jbbjz\" (UniqueName: \"kubernetes.io/projected/88a760bb-d8a8-449e-9517-ab57697b9b42-kube-api-access-jbbjz\") pod \"88a760bb-d8a8-449e-9517-ab57697b9b42\" (UID: \"88a760bb-d8a8-449e-9517-ab57697b9b42\") "
Jul 28 17:00:59.340239 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.340154    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29sjr\" (UniqueName: \"kubernetes.io/projected/1f1a702f-8990-4f3a-9084-7dbfd2e8eee4-kube-api-access-29sjr\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:00:59.340239 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.340176    2561 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1f1a702f-8990-4f3a-9084-7dbfd2e8eee4-offline-tls\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:00:59.340239 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.340193    2561 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1f1a702f-8990-4f3a-9084-7dbfd2e8eee4-online-tls\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:00:59.340239 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.340209    2561 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1f1a702f-8990-4f3a-9084-7dbfd2e8eee4-ui-tls\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:00:59.340239 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.340223    2561 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1f1a702f-8990-4f3a-9084-7dbfd2e8eee4-feast-data\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:00:59.340467 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.340329    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/88a760bb-d8a8-449e-9517-ab57697b9b42-feast-data" (OuterVolumeSpecName: "feast-data") pod "88a760bb-d8a8-449e-9517-ab57697b9b42" (UID: "88a760bb-d8a8-449e-9517-ab57697b9b42"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:00:59.342173 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.342142    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88a760bb-d8a8-449e-9517-ab57697b9b42-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "88a760bb-d8a8-449e-9517-ab57697b9b42" (UID: "88a760bb-d8a8-449e-9517-ab57697b9b42"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:00:59.342173 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.342150    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88a760bb-d8a8-449e-9517-ab57697b9b42-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "88a760bb-d8a8-449e-9517-ab57697b9b42" (UID: "88a760bb-d8a8-449e-9517-ab57697b9b42"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:00:59.342348 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.342218    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88a760bb-d8a8-449e-9517-ab57697b9b42-online-tls" (OuterVolumeSpecName: "online-tls") pod "88a760bb-d8a8-449e-9517-ab57697b9b42" (UID: "88a760bb-d8a8-449e-9517-ab57697b9b42"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:00:59.342507 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.342488    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88a760bb-d8a8-449e-9517-ab57697b9b42-kube-api-access-jbbjz" (OuterVolumeSpecName: "kube-api-access-jbbjz") pod "88a760bb-d8a8-449e-9517-ab57697b9b42" (UID: "88a760bb-d8a8-449e-9517-ab57697b9b42"). InnerVolumeSpecName "kube-api-access-jbbjz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:00:59.342580 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.342520    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88a760bb-d8a8-449e-9517-ab57697b9b42-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "88a760bb-d8a8-449e-9517-ab57697b9b42" (UID: "88a760bb-d8a8-449e-9517-ab57697b9b42"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:00:59.441219 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.441187    2561 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/88a760bb-d8a8-449e-9517-ab57697b9b42-feast-data\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:00:59.441219 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.441212    2561 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/88a760bb-d8a8-449e-9517-ab57697b9b42-online-tls\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:00:59.441219 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.441221    2561 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/88a760bb-d8a8-449e-9517-ab57697b9b42-ui-tls\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:00:59.441424 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.441229    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jbbjz\" (UniqueName: \"kubernetes.io/projected/88a760bb-d8a8-449e-9517-ab57697b9b42-kube-api-access-jbbjz\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:00:59.441424 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.441239    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/88a760bb-d8a8-449e-9517-ab57697b9b42-registry-tls\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:00:59.441424 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.441248    2561 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/88a760bb-d8a8-449e-9517-ab57697b9b42-offline-tls\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:00:59.793178 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.793142    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd"
Jul 28 17:00:59.793581 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.793142    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd" event={"ID":"88a760bb-d8a8-449e-9517-ab57697b9b42","Type":"ContainerDied","Data":"11d68966ec27d7e00c5722722ab43f73a4ea49f1933303faeea67377f9738c8d"}
Jul 28 17:00:59.793581 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.793286    2561 scope.go:117] "RemoveContainer" containerID="e45f596232af771fe3e12a129d8f7f65b17de723d15dfe11f6b6a517ffaf536e"
Jul 28 17:00:59.795866 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.795846    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w"
Jul 28 17:00:59.795866 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.795853    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w" event={"ID":"1f1a702f-8990-4f3a-9084-7dbfd2e8eee4","Type":"ContainerDied","Data":"4b5a6b60891be3987dbad44268a5543f8e2e98306483db0064aa8be68cd3f43b"}
Jul 28 17:00:59.802329 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.802310    2561 scope.go:117] "RemoveContainer" containerID="82d90d9ad864cea34053b0f4a88879c8050257771a984366874d1a9ed15aec07"
Jul 28 17:00:59.814366 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.814346    2561 scope.go:117] "RemoveContainer" containerID="33cd678fa89d32813d52686c4831715ede9e96b860cf565dba07a5a6c70483b4"
Jul 28 17:00:59.822115 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.822093    2561 scope.go:117] "RemoveContainer" containerID="5f5aa749881169c87ca1d04e917d10c2191817a2bbae8e297cdb3de2a37c5c54"
Jul 28 17:00:59.822498 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.822474    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w"]
Jul 28 17:00:59.827239 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.827215    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-578b464648-jms2w"]
Jul 28 17:00:59.829700 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.829679    2561 scope.go:117] "RemoveContainer" containerID="5bb0b41ef8240ed1b18cbca3c606915ce62fdb43271b2428632c6a8e4d152cad"
Jul 28 17:00:59.836466 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.836450    2561 scope.go:117] "RemoveContainer" containerID="aa0a997a792aa971ac3aae5eff886eb09ba8f02289c9c97a44016869041a4a46"
Jul 28 17:00:59.843219 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.843204    2561 scope.go:117] "RemoveContainer" containerID="3d0f646b28497cbce242a8e19ec3b553e1e3b65142144bc7019877a5b4b96955"
Jul 28 17:00:59.846234 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.846200    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd"]
Jul 28 17:00:59.850287 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.850269    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-56cb884f74-tjvzd"]
Jul 28 17:00:59.851283 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.851270    2561 scope.go:117] "RemoveContainer" containerID="acda8cf8a05afa274d32ae225940bf7150ede4b815da68baa3fa800c5501bfbd"
Jul 28 17:00:59.857910 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.857893    2561 scope.go:117] "RemoveContainer" containerID="26e2650dc67dedeb548a4652c93ba15481f577ec0b46d3a28741856bfe95922d"
Jul 28 17:00:59.864958 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.864926    2561 scope.go:117] "RemoveContainer" containerID="4c607c6e324b800ed4c350e4f675219135d9b5de679952c1d8556710f3dee4b2"
Jul 28 17:00:59.871408 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:00:59.871391    2561 scope.go:117] "RemoveContainer" containerID="e1e25a0e5030160c0eb4c9ea0194c707c85b60ca19092cb4f76617b87a37108f"
Jul 28 17:01:01.075076 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:01.075048    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f1a702f-8990-4f3a-9084-7dbfd2e8eee4" path="/var/lib/kubelet/pods/1f1a702f-8990-4f3a-9084-7dbfd2e8eee4/volumes"
Jul 28 17:01:01.075571 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:01.075557    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88a760bb-d8a8-449e-9517-ab57697b9b42" path="/var/lib/kubelet/pods/88a760bb-d8a8-449e-9517-ab57697b9b42/volumes"
Jul 28 17:01:09.506992 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:09.506959    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:01:09.782068 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:09.781988    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/postgres-864846d4f5-28h8r"]
Jul 28 17:01:09.782269 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:09.782258    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88a760bb-d8a8-449e-9517-ab57697b9b42" containerName="offline"
Jul 28 17:01:09.782313 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:09.782271    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="88a760bb-d8a8-449e-9517-ab57697b9b42" containerName="offline"
Jul 28 17:01:09.782313 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:09.782281    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88a760bb-d8a8-449e-9517-ab57697b9b42" containerName="registry"
Jul 28 17:01:09.782313 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:09.782286    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="88a760bb-d8a8-449e-9517-ab57697b9b42" containerName="registry"
Jul 28 17:01:09.782313 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:09.782295    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f1a702f-8990-4f3a-9084-7dbfd2e8eee4" containerName="feast-init"
Jul 28 17:01:09.782313 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:09.782300    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f1a702f-8990-4f3a-9084-7dbfd2e8eee4" containerName="feast-init"
Jul 28 17:01:09.782313 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:09.782307    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f1a702f-8990-4f3a-9084-7dbfd2e8eee4" containerName="feast-apply"
Jul 28 17:01:09.782313 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:09.782311    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f1a702f-8990-4f3a-9084-7dbfd2e8eee4" containerName="feast-apply"
Jul 28 17:01:09.782516 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:09.782319    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88a760bb-d8a8-449e-9517-ab57697b9b42" containerName="feast-init"
Jul 28 17:01:09.782516 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:09.782324    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="88a760bb-d8a8-449e-9517-ab57697b9b42" containerName="feast-init"
Jul 28 17:01:09.782516 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:09.782333    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88a760bb-d8a8-449e-9517-ab57697b9b42" containerName="online"
Jul 28 17:01:09.782516 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:09.782338    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="88a760bb-d8a8-449e-9517-ab57697b9b42" containerName="online"
Jul 28 17:01:09.782516 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:09.782345    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88a760bb-d8a8-449e-9517-ab57697b9b42" containerName="ui"
Jul 28 17:01:09.782516 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:09.782350    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="88a760bb-d8a8-449e-9517-ab57697b9b42" containerName="ui"
Jul 28 17:01:09.782516 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:09.782357    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f1a702f-8990-4f3a-9084-7dbfd2e8eee4" containerName="online"
Jul 28 17:01:09.782516 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:09.782361    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f1a702f-8990-4f3a-9084-7dbfd2e8eee4" containerName="online"
Jul 28 17:01:09.782516 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:09.782367    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f1a702f-8990-4f3a-9084-7dbfd2e8eee4" containerName="offline"
Jul 28 17:01:09.782516 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:09.782372    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f1a702f-8990-4f3a-9084-7dbfd2e8eee4" containerName="offline"
Jul 28 17:01:09.782516 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:09.782379    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88a760bb-d8a8-449e-9517-ab57697b9b42" containerName="feast-apply"
Jul 28 17:01:09.782516 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:09.782384    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="88a760bb-d8a8-449e-9517-ab57697b9b42" containerName="feast-apply"
Jul 28 17:01:09.782516 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:09.782390    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f1a702f-8990-4f3a-9084-7dbfd2e8eee4" containerName="ui"
Jul 28 17:01:09.782516 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:09.782396    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f1a702f-8990-4f3a-9084-7dbfd2e8eee4" containerName="ui"
Jul 28 17:01:09.782516 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:09.782435    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="88a760bb-d8a8-449e-9517-ab57697b9b42" containerName="offline"
Jul 28 17:01:09.782516 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:09.782443    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="88a760bb-d8a8-449e-9517-ab57697b9b42" containerName="registry"
Jul 28 17:01:09.782516 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:09.782449    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f1a702f-8990-4f3a-9084-7dbfd2e8eee4" containerName="online"
Jul 28 17:01:09.782516 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:09.782455    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f1a702f-8990-4f3a-9084-7dbfd2e8eee4" containerName="ui"
Jul 28 17:01:09.782516 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:09.782460    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="88a760bb-d8a8-449e-9517-ab57697b9b42" containerName="online"
Jul 28 17:01:09.782516 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:09.782466    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f1a702f-8990-4f3a-9084-7dbfd2e8eee4" containerName="offline"
Jul 28 17:01:09.782516 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:09.782472    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="88a760bb-d8a8-449e-9517-ab57697b9b42" containerName="ui"
Jul 28 17:01:09.785412 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:09.785398    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-28h8r"
Jul 28 17:01:09.788334 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:09.788313    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Jul 28 17:01:09.788478 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:09.788375    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\""
Jul 28 17:01:09.789445 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:09.789430    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Jul 28 17:01:09.789527 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:09.789442    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-grmdq\""
Jul 28 17:01:09.798275 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:09.798255    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-28h8r"]
Jul 28 17:01:09.823579 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:09.823554    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:01:09.832219 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:09.832199    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/redis-69bbd798b6-v9szx"]
Jul 28 17:01:09.835801 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:09.835783    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-v9szx"
Jul 28 17:01:09.843319 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:09.843301    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-v9szx"]
Jul 28 17:01:09.912527 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:09.912500    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:01:09.922752 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:09.922727    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/365f848b-7b77-4640-be0f-4c867a607e0a-postgresdata\") pod \"postgres-864846d4f5-28h8r\" (UID: \"365f848b-7b77-4640-be0f-4c867a607e0a\") " pod="test-ns-feast/postgres-864846d4f5-28h8r"
Jul 28 17:01:09.922816 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:09.922763    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pm64b\" (UniqueName: \"kubernetes.io/projected/365f848b-7b77-4640-be0f-4c867a607e0a-kube-api-access-pm64b\") pod \"postgres-864846d4f5-28h8r\" (UID: \"365f848b-7b77-4640-be0f-4c867a607e0a\") " pod="test-ns-feast/postgres-864846d4f5-28h8r"
Jul 28 17:01:09.922816 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:09.922791    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52frw\" (UniqueName: \"kubernetes.io/projected/f0a65d51-b38a-4ead-a31e-a4a8de9a85e0-kube-api-access-52frw\") pod \"redis-69bbd798b6-v9szx\" (UID: \"f0a65d51-b38a-4ead-a31e-a4a8de9a85e0\") " pod="test-ns-feast/redis-69bbd798b6-v9szx"
Jul 28 17:01:10.024000 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:10.023960    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/365f848b-7b77-4640-be0f-4c867a607e0a-postgresdata\") pod \"postgres-864846d4f5-28h8r\" (UID: \"365f848b-7b77-4640-be0f-4c867a607e0a\") " pod="test-ns-feast/postgres-864846d4f5-28h8r"
Jul 28 17:01:10.024000 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:10.024007    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pm64b\" (UniqueName: \"kubernetes.io/projected/365f848b-7b77-4640-be0f-4c867a607e0a-kube-api-access-pm64b\") pod \"postgres-864846d4f5-28h8r\" (UID: \"365f848b-7b77-4640-be0f-4c867a607e0a\") " pod="test-ns-feast/postgres-864846d4f5-28h8r"
Jul 28 17:01:10.024153 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:10.024044    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52frw\" (UniqueName: \"kubernetes.io/projected/f0a65d51-b38a-4ead-a31e-a4a8de9a85e0-kube-api-access-52frw\") pod \"redis-69bbd798b6-v9szx\" (UID: \"f0a65d51-b38a-4ead-a31e-a4a8de9a85e0\") " pod="test-ns-feast/redis-69bbd798b6-v9szx"
Jul 28 17:01:10.024298 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:10.024281    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/365f848b-7b77-4640-be0f-4c867a607e0a-postgresdata\") pod \"postgres-864846d4f5-28h8r\" (UID: \"365f848b-7b77-4640-be0f-4c867a607e0a\") " pod="test-ns-feast/postgres-864846d4f5-28h8r"
Jul 28 17:01:10.034875 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:10.034822    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52frw\" (UniqueName: \"kubernetes.io/projected/f0a65d51-b38a-4ead-a31e-a4a8de9a85e0-kube-api-access-52frw\") pod \"redis-69bbd798b6-v9szx\" (UID: \"f0a65d51-b38a-4ead-a31e-a4a8de9a85e0\") " pod="test-ns-feast/redis-69bbd798b6-v9szx"
Jul 28 17:01:10.034977 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:10.034954    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pm64b\" (UniqueName: \"kubernetes.io/projected/365f848b-7b77-4640-be0f-4c867a607e0a-kube-api-access-pm64b\") pod \"postgres-864846d4f5-28h8r\" (UID: \"365f848b-7b77-4640-be0f-4c867a607e0a\") " pod="test-ns-feast/postgres-864846d4f5-28h8r"
Jul 28 17:01:10.103790 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:10.103759    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-28h8r"
Jul 28 17:01:10.145152 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:10.145123    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-v9szx"
Jul 28 17:01:10.243637 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:10.243614    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-28h8r"]
Jul 28 17:01:10.245987 ip-10-0-128-92 kubenswrapper[2561]: W0728 17:01:10.245962    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod365f848b_7b77_4640_be0f_4c867a607e0a.slice/crio-a15eadf2abdf3ba34e4865ed764923b804e4852ff4f0f4540e9a8024bf8702b7 WatchSource:0}: Error finding container a15eadf2abdf3ba34e4865ed764923b804e4852ff4f0f4540e9a8024bf8702b7: Status 404 returned error can't find the container with id a15eadf2abdf3ba34e4865ed764923b804e4852ff4f0f4540e9a8024bf8702b7
Jul 28 17:01:10.248430 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:10.248409    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 17:01:10.287127 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:10.287073    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/redis-69bbd798b6-v9szx"]
Jul 28 17:01:10.290081 ip-10-0-128-92 kubenswrapper[2561]: W0728 17:01:10.290061    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0a65d51_b38a_4ead_a31e_a4a8de9a85e0.slice/crio-91a9b14fe468091f13d4049eb64b398b96cd0dac258ef9a11c193bd238d145c4 WatchSource:0}: Error finding container 91a9b14fe468091f13d4049eb64b398b96cd0dac258ef9a11c193bd238d145c4: Status 404 returned error can't find the container with id 91a9b14fe468091f13d4049eb64b398b96cd0dac258ef9a11c193bd238d145c4
Jul 28 17:01:10.836389 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:10.836354    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-v9szx" event={"ID":"f0a65d51-b38a-4ead-a31e-a4a8de9a85e0","Type":"ContainerStarted","Data":"91a9b14fe468091f13d4049eb64b398b96cd0dac258ef9a11c193bd238d145c4"}
Jul 28 17:01:10.837455 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:10.837431    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-28h8r" event={"ID":"365f848b-7b77-4640-be0f-4c867a607e0a","Type":"ContainerStarted","Data":"a15eadf2abdf3ba34e4865ed764923b804e4852ff4f0f4540e9a8024bf8702b7"}
Jul 28 17:01:11.842096 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:11.842058    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-v9szx" event={"ID":"f0a65d51-b38a-4ead-a31e-a4a8de9a85e0","Type":"ContainerStarted","Data":"3b4b79d9fd1bef31493d0cf88527477934a2a3285be672a99e6b696a6b2bb8f2"}
Jul 28 17:01:11.861976 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:11.861914    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/redis-69bbd798b6-v9szx" podStartSLOduration=1.407870597 podStartE2EDuration="2.861898619s" totalImagesPullingTime="1.454028022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:01:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:01:11.861237486 +0000 UTC m=+661.332651161" watchObservedRunningTime="2026-07-28 17:01:11.861898619 +0000 UTC m=+661.333312291"
Jul 28 17:01:17.810786 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:17.810764    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\""
Jul 28 17:01:18.875991 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:18.875953    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-28h8r" event={"ID":"365f848b-7b77-4640-be0f-4c867a607e0a","Type":"ContainerStarted","Data":"d550ee6d7043329eb39e2c2810f4f5751227cd132cd4cb7ef094111787fb726b"}
Jul 28 17:01:18.896814 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:18.896763    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/postgres-864846d4f5-28h8r" podStartSLOduration=2.337952703 podStartE2EDuration="9.896749211s" totalImagesPullingTime="7.558796508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:01:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:01:18.893698427 +0000 UTC m=+668.365112089" watchObservedRunningTime="2026-07-28 17:01:18.896749211 +0000 UTC m=+668.368162870"
Jul 28 17:01:22.420291 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:22.420236    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:01:22.518072 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:22.518038    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:01:22.560148 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:22.560118    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-credit-scoring-58d77f89-dmlc4"]
Jul 28 17:01:22.567382 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:22.567355    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4"
Jul 28 17:01:22.570100 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:22.570074    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-online-tls\""
Jul 28 17:01:22.570219 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:22.570088    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-registry-tls\""
Jul 28 17:01:22.570219 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:22.570088    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-offline-tls\""
Jul 28 17:01:22.570219 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:22.570100    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\""
Jul 28 17:01:22.570470 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:22.570150    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-9lxlg\""
Jul 28 17:01:22.577598 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:22.577577    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-58d77f89-dmlc4"]
Jul 28 17:01:22.724319 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:22.724294    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5xknm\" (UniqueName: \"kubernetes.io/projected/52e46e12-4f36-441d-acd9-62929007beb4-kube-api-access-5xknm\") pod \"feast-credit-scoring-58d77f89-dmlc4\" (UID: \"52e46e12-4f36-441d-acd9-62929007beb4\") " pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4"
Jul 28 17:01:22.724495 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:22.724327    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/52e46e12-4f36-441d-acd9-62929007beb4-online-tls\") pod \"feast-credit-scoring-58d77f89-dmlc4\" (UID: \"52e46e12-4f36-441d-acd9-62929007beb4\") " pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4"
Jul 28 17:01:22.724495 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:22.724343    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/52e46e12-4f36-441d-acd9-62929007beb4-offline-tls\") pod \"feast-credit-scoring-58d77f89-dmlc4\" (UID: \"52e46e12-4f36-441d-acd9-62929007beb4\") " pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4"
Jul 28 17:01:22.724495 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:22.724358    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/52e46e12-4f36-441d-acd9-62929007beb4-feast-data\") pod \"feast-credit-scoring-58d77f89-dmlc4\" (UID: \"52e46e12-4f36-441d-acd9-62929007beb4\") " pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4"
Jul 28 17:01:22.724495 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:22.724451    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/52e46e12-4f36-441d-acd9-62929007beb4-registry-tls\") pod \"feast-credit-scoring-58d77f89-dmlc4\" (UID: \"52e46e12-4f36-441d-acd9-62929007beb4\") " pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4"
Jul 28 17:01:22.770149 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:22.770109    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:01:22.824911 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:22.824877    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5xknm\" (UniqueName: \"kubernetes.io/projected/52e46e12-4f36-441d-acd9-62929007beb4-kube-api-access-5xknm\") pod \"feast-credit-scoring-58d77f89-dmlc4\" (UID: \"52e46e12-4f36-441d-acd9-62929007beb4\") " pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4"
Jul 28 17:01:22.825039 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:22.824922    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/52e46e12-4f36-441d-acd9-62929007beb4-online-tls\") pod \"feast-credit-scoring-58d77f89-dmlc4\" (UID: \"52e46e12-4f36-441d-acd9-62929007beb4\") " pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4"
Jul 28 17:01:22.825039 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:22.824968    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/52e46e12-4f36-441d-acd9-62929007beb4-offline-tls\") pod \"feast-credit-scoring-58d77f89-dmlc4\" (UID: \"52e46e12-4f36-441d-acd9-62929007beb4\") " pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4"
Jul 28 17:01:22.825039 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:22.824989    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/52e46e12-4f36-441d-acd9-62929007beb4-feast-data\") pod \"feast-credit-scoring-58d77f89-dmlc4\" (UID: \"52e46e12-4f36-441d-acd9-62929007beb4\") " pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4"
Jul 28 17:01:22.825039 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:22.825026    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/52e46e12-4f36-441d-acd9-62929007beb4-registry-tls\") pod \"feast-credit-scoring-58d77f89-dmlc4\" (UID: \"52e46e12-4f36-441d-acd9-62929007beb4\") " pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4"
Jul 28 17:01:22.825209 ip-10-0-128-92 kubenswrapper[2561]: E0728 17:01:22.825042    2561 secret.go:189] Couldn't get secret test-ns-feast/feast-credit-scoring-online-tls: secret "feast-credit-scoring-online-tls" not found
Jul 28 17:01:22.825209 ip-10-0-128-92 kubenswrapper[2561]: E0728 17:01:22.825109    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52e46e12-4f36-441d-acd9-62929007beb4-online-tls podName:52e46e12-4f36-441d-acd9-62929007beb4 nodeName:}" failed. No retries permitted until 2026-07-28 17:01:23.325089969 +0000 UTC m=+672.796503608 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/52e46e12-4f36-441d-acd9-62929007beb4-online-tls") pod "feast-credit-scoring-58d77f89-dmlc4" (UID: "52e46e12-4f36-441d-acd9-62929007beb4") : secret "feast-credit-scoring-online-tls" not found
Jul 28 17:01:22.825449 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:22.825430    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/52e46e12-4f36-441d-acd9-62929007beb4-feast-data\") pod \"feast-credit-scoring-58d77f89-dmlc4\" (UID: \"52e46e12-4f36-441d-acd9-62929007beb4\") " pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4"
Jul 28 17:01:22.827647 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:22.827631    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/52e46e12-4f36-441d-acd9-62929007beb4-registry-tls\") pod \"feast-credit-scoring-58d77f89-dmlc4\" (UID: \"52e46e12-4f36-441d-acd9-62929007beb4\") " pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4"
Jul 28 17:01:22.827704 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:22.827644    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/52e46e12-4f36-441d-acd9-62929007beb4-offline-tls\") pod \"feast-credit-scoring-58d77f89-dmlc4\" (UID: \"52e46e12-4f36-441d-acd9-62929007beb4\") " pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4"
Jul 28 17:01:22.834498 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:22.834479    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5xknm\" (UniqueName: \"kubernetes.io/projected/52e46e12-4f36-441d-acd9-62929007beb4-kube-api-access-5xknm\") pod \"feast-credit-scoring-58d77f89-dmlc4\" (UID: \"52e46e12-4f36-441d-acd9-62929007beb4\") " pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4"
Jul 28 17:01:22.870194 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:22.870171    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:01:22.972096 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:22.972070    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:01:23.329259 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:23.329225    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/52e46e12-4f36-441d-acd9-62929007beb4-online-tls\") pod \"feast-credit-scoring-58d77f89-dmlc4\" (UID: \"52e46e12-4f36-441d-acd9-62929007beb4\") " pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4"
Jul 28 17:01:23.331809 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:23.331786    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/52e46e12-4f36-441d-acd9-62929007beb4-online-tls\") pod \"feast-credit-scoring-58d77f89-dmlc4\" (UID: \"52e46e12-4f36-441d-acd9-62929007beb4\") " pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4"
Jul 28 17:01:23.479350 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:23.479322    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4"
Jul 28 17:01:23.616109 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:23.616083    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-58d77f89-dmlc4"]
Jul 28 17:01:23.616950 ip-10-0-128-92 kubenswrapper[2561]: W0728 17:01:23.616912    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52e46e12_4f36_441d_acd9_62929007beb4.slice/crio-219150dda31c605b759cd82c53a709fbdb1aca5abd54bb14ebaf51eb93f346e6 WatchSource:0}: Error finding container 219150dda31c605b759cd82c53a709fbdb1aca5abd54bb14ebaf51eb93f346e6: Status 404 returned error can't find the container with id 219150dda31c605b759cd82c53a709fbdb1aca5abd54bb14ebaf51eb93f346e6
Jul 28 17:01:23.897106 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:23.897026    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4" event={"ID":"52e46e12-4f36-441d-acd9-62929007beb4","Type":"ContainerStarted","Data":"1628be6bee5141bed5bb6a6b917482cb1be42391aaf939d2be266fecf7a51729"}
Jul 28 17:01:23.897106 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:23.897081    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4" event={"ID":"52e46e12-4f36-441d-acd9-62929007beb4","Type":"ContainerStarted","Data":"219150dda31c605b759cd82c53a709fbdb1aca5abd54bb14ebaf51eb93f346e6"}
Jul 28 17:01:24.902002 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:24.901904    2561 generic.go:356] "Generic (PLEG): container finished" podID="52e46e12-4f36-441d-acd9-62929007beb4" containerID="1628be6bee5141bed5bb6a6b917482cb1be42391aaf939d2be266fecf7a51729" exitCode=0
Jul 28 17:01:24.902343 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:24.901995    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4" event={"ID":"52e46e12-4f36-441d-acd9-62929007beb4","Type":"ContainerDied","Data":"1628be6bee5141bed5bb6a6b917482cb1be42391aaf939d2be266fecf7a51729"}
Jul 28 17:01:25.908411 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:25.908380    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4" event={"ID":"52e46e12-4f36-441d-acd9-62929007beb4","Type":"ContainerStarted","Data":"8313d18bfee358eafd457f0815c0d1b82c3183eeb1a061cdb5cab8618e878aa4"}
Jul 28 17:01:31.933863 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:31.933829    2561 generic.go:356] "Generic (PLEG): container finished" podID="52e46e12-4f36-441d-acd9-62929007beb4" containerID="8313d18bfee358eafd457f0815c0d1b82c3183eeb1a061cdb5cab8618e878aa4" exitCode=0
Jul 28 17:01:31.934279 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:31.933888    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4" event={"ID":"52e46e12-4f36-441d-acd9-62929007beb4","Type":"ContainerDied","Data":"8313d18bfee358eafd457f0815c0d1b82c3183eeb1a061cdb5cab8618e878aa4"}
Jul 28 17:01:32.950008 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:32.949969    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4" event={"ID":"52e46e12-4f36-441d-acd9-62929007beb4","Type":"ContainerStarted","Data":"cdb87d950a78b46014cc4b7f131e210e1b76db9c0dddda53e84281da9bca9afd"}
Jul 28 17:01:32.950364 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:32.950080    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4" event={"ID":"52e46e12-4f36-441d-acd9-62929007beb4","Type":"ContainerStarted","Data":"a5e06bb51ff7dfb8be58c396197beb214b846416d5b1151d3d10f06ced9f797d"}
Jul 28 17:01:32.950364 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:32.950112    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4" event={"ID":"52e46e12-4f36-441d-acd9-62929007beb4","Type":"ContainerStarted","Data":"e29110de0c971d88aaabe333b9a8e8d3dd3507e1f38fc3867795be61cf045550"}
Jul 28 17:01:32.979166 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:32.979097    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4" podStartSLOduration=10.979076888 podStartE2EDuration="10.979076888s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:01:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:01:32.97696967 +0000 UTC m=+682.448383331" watchObservedRunningTime="2026-07-28 17:01:32.979076888 +0000 UTC m=+682.450490550"
Jul 28 17:01:33.479447 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:33.479396    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4"
Jul 28 17:01:33.479635 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:33.479500    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4"
Jul 28 17:01:33.479635 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:33.479527    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4"
Jul 28 17:01:35.479614 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:35.479561    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4"
Jul 28 17:01:35.480122 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:35.479688    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4"
Jul 28 17:01:35.480122 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:35.479715    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4"
Jul 28 17:01:35.481314 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:35.481275    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4" podUID="52e46e12-4f36-441d-acd9-62929007beb4" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.26:6571: connect: connection refused"
Jul 28 17:01:35.481314 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:35.481297    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4" podUID="52e46e12-4f36-441d-acd9-62929007beb4" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.26:8816: connect: connection refused"
Jul 28 17:01:35.481510 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:35.481313    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4" podUID="52e46e12-4f36-441d-acd9-62929007beb4" containerName="online" probeResult="failure" output="Get \"https://10.134.0.26:6567/health\": dial tcp 10.134.0.26:6567: connect: connection refused"
Jul 28 17:01:38.480340 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:38.480296    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4" podUID="52e46e12-4f36-441d-acd9-62929007beb4" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.26:6571: connect: connection refused"
Jul 28 17:01:38.481239 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:38.481216    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4"
Jul 28 17:01:38.482103 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:38.482079    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4"
Jul 28 17:01:38.486141 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:38.486119    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4"
Jul 28 17:01:38.982422 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:38.982389    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4"
Jul 28 17:01:39.657447 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:39.657397    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:01:41.479793 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:41.479737    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4" podUID="52e46e12-4f36-441d-acd9-62929007beb4" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.26:6571: connect: connection refused"
Jul 28 17:01:44.480699 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:44.480670    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4"
Jul 28 17:01:44.481518 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:44.481499    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4"
Jul 28 17:01:44.702674 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:01:44.702619    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:02:43.044742 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:02:43.044701    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:02:48.029886 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:02:48.029851    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-58d77f89-dmlc4"]
Jul 28 17:02:48.030299 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:02:48.030103    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4" podUID="52e46e12-4f36-441d-acd9-62929007beb4" containerName="registry" containerID="cri-o://e29110de0c971d88aaabe333b9a8e8d3dd3507e1f38fc3867795be61cf045550" gracePeriod=30
Jul 28 17:02:48.030299 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:02:48.030132    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4" podUID="52e46e12-4f36-441d-acd9-62929007beb4" containerName="offline" containerID="cri-o://cdb87d950a78b46014cc4b7f131e210e1b76db9c0dddda53e84281da9bca9afd" gracePeriod=30
Jul 28 17:02:48.030299 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:02:48.030142    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4" podUID="52e46e12-4f36-441d-acd9-62929007beb4" containerName="online" containerID="cri-o://a5e06bb51ff7dfb8be58c396197beb214b846416d5b1151d3d10f06ced9f797d" gracePeriod=30
Jul 28 17:02:48.048901 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:02:48.048869    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-28h8r"]
Jul 28 17:02:48.049052 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:02:48.049021    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/postgres-864846d4f5-28h8r" podUID="365f848b-7b77-4640-be0f-4c867a607e0a" containerName="postgres" containerID="cri-o://d550ee6d7043329eb39e2c2810f4f5751227cd132cd4cb7ef094111787fb726b" gracePeriod=30
Jul 28 17:02:48.058238 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:02:48.058217    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-v9szx"]
Jul 28 17:02:48.058397 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:02:48.058365    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/redis-69bbd798b6-v9szx" podUID="f0a65d51-b38a-4ead-a31e-a4a8de9a85e0" containerName="redis" containerID="cri-o://3b4b79d9fd1bef31493d0cf88527477934a2a3285be672a99e6b696a6b2bb8f2" gracePeriod=30
Jul 28 17:02:48.115613 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:02:48.115584    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:02:48.248581 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:02:48.248554    2561 generic.go:356] "Generic (PLEG): container finished" podID="f0a65d51-b38a-4ead-a31e-a4a8de9a85e0" containerID="3b4b79d9fd1bef31493d0cf88527477934a2a3285be672a99e6b696a6b2bb8f2" exitCode=0
Jul 28 17:02:48.248731 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:02:48.248626    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-v9szx" event={"ID":"f0a65d51-b38a-4ead-a31e-a4a8de9a85e0","Type":"ContainerDied","Data":"3b4b79d9fd1bef31493d0cf88527477934a2a3285be672a99e6b696a6b2bb8f2"}
Jul 28 17:02:48.250088 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:02:48.250067    2561 generic.go:356] "Generic (PLEG): container finished" podID="365f848b-7b77-4640-be0f-4c867a607e0a" containerID="d550ee6d7043329eb39e2c2810f4f5751227cd132cd4cb7ef094111787fb726b" exitCode=0
Jul 28 17:02:48.250207 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:02:48.250137    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-28h8r" event={"ID":"365f848b-7b77-4640-be0f-4c867a607e0a","Type":"ContainerDied","Data":"d550ee6d7043329eb39e2c2810f4f5751227cd132cd4cb7ef094111787fb726b"}
Jul 28 17:02:48.320543 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:02:48.320522    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-28h8r"
Jul 28 17:02:48.323445 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:02:48.323426    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-v9szx"
Jul 28 17:02:48.384902 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:02:48.384871    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-52frw\" (UniqueName: \"kubernetes.io/projected/f0a65d51-b38a-4ead-a31e-a4a8de9a85e0-kube-api-access-52frw\") pod \"f0a65d51-b38a-4ead-a31e-a4a8de9a85e0\" (UID: \"f0a65d51-b38a-4ead-a31e-a4a8de9a85e0\") "
Jul 28 17:02:48.385083 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:02:48.384976    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pm64b\" (UniqueName: \"kubernetes.io/projected/365f848b-7b77-4640-be0f-4c867a607e0a-kube-api-access-pm64b\") pod \"365f848b-7b77-4640-be0f-4c867a607e0a\" (UID: \"365f848b-7b77-4640-be0f-4c867a607e0a\") "
Jul 28 17:02:48.385083 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:02:48.385014    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/365f848b-7b77-4640-be0f-4c867a607e0a-postgresdata\") pod \"365f848b-7b77-4640-be0f-4c867a607e0a\" (UID: \"365f848b-7b77-4640-be0f-4c867a607e0a\") "
Jul 28 17:02:48.387185 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:02:48.387158    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0a65d51-b38a-4ead-a31e-a4a8de9a85e0-kube-api-access-52frw" (OuterVolumeSpecName: "kube-api-access-52frw") pod "f0a65d51-b38a-4ead-a31e-a4a8de9a85e0" (UID: "f0a65d51-b38a-4ead-a31e-a4a8de9a85e0"). InnerVolumeSpecName "kube-api-access-52frw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:02:48.387185 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:02:48.387168    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/365f848b-7b77-4640-be0f-4c867a607e0a-kube-api-access-pm64b" (OuterVolumeSpecName: "kube-api-access-pm64b") pod "365f848b-7b77-4640-be0f-4c867a607e0a" (UID: "365f848b-7b77-4640-be0f-4c867a607e0a"). InnerVolumeSpecName "kube-api-access-pm64b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:02:48.422563 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:02:48.422535    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/365f848b-7b77-4640-be0f-4c867a607e0a-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "365f848b-7b77-4640-be0f-4c867a607e0a" (UID: "365f848b-7b77-4640-be0f-4c867a607e0a"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:02:48.485627 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:02:48.485595    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pm64b\" (UniqueName: \"kubernetes.io/projected/365f848b-7b77-4640-be0f-4c867a607e0a-kube-api-access-pm64b\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:02:48.485627 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:02:48.485624    2561 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/365f848b-7b77-4640-be0f-4c867a607e0a-postgresdata\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:02:48.485627 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:02:48.485635    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52frw\" (UniqueName: \"kubernetes.io/projected/f0a65d51-b38a-4ead-a31e-a4a8de9a85e0-kube-api-access-52frw\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:02:48.978564 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:02:48.978528    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4" podUID="52e46e12-4f36-441d-acd9-62929007beb4" containerName="online" probeResult="failure" output="Get \"https://10.134.0.26:6567/health\": dial tcp 10.134.0.26:6567: connect: connection refused"
Jul 28 17:02:49.255186 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:02:49.255111    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/redis-69bbd798b6-v9szx"
Jul 28 17:02:49.255686 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:02:49.255111    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/redis-69bbd798b6-v9szx" event={"ID":"f0a65d51-b38a-4ead-a31e-a4a8de9a85e0","Type":"ContainerDied","Data":"91a9b14fe468091f13d4049eb64b398b96cd0dac258ef9a11c193bd238d145c4"}
Jul 28 17:02:49.255686 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:02:49.255238    2561 scope.go:117] "RemoveContainer" containerID="3b4b79d9fd1bef31493d0cf88527477934a2a3285be672a99e6b696a6b2bb8f2"
Jul 28 17:02:49.258406 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:02:49.258379    2561 generic.go:356] "Generic (PLEG): container finished" podID="52e46e12-4f36-441d-acd9-62929007beb4" containerID="a5e06bb51ff7dfb8be58c396197beb214b846416d5b1151d3d10f06ced9f797d" exitCode=0
Jul 28 17:02:49.258507 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:02:49.258447    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4" event={"ID":"52e46e12-4f36-441d-acd9-62929007beb4","Type":"ContainerDied","Data":"a5e06bb51ff7dfb8be58c396197beb214b846416d5b1151d3d10f06ced9f797d"}
Jul 28 17:02:49.259800 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:02:49.259782    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-28h8r"
Jul 28 17:02:49.259880 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:02:49.259783    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-28h8r" event={"ID":"365f848b-7b77-4640-be0f-4c867a607e0a","Type":"ContainerDied","Data":"a15eadf2abdf3ba34e4865ed764923b804e4852ff4f0f4540e9a8024bf8702b7"}
Jul 28 17:02:49.263849 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:02:49.263831    2561 scope.go:117] "RemoveContainer" containerID="d550ee6d7043329eb39e2c2810f4f5751227cd132cd4cb7ef094111787fb726b"
Jul 28 17:02:49.280633 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:02:49.280612    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/redis-69bbd798b6-v9szx"]
Jul 28 17:02:49.283390 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:02:49.283372    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/redis-69bbd798b6-v9szx"]
Jul 28 17:02:49.297706 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:02:49.297688    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-28h8r"]
Jul 28 17:02:49.303828 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:02:49.303808    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/postgres-864846d4f5-28h8r"]
Jul 28 17:02:51.075135 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:02:51.075107    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="365f848b-7b77-4640-be0f-4c867a607e0a" path="/var/lib/kubelet/pods/365f848b-7b77-4640-be0f-4c867a607e0a/volumes"
Jul 28 17:02:51.075493 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:02:51.075385    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0a65d51-b38a-4ead-a31e-a4a8de9a85e0" path="/var/lib/kubelet/pods/f0a65d51-b38a-4ead-a31e-a4a8de9a85e0/volumes"
Jul 28 17:02:58.978772 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:02:58.978731    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4" podUID="52e46e12-4f36-441d-acd9-62929007beb4" containerName="online" probeResult="failure" output="Get \"https://10.134.0.26:6567/health\": dial tcp 10.134.0.26:6567: connect: connection refused"
Jul 28 17:03:08.978257 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:03:08.978215    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4" podUID="52e46e12-4f36-441d-acd9-62929007beb4" containerName="online" probeResult="failure" output="Get \"https://10.134.0.26:6567/health\": dial tcp 10.134.0.26:6567: connect: connection refused"
Jul 28 17:03:08.978708 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:03:08.978344    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4"
Jul 28 17:03:18.364689 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:03:18.364609    2561 generic.go:356] "Generic (PLEG): container finished" podID="52e46e12-4f36-441d-acd9-62929007beb4" containerID="cdb87d950a78b46014cc4b7f131e210e1b76db9c0dddda53e84281da9bca9afd" exitCode=137
Jul 28 17:03:18.364689 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:03:18.364636    2561 generic.go:356] "Generic (PLEG): container finished" podID="52e46e12-4f36-441d-acd9-62929007beb4" containerID="e29110de0c971d88aaabe333b9a8e8d3dd3507e1f38fc3867795be61cf045550" exitCode=137
Jul 28 17:03:18.365073 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:03:18.364682    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4" event={"ID":"52e46e12-4f36-441d-acd9-62929007beb4","Type":"ContainerDied","Data":"cdb87d950a78b46014cc4b7f131e210e1b76db9c0dddda53e84281da9bca9afd"}
Jul 28 17:03:18.365073 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:03:18.364754    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4" event={"ID":"52e46e12-4f36-441d-acd9-62929007beb4","Type":"ContainerDied","Data":"e29110de0c971d88aaabe333b9a8e8d3dd3507e1f38fc3867795be61cf045550"}
Jul 28 17:03:18.482493 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:03:18.482465    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4" podUID="52e46e12-4f36-441d-acd9-62929007beb4" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.26:8816: connect: connection refused"
Jul 28 17:03:18.676409 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:03:18.676386    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4"
Jul 28 17:03:18.798354 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:03:18.798329    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/52e46e12-4f36-441d-acd9-62929007beb4-offline-tls\") pod \"52e46e12-4f36-441d-acd9-62929007beb4\" (UID: \"52e46e12-4f36-441d-acd9-62929007beb4\") "
Jul 28 17:03:18.798501 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:03:18.798369    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5xknm\" (UniqueName: \"kubernetes.io/projected/52e46e12-4f36-441d-acd9-62929007beb4-kube-api-access-5xknm\") pod \"52e46e12-4f36-441d-acd9-62929007beb4\" (UID: \"52e46e12-4f36-441d-acd9-62929007beb4\") "
Jul 28 17:03:18.798501 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:03:18.798386    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/52e46e12-4f36-441d-acd9-62929007beb4-online-tls\") pod \"52e46e12-4f36-441d-acd9-62929007beb4\" (UID: \"52e46e12-4f36-441d-acd9-62929007beb4\") "
Jul 28 17:03:18.798501 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:03:18.798405    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/52e46e12-4f36-441d-acd9-62929007beb4-registry-tls\") pod \"52e46e12-4f36-441d-acd9-62929007beb4\" (UID: \"52e46e12-4f36-441d-acd9-62929007beb4\") "
Jul 28 17:03:18.798501 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:03:18.798444    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/52e46e12-4f36-441d-acd9-62929007beb4-feast-data\") pod \"52e46e12-4f36-441d-acd9-62929007beb4\" (UID: \"52e46e12-4f36-441d-acd9-62929007beb4\") "
Jul 28 17:03:18.800633 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:03:18.800602    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52e46e12-4f36-441d-acd9-62929007beb4-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "52e46e12-4f36-441d-acd9-62929007beb4" (UID: "52e46e12-4f36-441d-acd9-62929007beb4"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:03:18.800633 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:03:18.800615    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52e46e12-4f36-441d-acd9-62929007beb4-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "52e46e12-4f36-441d-acd9-62929007beb4" (UID: "52e46e12-4f36-441d-acd9-62929007beb4"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:03:18.800771 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:03:18.800635    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/52e46e12-4f36-441d-acd9-62929007beb4-online-tls" (OuterVolumeSpecName: "online-tls") pod "52e46e12-4f36-441d-acd9-62929007beb4" (UID: "52e46e12-4f36-441d-acd9-62929007beb4"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:03:18.800838 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:03:18.800817    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52e46e12-4f36-441d-acd9-62929007beb4-kube-api-access-5xknm" (OuterVolumeSpecName: "kube-api-access-5xknm") pod "52e46e12-4f36-441d-acd9-62929007beb4" (UID: "52e46e12-4f36-441d-acd9-62929007beb4"). InnerVolumeSpecName "kube-api-access-5xknm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:03:18.806836 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:03:18.806815    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/52e46e12-4f36-441d-acd9-62929007beb4-feast-data" (OuterVolumeSpecName: "feast-data") pod "52e46e12-4f36-441d-acd9-62929007beb4" (UID: "52e46e12-4f36-441d-acd9-62929007beb4"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:03:18.899146 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:03:18.899113    2561 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/52e46e12-4f36-441d-acd9-62929007beb4-feast-data\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:03:18.899146 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:03:18.899142    2561 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/52e46e12-4f36-441d-acd9-62929007beb4-offline-tls\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:03:18.899146 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:03:18.899151    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5xknm\" (UniqueName: \"kubernetes.io/projected/52e46e12-4f36-441d-acd9-62929007beb4-kube-api-access-5xknm\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:03:18.899301 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:03:18.899178    2561 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/52e46e12-4f36-441d-acd9-62929007beb4-online-tls\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:03:18.899301 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:03:18.899187    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/52e46e12-4f36-441d-acd9-62929007beb4-registry-tls\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:03:19.370779 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:03:19.370707    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4"
Jul 28 17:03:19.371207 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:03:19.370709    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-58d77f89-dmlc4" event={"ID":"52e46e12-4f36-441d-acd9-62929007beb4","Type":"ContainerDied","Data":"219150dda31c605b759cd82c53a709fbdb1aca5abd54bb14ebaf51eb93f346e6"}
Jul 28 17:03:19.371207 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:03:19.370842    2561 scope.go:117] "RemoveContainer" containerID="cdb87d950a78b46014cc4b7f131e210e1b76db9c0dddda53e84281da9bca9afd"
Jul 28 17:03:19.379187 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:03:19.379169    2561 scope.go:117] "RemoveContainer" containerID="a5e06bb51ff7dfb8be58c396197beb214b846416d5b1151d3d10f06ced9f797d"
Jul 28 17:03:19.386187 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:03:19.386169    2561 scope.go:117] "RemoveContainer" containerID="e29110de0c971d88aaabe333b9a8e8d3dd3507e1f38fc3867795be61cf045550"
Jul 28 17:03:19.393561 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:03:19.393542    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-58d77f89-dmlc4"]
Jul 28 17:03:19.393704 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:03:19.393690    2561 scope.go:117] "RemoveContainer" containerID="8313d18bfee358eafd457f0815c0d1b82c3183eeb1a061cdb5cab8618e878aa4"
Jul 28 17:03:19.400496 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:03:19.400476    2561 scope.go:117] "RemoveContainer" containerID="1628be6bee5141bed5bb6a6b917482cb1be42391aaf939d2be266fecf7a51729"
Jul 28 17:03:19.403295 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:03:19.403275    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-credit-scoring-58d77f89-dmlc4"]
Jul 28 17:03:21.075056 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:03:21.075021    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52e46e12-4f36-441d-acd9-62929007beb4" path="/var/lib/kubelet/pods/52e46e12-4f36-441d-acd9-62929007beb4/volumes"
Jul 28 17:03:25.322695 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:03:25.322659    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:03:25.449279 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:03:25.449240    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:03:26.179592 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:03:26.179558    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:03:26.668919 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:03:26.668884    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:04:03.469960 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:04:03.469902    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:04:31.585628 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:04:31.585587    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:05:30.872764 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:30.872736    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:05:31.062461 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:31.062430    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-d5c69"]
Jul 28 17:05:31.062780 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:31.062763    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52e46e12-4f36-441d-acd9-62929007beb4" containerName="offline"
Jul 28 17:05:31.062868 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:31.062783    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="52e46e12-4f36-441d-acd9-62929007beb4" containerName="offline"
Jul 28 17:05:31.062868 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:31.062799    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0a65d51-b38a-4ead-a31e-a4a8de9a85e0" containerName="redis"
Jul 28 17:05:31.062868 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:31.062807    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0a65d51-b38a-4ead-a31e-a4a8de9a85e0" containerName="redis"
Jul 28 17:05:31.062868 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:31.062815    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="365f848b-7b77-4640-be0f-4c867a607e0a" containerName="postgres"
Jul 28 17:05:31.062868 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:31.062824    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="365f848b-7b77-4640-be0f-4c867a607e0a" containerName="postgres"
Jul 28 17:05:31.062868 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:31.062832    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52e46e12-4f36-441d-acd9-62929007beb4" containerName="feast-init"
Jul 28 17:05:31.062868 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:31.062840    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="52e46e12-4f36-441d-acd9-62929007beb4" containerName="feast-init"
Jul 28 17:05:31.062868 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:31.062848    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52e46e12-4f36-441d-acd9-62929007beb4" containerName="online"
Jul 28 17:05:31.062868 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:31.062856    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="52e46e12-4f36-441d-acd9-62929007beb4" containerName="online"
Jul 28 17:05:31.063309 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:31.062877    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52e46e12-4f36-441d-acd9-62929007beb4" containerName="feast-apply"
Jul 28 17:05:31.063309 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:31.062885    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="52e46e12-4f36-441d-acd9-62929007beb4" containerName="feast-apply"
Jul 28 17:05:31.063309 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:31.062906    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52e46e12-4f36-441d-acd9-62929007beb4" containerName="registry"
Jul 28 17:05:31.063309 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:31.062914    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="52e46e12-4f36-441d-acd9-62929007beb4" containerName="registry"
Jul 28 17:05:31.063309 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:31.063015    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="52e46e12-4f36-441d-acd9-62929007beb4" containerName="online"
Jul 28 17:05:31.063309 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:31.063028    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0a65d51-b38a-4ead-a31e-a4a8de9a85e0" containerName="redis"
Jul 28 17:05:31.063309 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:31.063041    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="365f848b-7b77-4640-be0f-4c867a607e0a" containerName="postgres"
Jul 28 17:05:31.063309 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:31.063050    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="52e46e12-4f36-441d-acd9-62929007beb4" containerName="offline"
Jul 28 17:05:31.063309 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:31.063060    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="52e46e12-4f36-441d-acd9-62929007beb4" containerName="registry"
Jul 28 17:05:31.065962 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:31.065924    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-d5c69"
Jul 28 17:05:31.068887 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:31.068867    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\""
Jul 28 17:05:31.069993 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:31.069977    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\""
Jul 28 17:05:31.070090 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:31.069991    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"default-dockercfg-q8jsx\""
Jul 28 17:05:31.085976 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:31.085925    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-d5c69"]
Jul 28 17:05:31.167052 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:31.166995    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swcrc\" (UniqueName: \"kubernetes.io/projected/af9345b6-be5a-4e0a-a9ac-9384e3152232-kube-api-access-swcrc\") pod \"redis-69bbd798b6-d5c69\" (UID: \"af9345b6-be5a-4e0a-a9ac-9384e3152232\") " pod="test-ns-feast-rest/redis-69bbd798b6-d5c69"
Jul 28 17:05:31.267726 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:31.267695    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swcrc\" (UniqueName: \"kubernetes.io/projected/af9345b6-be5a-4e0a-a9ac-9384e3152232-kube-api-access-swcrc\") pod \"redis-69bbd798b6-d5c69\" (UID: \"af9345b6-be5a-4e0a-a9ac-9384e3152232\") " pod="test-ns-feast-rest/redis-69bbd798b6-d5c69"
Jul 28 17:05:31.278665 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:31.278639    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swcrc\" (UniqueName: \"kubernetes.io/projected/af9345b6-be5a-4e0a-a9ac-9384e3152232-kube-api-access-swcrc\") pod \"redis-69bbd798b6-d5c69\" (UID: \"af9345b6-be5a-4e0a-a9ac-9384e3152232\") " pod="test-ns-feast-rest/redis-69bbd798b6-d5c69"
Jul 28 17:05:31.388507 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:31.388482    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-d5c69"
Jul 28 17:05:31.518789 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:31.518694    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-d5c69"]
Jul 28 17:05:31.521523 ip-10-0-128-92 kubenswrapper[2561]: W0728 17:05:31.521495    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaf9345b6_be5a_4e0a_a9ac_9384e3152232.slice/crio-a3e9910895b042f8ccfbc61b6fa97a273013b0178feb829a33fe45cbbf951b7c WatchSource:0}: Error finding container a3e9910895b042f8ccfbc61b6fa97a273013b0178feb829a33fe45cbbf951b7c: Status 404 returned error can't find the container with id a3e9910895b042f8ccfbc61b6fa97a273013b0178feb829a33fe45cbbf951b7c
Jul 28 17:05:31.845781 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:31.845744    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-d5c69" event={"ID":"af9345b6-be5a-4e0a-a9ac-9384e3152232","Type":"ContainerStarted","Data":"abfd65612a49aabcabfe9d98e11eb931c75369f25ea9e8e18c743b3f929c6533"}
Jul 28 17:05:31.845966 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:31.845791    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-d5c69" event={"ID":"af9345b6-be5a-4e0a-a9ac-9384e3152232","Type":"ContainerStarted","Data":"a3e9910895b042f8ccfbc61b6fa97a273013b0178feb829a33fe45cbbf951b7c"}
Jul 28 17:05:31.863375 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:31.863324    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/redis-69bbd798b6-d5c69" podStartSLOduration=0.863305595 podStartE2EDuration="863.305595ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:05:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:05:31.862721291 +0000 UTC m=+921.334134972" watchObservedRunningTime="2026-07-28 17:05:31.863305595 +0000 UTC m=+921.334719255"
Jul 28 17:05:32.899037 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:32.898992    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:05:36.544872 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:36.544841    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-g2ndm"]
Jul 28 17:05:36.547830 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:36.547814    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-g2ndm"
Jul 28 17:05:36.550665 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:36.550644    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\""
Jul 28 17:05:36.560199 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:36.560178    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-g2ndm"]
Jul 28 17:05:36.592075 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:36.592054    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:05:36.708827 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:36.708791    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ssfw\" (UniqueName: \"kubernetes.io/projected/f48b9c26-abc5-4c18-9606-8bb0b3b786ed-kube-api-access-6ssfw\") pod \"postgres-864846d4f5-g2ndm\" (UID: \"f48b9c26-abc5-4c18-9606-8bb0b3b786ed\") " pod="test-ns-feast-rest/postgres-864846d4f5-g2ndm"
Jul 28 17:05:36.708977 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:36.708854    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/f48b9c26-abc5-4c18-9606-8bb0b3b786ed-postgresdata\") pod \"postgres-864846d4f5-g2ndm\" (UID: \"f48b9c26-abc5-4c18-9606-8bb0b3b786ed\") " pod="test-ns-feast-rest/postgres-864846d4f5-g2ndm"
Jul 28 17:05:36.809773 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:36.809716    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ssfw\" (UniqueName: \"kubernetes.io/projected/f48b9c26-abc5-4c18-9606-8bb0b3b786ed-kube-api-access-6ssfw\") pod \"postgres-864846d4f5-g2ndm\" (UID: \"f48b9c26-abc5-4c18-9606-8bb0b3b786ed\") " pod="test-ns-feast-rest/postgres-864846d4f5-g2ndm"
Jul 28 17:05:36.809773 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:36.809758    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/f48b9c26-abc5-4c18-9606-8bb0b3b786ed-postgresdata\") pod \"postgres-864846d4f5-g2ndm\" (UID: \"f48b9c26-abc5-4c18-9606-8bb0b3b786ed\") " pod="test-ns-feast-rest/postgres-864846d4f5-g2ndm"
Jul 28 17:05:36.810076 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:36.810063    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/f48b9c26-abc5-4c18-9606-8bb0b3b786ed-postgresdata\") pod \"postgres-864846d4f5-g2ndm\" (UID: \"f48b9c26-abc5-4c18-9606-8bb0b3b786ed\") " pod="test-ns-feast-rest/postgres-864846d4f5-g2ndm"
Jul 28 17:05:36.820568 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:36.820541    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ssfw\" (UniqueName: \"kubernetes.io/projected/f48b9c26-abc5-4c18-9606-8bb0b3b786ed-kube-api-access-6ssfw\") pod \"postgres-864846d4f5-g2ndm\" (UID: \"f48b9c26-abc5-4c18-9606-8bb0b3b786ed\") " pod="test-ns-feast-rest/postgres-864846d4f5-g2ndm"
Jul 28 17:05:36.856490 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:36.856455    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-g2ndm"
Jul 28 17:05:36.984406 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:36.984380    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-g2ndm"]
Jul 28 17:05:36.986474 ip-10-0-128-92 kubenswrapper[2561]: W0728 17:05:36.986445    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf48b9c26_abc5_4c18_9606_8bb0b3b786ed.slice/crio-3c2db2547f2a83f9d5546a866dd808d92cd72052b3a8b0bf44fa23f9ee3553da WatchSource:0}: Error finding container 3c2db2547f2a83f9d5546a866dd808d92cd72052b3a8b0bf44fa23f9ee3553da: Status 404 returned error can't find the container with id 3c2db2547f2a83f9d5546a866dd808d92cd72052b3a8b0bf44fa23f9ee3553da
Jul 28 17:05:37.868761 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:37.868724    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-g2ndm" event={"ID":"f48b9c26-abc5-4c18-9606-8bb0b3b786ed","Type":"ContainerStarted","Data":"090605835ccee29f6ed4d21d1dfb01a9d1936f841359759ad08078c45628ba34"}
Jul 28 17:05:37.868761 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:37.868761    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-g2ndm" event={"ID":"f48b9c26-abc5-4c18-9606-8bb0b3b786ed","Type":"ContainerStarted","Data":"3c2db2547f2a83f9d5546a866dd808d92cd72052b3a8b0bf44fa23f9ee3553da"}
Jul 28 17:05:37.887525 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:37.887456    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/postgres-864846d4f5-g2ndm" podStartSLOduration=1.887442396 podStartE2EDuration="1.887442396s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:05:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:05:37.88610263 +0000 UTC m=+927.357516292" watchObservedRunningTime="2026-07-28 17:05:37.887442396 +0000 UTC m=+927.358856055"
Jul 28 17:05:42.105429 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:42.105393    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:05:42.210238 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:42.210194    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:05:42.237608 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:42.237575    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-84f65bb66f-447t4"]
Jul 28 17:05:42.241039 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:42.241024    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-84f65bb66f-447t4"
Jul 28 17:05:42.245970 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:42.245920    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-registry-tls\""
Jul 28 17:05:42.246094 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:42.245985    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\""
Jul 28 17:05:42.246495 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:42.246474    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-online-tls\""
Jul 28 17:05:42.246641 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:42.246621    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-dockercfg-dncrv\""
Jul 28 17:05:42.248837 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:42.248817    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a0be23bb-8bf7-4363-88a5-aaf513a298fe-feast-data\") pod \"feast-credit-scoring-84f65bb66f-447t4\" (UID: \"a0be23bb-8bf7-4363-88a5-aaf513a298fe\") " pod="test-ns-feast-rest/feast-credit-scoring-84f65bb66f-447t4"
Jul 28 17:05:42.248955 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:42.248874    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a0be23bb-8bf7-4363-88a5-aaf513a298fe-registry-tls\") pod \"feast-credit-scoring-84f65bb66f-447t4\" (UID: \"a0be23bb-8bf7-4363-88a5-aaf513a298fe\") " pod="test-ns-feast-rest/feast-credit-scoring-84f65bb66f-447t4"
Jul 28 17:05:42.248955 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:42.248926    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a0be23bb-8bf7-4363-88a5-aaf513a298fe-online-tls\") pod \"feast-credit-scoring-84f65bb66f-447t4\" (UID: \"a0be23bb-8bf7-4363-88a5-aaf513a298fe\") " pod="test-ns-feast-rest/feast-credit-scoring-84f65bb66f-447t4"
Jul 28 17:05:42.249060 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:42.248989    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lxtcg\" (UniqueName: \"kubernetes.io/projected/a0be23bb-8bf7-4363-88a5-aaf513a298fe-kube-api-access-lxtcg\") pod \"feast-credit-scoring-84f65bb66f-447t4\" (UID: \"a0be23bb-8bf7-4363-88a5-aaf513a298fe\") " pod="test-ns-feast-rest/feast-credit-scoring-84f65bb66f-447t4"
Jul 28 17:05:42.261550 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:42.261529    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-84f65bb66f-447t4"]
Jul 28 17:05:42.349791 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:42.349758    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a0be23bb-8bf7-4363-88a5-aaf513a298fe-feast-data\") pod \"feast-credit-scoring-84f65bb66f-447t4\" (UID: \"a0be23bb-8bf7-4363-88a5-aaf513a298fe\") " pod="test-ns-feast-rest/feast-credit-scoring-84f65bb66f-447t4"
Jul 28 17:05:42.349996 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:42.349806    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a0be23bb-8bf7-4363-88a5-aaf513a298fe-registry-tls\") pod \"feast-credit-scoring-84f65bb66f-447t4\" (UID: \"a0be23bb-8bf7-4363-88a5-aaf513a298fe\") " pod="test-ns-feast-rest/feast-credit-scoring-84f65bb66f-447t4"
Jul 28 17:05:42.349996 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:42.349827    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a0be23bb-8bf7-4363-88a5-aaf513a298fe-online-tls\") pod \"feast-credit-scoring-84f65bb66f-447t4\" (UID: \"a0be23bb-8bf7-4363-88a5-aaf513a298fe\") " pod="test-ns-feast-rest/feast-credit-scoring-84f65bb66f-447t4"
Jul 28 17:05:42.349996 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:42.349865    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lxtcg\" (UniqueName: \"kubernetes.io/projected/a0be23bb-8bf7-4363-88a5-aaf513a298fe-kube-api-access-lxtcg\") pod \"feast-credit-scoring-84f65bb66f-447t4\" (UID: \"a0be23bb-8bf7-4363-88a5-aaf513a298fe\") " pod="test-ns-feast-rest/feast-credit-scoring-84f65bb66f-447t4"
Jul 28 17:05:42.349996 ip-10-0-128-92 kubenswrapper[2561]: E0728 17:05:42.349920    2561 secret.go:189] Couldn't get secret test-ns-feast-rest/feast-credit-scoring-registry-tls: secret "feast-credit-scoring-registry-tls" not found
Jul 28 17:05:42.349996 ip-10-0-128-92 kubenswrapper[2561]: E0728 17:05:42.349999    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a0be23bb-8bf7-4363-88a5-aaf513a298fe-registry-tls podName:a0be23bb-8bf7-4363-88a5-aaf513a298fe nodeName:}" failed. No retries permitted until 2026-07-28 17:05:42.849983859 +0000 UTC m=+932.321397496 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/a0be23bb-8bf7-4363-88a5-aaf513a298fe-registry-tls") pod "feast-credit-scoring-84f65bb66f-447t4" (UID: "a0be23bb-8bf7-4363-88a5-aaf513a298fe") : secret "feast-credit-scoring-registry-tls" not found
Jul 28 17:05:42.350571 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:42.350169    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a0be23bb-8bf7-4363-88a5-aaf513a298fe-feast-data\") pod \"feast-credit-scoring-84f65bb66f-447t4\" (UID: \"a0be23bb-8bf7-4363-88a5-aaf513a298fe\") " pod="test-ns-feast-rest/feast-credit-scoring-84f65bb66f-447t4"
Jul 28 17:05:42.352381 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:42.352356    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a0be23bb-8bf7-4363-88a5-aaf513a298fe-online-tls\") pod \"feast-credit-scoring-84f65bb66f-447t4\" (UID: \"a0be23bb-8bf7-4363-88a5-aaf513a298fe\") " pod="test-ns-feast-rest/feast-credit-scoring-84f65bb66f-447t4"
Jul 28 17:05:42.364671 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:42.364603    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lxtcg\" (UniqueName: \"kubernetes.io/projected/a0be23bb-8bf7-4363-88a5-aaf513a298fe-kube-api-access-lxtcg\") pod \"feast-credit-scoring-84f65bb66f-447t4\" (UID: \"a0be23bb-8bf7-4363-88a5-aaf513a298fe\") " pod="test-ns-feast-rest/feast-credit-scoring-84f65bb66f-447t4"
Jul 28 17:05:42.407636 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:42.407589    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:05:42.509380 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:42.509344    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:05:42.853050 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:42.853016    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a0be23bb-8bf7-4363-88a5-aaf513a298fe-registry-tls\") pod \"feast-credit-scoring-84f65bb66f-447t4\" (UID: \"a0be23bb-8bf7-4363-88a5-aaf513a298fe\") " pod="test-ns-feast-rest/feast-credit-scoring-84f65bb66f-447t4"
Jul 28 17:05:42.855537 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:42.855520    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a0be23bb-8bf7-4363-88a5-aaf513a298fe-registry-tls\") pod \"feast-credit-scoring-84f65bb66f-447t4\" (UID: \"a0be23bb-8bf7-4363-88a5-aaf513a298fe\") " pod="test-ns-feast-rest/feast-credit-scoring-84f65bb66f-447t4"
Jul 28 17:05:43.149884 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:43.149795    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-84f65bb66f-447t4"
Jul 28 17:05:43.287278 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:43.287255    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-84f65bb66f-447t4"]
Jul 28 17:05:43.288108 ip-10-0-128-92 kubenswrapper[2561]: W0728 17:05:43.288084    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0be23bb_8bf7_4363_88a5_aaf513a298fe.slice/crio-df43910601ae3d4b444eeb987e5527353de75f77736101e52b5df83068ef73e8 WatchSource:0}: Error finding container df43910601ae3d4b444eeb987e5527353de75f77736101e52b5df83068ef73e8: Status 404 returned error can't find the container with id df43910601ae3d4b444eeb987e5527353de75f77736101e52b5df83068ef73e8
Jul 28 17:05:43.891361 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:43.891328    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-84f65bb66f-447t4" event={"ID":"a0be23bb-8bf7-4363-88a5-aaf513a298fe","Type":"ContainerStarted","Data":"66370c24247963cfd66faf3368df6264d48d42ef5a8e59fd9d32f9ec04e31d34"}
Jul 28 17:05:43.891529 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:43.891378    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-84f65bb66f-447t4" event={"ID":"a0be23bb-8bf7-4363-88a5-aaf513a298fe","Type":"ContainerStarted","Data":"df43910601ae3d4b444eeb987e5527353de75f77736101e52b5df83068ef73e8"}
Jul 28 17:05:44.896159 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:44.896125    2561 generic.go:356] "Generic (PLEG): container finished" podID="a0be23bb-8bf7-4363-88a5-aaf513a298fe" containerID="66370c24247963cfd66faf3368df6264d48d42ef5a8e59fd9d32f9ec04e31d34" exitCode=0
Jul 28 17:05:44.896547 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:44.896194    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-84f65bb66f-447t4" event={"ID":"a0be23bb-8bf7-4363-88a5-aaf513a298fe","Type":"ContainerDied","Data":"66370c24247963cfd66faf3368df6264d48d42ef5a8e59fd9d32f9ec04e31d34"}
Jul 28 17:05:45.902669 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:45.902635    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-84f65bb66f-447t4" event={"ID":"a0be23bb-8bf7-4363-88a5-aaf513a298fe","Type":"ContainerStarted","Data":"ff811df7f9d219d3edc9d64531bccf68262833540b5f10eee10d19024afa0c37"}
Jul 28 17:05:51.927492 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:51.927414    2561 generic.go:356] "Generic (PLEG): container finished" podID="a0be23bb-8bf7-4363-88a5-aaf513a298fe" containerID="ff811df7f9d219d3edc9d64531bccf68262833540b5f10eee10d19024afa0c37" exitCode=0
Jul 28 17:05:51.927492 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:51.927467    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-84f65bb66f-447t4" event={"ID":"a0be23bb-8bf7-4363-88a5-aaf513a298fe","Type":"ContainerDied","Data":"ff811df7f9d219d3edc9d64531bccf68262833540b5f10eee10d19024afa0c37"}
Jul 28 17:05:52.935909 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:52.935875    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-84f65bb66f-447t4" event={"ID":"a0be23bb-8bf7-4363-88a5-aaf513a298fe","Type":"ContainerStarted","Data":"db8b28f3f1f20b654a3366e88987df5d5e86bf94d064be1c27390346077b0456"}
Jul 28 17:05:52.936302 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:52.935952    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-84f65bb66f-447t4" event={"ID":"a0be23bb-8bf7-4363-88a5-aaf513a298fe","Type":"ContainerStarted","Data":"260718b66fae12d2a1fa16c6192abbdb8a60685f15b815f5ac2991882de675b5"}
Jul 28 17:05:52.963811 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:52.963757    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-credit-scoring-84f65bb66f-447t4" podStartSLOduration=10.963739212 podStartE2EDuration="10.963739212s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:05:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:05:52.96251461 +0000 UTC m=+942.433928285" watchObservedRunningTime="2026-07-28 17:05:52.963739212 +0000 UTC m=+942.435152874"
Jul 28 17:05:53.150913 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:53.150879    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-84f65bb66f-447t4"
Jul 28 17:05:53.151097 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:53.150972    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-84f65bb66f-447t4"
Jul 28 17:05:55.150259 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:55.150224    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-84f65bb66f-447t4"
Jul 28 17:05:55.150639 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:55.150294    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-84f65bb66f-447t4"
Jul 28 17:05:55.151758 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:55.151716    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-84f65bb66f-447t4" podUID="a0be23bb-8bf7-4363-88a5-aaf513a298fe" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.29:6571: connect: connection refused"
Jul 28 17:05:55.151890 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:55.151763    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-84f65bb66f-447t4" podUID="a0be23bb-8bf7-4363-88a5-aaf513a298fe" containerName="online" probeResult="failure" output="Get \"https://10.134.0.29:6567/health\": dial tcp 10.134.0.29:6567: connect: connection refused"
Jul 28 17:05:58.150848 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:58.150792    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-84f65bb66f-447t4" podUID="a0be23bb-8bf7-4363-88a5-aaf513a298fe" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.29:6571: connect: connection refused"
Jul 28 17:05:58.156260 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:58.156229    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-84f65bb66f-447t4"
Jul 28 17:05:58.159474 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:05:58.159449    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-84f65bb66f-447t4"
Jul 28 17:06:01.150739 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:01.150694    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-84f65bb66f-447t4" podUID="a0be23bb-8bf7-4363-88a5-aaf513a298fe" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.29:6571: connect: connection refused"
Jul 28 17:06:04.151771 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:04.151739    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-84f65bb66f-447t4"
Jul 28 17:06:04.152594 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:04.152575    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-84f65bb66f-447t4"
Jul 28 17:06:04.539433 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:04.539402    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:06:08.023513 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:08.023482    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:06:08.174745 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:08.174716    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn"]
Jul 28 17:06:08.178142 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:08.178125    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn"
Jul 28 17:06:08.182497 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:08.182478    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-registry-tls\""
Jul 28 17:06:08.182919 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:08.182906    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\""
Jul 28 17:06:08.183025 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:08.182998    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-online-tls\""
Jul 28 17:06:08.183442 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:08.183425    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-dockercfg-r9bfv\""
Jul 28 17:06:08.192030 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:08.192011    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:06:08.198089 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:08.198071    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn"]
Jul 28 17:06:08.249188 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:08.249159    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/607ded59-7849-4afa-aa03-2050af36d552-online-tls\") pod \"feast-driver-ranking-6975d78fcd-8d5gn\" (UID: \"607ded59-7849-4afa-aa03-2050af36d552\") " pod="test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn"
Jul 28 17:06:08.249373 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:08.249218    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtzxx\" (UniqueName: \"kubernetes.io/projected/607ded59-7849-4afa-aa03-2050af36d552-kube-api-access-qtzxx\") pod \"feast-driver-ranking-6975d78fcd-8d5gn\" (UID: \"607ded59-7849-4afa-aa03-2050af36d552\") " pod="test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn"
Jul 28 17:06:08.249373 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:08.249301    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/607ded59-7849-4afa-aa03-2050af36d552-registry-tls\") pod \"feast-driver-ranking-6975d78fcd-8d5gn\" (UID: \"607ded59-7849-4afa-aa03-2050af36d552\") " pod="test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn"
Jul 28 17:06:08.249373 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:08.249333    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/607ded59-7849-4afa-aa03-2050af36d552-feast-data\") pod \"feast-driver-ranking-6975d78fcd-8d5gn\" (UID: \"607ded59-7849-4afa-aa03-2050af36d552\") " pod="test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn"
Jul 28 17:06:08.259637 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:08.259608    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:06:08.350148 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:08.350064    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/607ded59-7849-4afa-aa03-2050af36d552-registry-tls\") pod \"feast-driver-ranking-6975d78fcd-8d5gn\" (UID: \"607ded59-7849-4afa-aa03-2050af36d552\") " pod="test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn"
Jul 28 17:06:08.350148 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:08.350107    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/607ded59-7849-4afa-aa03-2050af36d552-feast-data\") pod \"feast-driver-ranking-6975d78fcd-8d5gn\" (UID: \"607ded59-7849-4afa-aa03-2050af36d552\") " pod="test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn"
Jul 28 17:06:08.350148 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:08.350129    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/607ded59-7849-4afa-aa03-2050af36d552-online-tls\") pod \"feast-driver-ranking-6975d78fcd-8d5gn\" (UID: \"607ded59-7849-4afa-aa03-2050af36d552\") " pod="test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn"
Jul 28 17:06:08.350385 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:08.350169    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtzxx\" (UniqueName: \"kubernetes.io/projected/607ded59-7849-4afa-aa03-2050af36d552-kube-api-access-qtzxx\") pod \"feast-driver-ranking-6975d78fcd-8d5gn\" (UID: \"607ded59-7849-4afa-aa03-2050af36d552\") " pod="test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn"
Jul 28 17:06:08.350474 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:08.350455    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/607ded59-7849-4afa-aa03-2050af36d552-feast-data\") pod \"feast-driver-ranking-6975d78fcd-8d5gn\" (UID: \"607ded59-7849-4afa-aa03-2050af36d552\") " pod="test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn"
Jul 28 17:06:08.352819 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:08.352788    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/607ded59-7849-4afa-aa03-2050af36d552-online-tls\") pod \"feast-driver-ranking-6975d78fcd-8d5gn\" (UID: \"607ded59-7849-4afa-aa03-2050af36d552\") " pod="test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn"
Jul 28 17:06:08.352924 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:08.352788    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/607ded59-7849-4afa-aa03-2050af36d552-registry-tls\") pod \"feast-driver-ranking-6975d78fcd-8d5gn\" (UID: \"607ded59-7849-4afa-aa03-2050af36d552\") " pod="test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn"
Jul 28 17:06:08.359838 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:08.359802    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:06:08.360481 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:08.360462    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtzxx\" (UniqueName: \"kubernetes.io/projected/607ded59-7849-4afa-aa03-2050af36d552-kube-api-access-qtzxx\") pod \"feast-driver-ranking-6975d78fcd-8d5gn\" (UID: \"607ded59-7849-4afa-aa03-2050af36d552\") " pod="test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn"
Jul 28 17:06:08.486950 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:08.486890    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn"
Jul 28 17:06:08.624488 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:08.624462    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn"]
Jul 28 17:06:08.626724 ip-10-0-128-92 kubenswrapper[2561]: W0728 17:06:08.626680    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod607ded59_7849_4afa_aa03_2050af36d552.slice/crio-a20263396cefd170aabb68fb55542364d444380af49d1a6c50102b6d5eed65f8 WatchSource:0}: Error finding container a20263396cefd170aabb68fb55542364d444380af49d1a6c50102b6d5eed65f8: Status 404 returned error can't find the container with id a20263396cefd170aabb68fb55542364d444380af49d1a6c50102b6d5eed65f8
Jul 28 17:06:09.018141 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:09.018109    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn" event={"ID":"607ded59-7849-4afa-aa03-2050af36d552","Type":"ContainerStarted","Data":"70540d75bb4c5b37dc9715a231f561f40aeb4870d326401413a585afcec5b744"}
Jul 28 17:06:09.018288 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:09.018162    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn" event={"ID":"607ded59-7849-4afa-aa03-2050af36d552","Type":"ContainerStarted","Data":"a20263396cefd170aabb68fb55542364d444380af49d1a6c50102b6d5eed65f8"}
Jul 28 17:06:14.039375 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:14.039339    2561 generic.go:356] "Generic (PLEG): container finished" podID="607ded59-7849-4afa-aa03-2050af36d552" containerID="70540d75bb4c5b37dc9715a231f561f40aeb4870d326401413a585afcec5b744" exitCode=0
Jul 28 17:06:14.039792 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:14.039411    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn" event={"ID":"607ded59-7849-4afa-aa03-2050af36d552","Type":"ContainerDied","Data":"70540d75bb4c5b37dc9715a231f561f40aeb4870d326401413a585afcec5b744"}
Jul 28 17:06:15.045406 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:15.045371    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn" event={"ID":"607ded59-7849-4afa-aa03-2050af36d552","Type":"ContainerStarted","Data":"b563ffff7c687a13ca88d114e9067accdb35d58af4fd74dc538bb0b6ecf24cdc"}
Jul 28 17:06:21.072163 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:21.072120    2561 generic.go:356] "Generic (PLEG): container finished" podID="607ded59-7849-4afa-aa03-2050af36d552" containerID="b563ffff7c687a13ca88d114e9067accdb35d58af4fd74dc538bb0b6ecf24cdc" exitCode=0
Jul 28 17:06:21.075324 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:21.075299    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn" event={"ID":"607ded59-7849-4afa-aa03-2050af36d552","Type":"ContainerDied","Data":"b563ffff7c687a13ca88d114e9067accdb35d58af4fd74dc538bb0b6ecf24cdc"}
Jul 28 17:06:21.078636 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:21.078621    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\""
Jul 28 17:06:22.078927 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:22.078889    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn" event={"ID":"607ded59-7849-4afa-aa03-2050af36d552","Type":"ContainerStarted","Data":"4949eb61f2fbe744963374506dc1e1a68313fc1153efc733ee596dcbea170f52"}
Jul 28 17:06:22.079442 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:22.078978    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn" event={"ID":"607ded59-7849-4afa-aa03-2050af36d552","Type":"ContainerStarted","Data":"7666e48bb6a9ff2ecffebeb9106d6b22edcf4964ee6ab5793751e3f49ec8cab8"}
Jul 28 17:06:22.115141 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:22.115081    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn" podStartSLOduration=14.115066366 podStartE2EDuration="14.115066366s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:06:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:06:22.114204727 +0000 UTC m=+971.585618423" watchObservedRunningTime="2026-07-28 17:06:22.115066366 +0000 UTC m=+971.586480026"
Jul 28 17:06:23.487604 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:23.487560    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn"
Jul 28 17:06:23.488108 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:23.487659    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn"
Jul 28 17:06:23.489008 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:23.488976    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn" podUID="607ded59-7849-4afa-aa03-2050af36d552" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.30:6571: connect: connection refused"
Jul 28 17:06:23.489164 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:23.489025    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn" podUID="607ded59-7849-4afa-aa03-2050af36d552" containerName="online" probeResult="failure" output="Get \"https://10.134.0.30:6567/health\": dial tcp 10.134.0.30:6567: connect: connection refused"
Jul 28 17:06:26.487289 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:26.487244    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn" podUID="607ded59-7849-4afa-aa03-2050af36d552" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.30:6571: connect: connection refused"
Jul 28 17:06:26.487680 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:26.487279    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn" podUID="607ded59-7849-4afa-aa03-2050af36d552" containerName="online" probeResult="failure" output="Get \"https://10.134.0.30:6567/health\": dial tcp 10.134.0.30:6567: connect: connection refused"
Jul 28 17:06:28.487400 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:28.487360    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn"
Jul 28 17:06:28.487812 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:28.487424    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn"
Jul 28 17:06:29.488267 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:29.488224    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn" podUID="607ded59-7849-4afa-aa03-2050af36d552" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.30:6571: connect: connection refused"
Jul 28 17:06:29.494268 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:29.494241    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn"
Jul 28 17:06:29.497863 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:29.497809    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn"
Jul 28 17:06:32.487404 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:32.487319    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn" podUID="607ded59-7849-4afa-aa03-2050af36d552" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.30:6571: connect: connection refused"
Jul 28 17:06:35.487803 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:35.487775    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn"
Jul 28 17:06:35.490082 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:35.490060    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn"
Jul 28 17:06:43.638461 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:43.638428    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:06:56.323839 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:06:56.323796    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:07:07.315508 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:07.315463    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:07:17.820290 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:17.820249    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:07:50.821198 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:50.821151    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:07:54.704839 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:54.704804    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:07:55.128572 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:55.128538    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7b7db985fb-sxkpr"]
Jul 28 17:07:55.128769 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:55.128734    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-7b7db985fb-sxkpr" podUID="41b4d2c6-ccf8-4710-a1d5-f2c2cbd5b4c2" containerName="manager" containerID="cri-o://0c5a4c1416dfe4fedb307fe4e34710f596154aedc80caed4f2268dd8888de9dc" gracePeriod=10
Jul 28 17:07:55.138045 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:55.138006    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:07:55.388951 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:55.388889    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:07:55.403909 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:55.403880    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7b7db985fb-sxkpr"
Jul 28 17:07:55.422243 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:55.422199    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-84f65bb66f-447t4"]
Jul 28 17:07:55.422688 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:55.422490    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-84f65bb66f-447t4" podUID="a0be23bb-8bf7-4363-88a5-aaf513a298fe" containerName="registry" containerID="cri-o://260718b66fae12d2a1fa16c6192abbdb8a60685f15b815f5ac2991882de675b5" gracePeriod=30
Jul 28 17:07:55.422688 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:55.422539    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-84f65bb66f-447t4" podUID="a0be23bb-8bf7-4363-88a5-aaf513a298fe" containerName="online" containerID="cri-o://db8b28f3f1f20b654a3366e88987df5d5e86bf94d064be1c27390346077b0456" gracePeriod=30
Jul 28 17:07:55.424207 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:55.424184    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn"]
Jul 28 17:07:55.424459 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:55.424431    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn" podUID="607ded59-7849-4afa-aa03-2050af36d552" containerName="registry" containerID="cri-o://7666e48bb6a9ff2ecffebeb9106d6b22edcf4964ee6ab5793751e3f49ec8cab8" gracePeriod=30
Jul 28 17:07:55.424687 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:55.424462    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn" podUID="607ded59-7849-4afa-aa03-2050af36d552" containerName="online" containerID="cri-o://4949eb61f2fbe744963374506dc1e1a68313fc1153efc733ee596dcbea170f52" gracePeriod=30
Jul 28 17:07:55.448615 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:55.448582    2561 generic.go:356] "Generic (PLEG): container finished" podID="41b4d2c6-ccf8-4710-a1d5-f2c2cbd5b4c2" containerID="0c5a4c1416dfe4fedb307fe4e34710f596154aedc80caed4f2268dd8888de9dc" exitCode=0
Jul 28 17:07:55.448795 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:55.448630    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7b7db985fb-sxkpr"
Jul 28 17:07:55.448795 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:55.448671    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7b7db985fb-sxkpr" event={"ID":"41b4d2c6-ccf8-4710-a1d5-f2c2cbd5b4c2","Type":"ContainerDied","Data":"0c5a4c1416dfe4fedb307fe4e34710f596154aedc80caed4f2268dd8888de9dc"}
Jul 28 17:07:55.448795 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:55.448734    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7b7db985fb-sxkpr" event={"ID":"41b4d2c6-ccf8-4710-a1d5-f2c2cbd5b4c2","Type":"ContainerDied","Data":"bb9fed872591ed66ca7477eef6ee406a760248d9b5e577113a6d43edcce28d28"}
Jul 28 17:07:55.448795 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:55.448768    2561 scope.go:117] "RemoveContainer" containerID="0c5a4c1416dfe4fedb307fe4e34710f596154aedc80caed4f2268dd8888de9dc"
Jul 28 17:07:55.456977 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:55.456956    2561 scope.go:117] "RemoveContainer" containerID="0c5a4c1416dfe4fedb307fe4e34710f596154aedc80caed4f2268dd8888de9dc"
Jul 28 17:07:55.457259 ip-10-0-128-92 kubenswrapper[2561]: E0728 17:07:55.457233    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c5a4c1416dfe4fedb307fe4e34710f596154aedc80caed4f2268dd8888de9dc\": container with ID starting with 0c5a4c1416dfe4fedb307fe4e34710f596154aedc80caed4f2268dd8888de9dc not found: ID does not exist" containerID="0c5a4c1416dfe4fedb307fe4e34710f596154aedc80caed4f2268dd8888de9dc"
Jul 28 17:07:55.457322 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:55.457268    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c5a4c1416dfe4fedb307fe4e34710f596154aedc80caed4f2268dd8888de9dc"} err="failed to get container status \"0c5a4c1416dfe4fedb307fe4e34710f596154aedc80caed4f2268dd8888de9dc\": rpc error: code = NotFound desc = could not find container \"0c5a4c1416dfe4fedb307fe4e34710f596154aedc80caed4f2268dd8888de9dc\": container with ID starting with 0c5a4c1416dfe4fedb307fe4e34710f596154aedc80caed4f2268dd8888de9dc not found: ID does not exist"
Jul 28 17:07:55.502581 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:55.502549    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:07:55.511656 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:55.511627    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tgcws\" (UniqueName: \"kubernetes.io/projected/41b4d2c6-ccf8-4710-a1d5-f2c2cbd5b4c2-kube-api-access-tgcws\") pod \"41b4d2c6-ccf8-4710-a1d5-f2c2cbd5b4c2\" (UID: \"41b4d2c6-ccf8-4710-a1d5-f2c2cbd5b4c2\") "
Jul 28 17:07:55.514072 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:55.514042    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41b4d2c6-ccf8-4710-a1d5-f2c2cbd5b4c2-kube-api-access-tgcws" (OuterVolumeSpecName: "kube-api-access-tgcws") pod "41b4d2c6-ccf8-4710-a1d5-f2c2cbd5b4c2" (UID: "41b4d2c6-ccf8-4710-a1d5-f2c2cbd5b4c2"). InnerVolumeSpecName "kube-api-access-tgcws". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:07:55.612710 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:55.612670    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgcws\" (UniqueName: \"kubernetes.io/projected/41b4d2c6-ccf8-4710-a1d5-f2c2cbd5b4c2-kube-api-access-tgcws\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:07:55.786465 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:55.786424    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7b7db985fb-sxkpr"]
Jul 28 17:07:55.794190 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:55.794157    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7b7db985fb-sxkpr"]
Jul 28 17:07:55.830255 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:55.830222    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-g2ndm"]
Jul 28 17:07:55.830467 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:55.830442    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/postgres-864846d4f5-g2ndm" podUID="f48b9c26-abc5-4c18-9606-8bb0b3b786ed" containerName="postgres" containerID="cri-o://090605835ccee29f6ed4d21d1dfb01a9d1936f841359759ad08078c45628ba34" gracePeriod=30
Jul 28 17:07:55.867784 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:55.867737    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-d5c69"]
Jul 28 17:07:55.868001 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:55.867921    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/redis-69bbd798b6-d5c69" podUID="af9345b6-be5a-4e0a-a9ac-9384e3152232" containerName="redis" containerID="cri-o://abfd65612a49aabcabfe9d98e11eb931c75369f25ea9e8e18c743b3f929c6533" gracePeriod=30
Jul 28 17:07:55.915202 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:55.915165    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:07:56.088633 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:56.088608    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-g2ndm"
Jul 28 17:07:56.116545 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:56.115874    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/f48b9c26-abc5-4c18-9606-8bb0b3b786ed-postgresdata\") pod \"f48b9c26-abc5-4c18-9606-8bb0b3b786ed\" (UID: \"f48b9c26-abc5-4c18-9606-8bb0b3b786ed\") "
Jul 28 17:07:56.116545 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:56.115982    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ssfw\" (UniqueName: \"kubernetes.io/projected/f48b9c26-abc5-4c18-9606-8bb0b3b786ed-kube-api-access-6ssfw\") pod \"f48b9c26-abc5-4c18-9606-8bb0b3b786ed\" (UID: \"f48b9c26-abc5-4c18-9606-8bb0b3b786ed\") "
Jul 28 17:07:56.119172 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:56.119132    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f48b9c26-abc5-4c18-9606-8bb0b3b786ed-kube-api-access-6ssfw" (OuterVolumeSpecName: "kube-api-access-6ssfw") pod "f48b9c26-abc5-4c18-9606-8bb0b3b786ed" (UID: "f48b9c26-abc5-4c18-9606-8bb0b3b786ed"). InnerVolumeSpecName "kube-api-access-6ssfw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:07:56.136103 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:56.136066    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-d5c69"
Jul 28 17:07:56.154072 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:56.153776    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f48b9c26-abc5-4c18-9606-8bb0b3b786ed-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "f48b9c26-abc5-4c18-9606-8bb0b3b786ed" (UID: "f48b9c26-abc5-4c18-9606-8bb0b3b786ed"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:07:56.216587 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:56.216545    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swcrc\" (UniqueName: \"kubernetes.io/projected/af9345b6-be5a-4e0a-a9ac-9384e3152232-kube-api-access-swcrc\") pod \"af9345b6-be5a-4e0a-a9ac-9384e3152232\" (UID: \"af9345b6-be5a-4e0a-a9ac-9384e3152232\") "
Jul 28 17:07:56.216799 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:56.216783    2561 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/f48b9c26-abc5-4c18-9606-8bb0b3b786ed-postgresdata\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:07:56.216856 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:56.216806    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ssfw\" (UniqueName: \"kubernetes.io/projected/f48b9c26-abc5-4c18-9606-8bb0b3b786ed-kube-api-access-6ssfw\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:07:56.218769 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:56.218744    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af9345b6-be5a-4e0a-a9ac-9384e3152232-kube-api-access-swcrc" (OuterVolumeSpecName: "kube-api-access-swcrc") pod "af9345b6-be5a-4e0a-a9ac-9384e3152232" (UID: "af9345b6-be5a-4e0a-a9ac-9384e3152232"). InnerVolumeSpecName "kube-api-access-swcrc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:07:56.318063 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:56.318032    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swcrc\" (UniqueName: \"kubernetes.io/projected/af9345b6-be5a-4e0a-a9ac-9384e3152232-kube-api-access-swcrc\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:07:56.454283 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:56.454251    2561 generic.go:356] "Generic (PLEG): container finished" podID="af9345b6-be5a-4e0a-a9ac-9384e3152232" containerID="abfd65612a49aabcabfe9d98e11eb931c75369f25ea9e8e18c743b3f929c6533" exitCode=0
Jul 28 17:07:56.454467 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:56.454297    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-d5c69"
Jul 28 17:07:56.454467 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:56.454345    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-d5c69" event={"ID":"af9345b6-be5a-4e0a-a9ac-9384e3152232","Type":"ContainerDied","Data":"abfd65612a49aabcabfe9d98e11eb931c75369f25ea9e8e18c743b3f929c6533"}
Jul 28 17:07:56.454467 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:56.454386    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-d5c69" event={"ID":"af9345b6-be5a-4e0a-a9ac-9384e3152232","Type":"ContainerDied","Data":"a3e9910895b042f8ccfbc61b6fa97a273013b0178feb829a33fe45cbbf951b7c"}
Jul 28 17:07:56.454467 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:56.454409    2561 scope.go:117] "RemoveContainer" containerID="abfd65612a49aabcabfe9d98e11eb931c75369f25ea9e8e18c743b3f929c6533"
Jul 28 17:07:56.457252 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:56.457229    2561 generic.go:356] "Generic (PLEG): container finished" podID="607ded59-7849-4afa-aa03-2050af36d552" containerID="4949eb61f2fbe744963374506dc1e1a68313fc1153efc733ee596dcbea170f52" exitCode=0
Jul 28 17:07:56.457399 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:56.457252    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn" event={"ID":"607ded59-7849-4afa-aa03-2050af36d552","Type":"ContainerDied","Data":"4949eb61f2fbe744963374506dc1e1a68313fc1153efc733ee596dcbea170f52"}
Jul 28 17:07:56.458524 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:56.458497    2561 generic.go:356] "Generic (PLEG): container finished" podID="f48b9c26-abc5-4c18-9606-8bb0b3b786ed" containerID="090605835ccee29f6ed4d21d1dfb01a9d1936f841359759ad08078c45628ba34" exitCode=0
Jul 28 17:07:56.458637 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:56.458546    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-g2ndm"
Jul 28 17:07:56.458637 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:56.458576    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-g2ndm" event={"ID":"f48b9c26-abc5-4c18-9606-8bb0b3b786ed","Type":"ContainerDied","Data":"090605835ccee29f6ed4d21d1dfb01a9d1936f841359759ad08078c45628ba34"}
Jul 28 17:07:56.458637 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:56.458610    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-g2ndm" event={"ID":"f48b9c26-abc5-4c18-9606-8bb0b3b786ed","Type":"ContainerDied","Data":"3c2db2547f2a83f9d5546a866dd808d92cd72052b3a8b0bf44fa23f9ee3553da"}
Jul 28 17:07:56.461885 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:56.461861    2561 generic.go:356] "Generic (PLEG): container finished" podID="a0be23bb-8bf7-4363-88a5-aaf513a298fe" containerID="db8b28f3f1f20b654a3366e88987df5d5e86bf94d064be1c27390346077b0456" exitCode=0
Jul 28 17:07:56.462009 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:56.461921    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-84f65bb66f-447t4" event={"ID":"a0be23bb-8bf7-4363-88a5-aaf513a298fe","Type":"ContainerDied","Data":"db8b28f3f1f20b654a3366e88987df5d5e86bf94d064be1c27390346077b0456"}
Jul 28 17:07:56.463768 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:56.463742    2561 scope.go:117] "RemoveContainer" containerID="abfd65612a49aabcabfe9d98e11eb931c75369f25ea9e8e18c743b3f929c6533"
Jul 28 17:07:56.464110 ip-10-0-128-92 kubenswrapper[2561]: E0728 17:07:56.464089    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"abfd65612a49aabcabfe9d98e11eb931c75369f25ea9e8e18c743b3f929c6533\": container with ID starting with abfd65612a49aabcabfe9d98e11eb931c75369f25ea9e8e18c743b3f929c6533 not found: ID does not exist" containerID="abfd65612a49aabcabfe9d98e11eb931c75369f25ea9e8e18c743b3f929c6533"
Jul 28 17:07:56.464205 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:56.464118    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"abfd65612a49aabcabfe9d98e11eb931c75369f25ea9e8e18c743b3f929c6533"} err="failed to get container status \"abfd65612a49aabcabfe9d98e11eb931c75369f25ea9e8e18c743b3f929c6533\": rpc error: code = NotFound desc = could not find container \"abfd65612a49aabcabfe9d98e11eb931c75369f25ea9e8e18c743b3f929c6533\": container with ID starting with abfd65612a49aabcabfe9d98e11eb931c75369f25ea9e8e18c743b3f929c6533 not found: ID does not exist"
Jul 28 17:07:56.464205 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:56.464135    2561 scope.go:117] "RemoveContainer" containerID="090605835ccee29f6ed4d21d1dfb01a9d1936f841359759ad08078c45628ba34"
Jul 28 17:07:56.472080 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:56.472058    2561 scope.go:117] "RemoveContainer" containerID="090605835ccee29f6ed4d21d1dfb01a9d1936f841359759ad08078c45628ba34"
Jul 28 17:07:56.472337 ip-10-0-128-92 kubenswrapper[2561]: E0728 17:07:56.472316    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"090605835ccee29f6ed4d21d1dfb01a9d1936f841359759ad08078c45628ba34\": container with ID starting with 090605835ccee29f6ed4d21d1dfb01a9d1936f841359759ad08078c45628ba34 not found: ID does not exist" containerID="090605835ccee29f6ed4d21d1dfb01a9d1936f841359759ad08078c45628ba34"
Jul 28 17:07:56.472419 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:56.472340    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"090605835ccee29f6ed4d21d1dfb01a9d1936f841359759ad08078c45628ba34"} err="failed to get container status \"090605835ccee29f6ed4d21d1dfb01a9d1936f841359759ad08078c45628ba34\": rpc error: code = NotFound desc = could not find container \"090605835ccee29f6ed4d21d1dfb01a9d1936f841359759ad08078c45628ba34\": container with ID starting with 090605835ccee29f6ed4d21d1dfb01a9d1936f841359759ad08078c45628ba34 not found: ID does not exist"
Jul 28 17:07:56.479913 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:56.479890    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-d5c69"]
Jul 28 17:07:56.488948 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:56.488899    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-d5c69"]
Jul 28 17:07:56.504092 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:56.504059    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-g2ndm"]
Jul 28 17:07:56.509631 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:56.509600    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-g2ndm"]
Jul 28 17:07:57.074384 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:57.074356    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41b4d2c6-ccf8-4710-a1d5-f2c2cbd5b4c2" path="/var/lib/kubelet/pods/41b4d2c6-ccf8-4710-a1d5-f2c2cbd5b4c2/volumes"
Jul 28 17:07:57.074754 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:57.074647    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af9345b6-be5a-4e0a-a9ac-9384e3152232" path="/var/lib/kubelet/pods/af9345b6-be5a-4e0a-a9ac-9384e3152232/volumes"
Jul 28 17:07:57.074952 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:57.074921    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f48b9c26-abc5-4c18-9606-8bb0b3b786ed" path="/var/lib/kubelet/pods/f48b9c26-abc5-4c18-9606-8bb0b3b786ed/volumes"
Jul 28 17:07:58.157761 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:58.157724    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-84f65bb66f-447t4" podUID="a0be23bb-8bf7-4363-88a5-aaf513a298fe" containerName="online" probeResult="failure" output="Get \"https://10.134.0.29:6567/health\": dial tcp 10.134.0.29:6567: connect: connection refused"
Jul 28 17:07:59.495316 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:07:59.495279    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn" podUID="607ded59-7849-4afa-aa03-2050af36d552" containerName="online" probeResult="failure" output="Get \"https://10.134.0.30:6567/health\": dial tcp 10.134.0.30:6567: connect: connection refused"
Jul 28 17:08:00.491094 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:00.491064    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:08:00.570832 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:00.570803    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:08:06.851211 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:06.851131    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:08:06.952944 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:06.952911    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:08:07.453717 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:07.453687    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:08:07.486313 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:07.486280    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-9v468"]
Jul 28 17:08:07.486572 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:07.486560    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41b4d2c6-ccf8-4710-a1d5-f2c2cbd5b4c2" containerName="manager"
Jul 28 17:08:07.486626 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:07.486573    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="41b4d2c6-ccf8-4710-a1d5-f2c2cbd5b4c2" containerName="manager"
Jul 28 17:08:07.486626 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:07.486594    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f48b9c26-abc5-4c18-9606-8bb0b3b786ed" containerName="postgres"
Jul 28 17:08:07.486626 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:07.486599    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="f48b9c26-abc5-4c18-9606-8bb0b3b786ed" containerName="postgres"
Jul 28 17:08:07.486626 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:07.486609    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af9345b6-be5a-4e0a-a9ac-9384e3152232" containerName="redis"
Jul 28 17:08:07.486626 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:07.486614    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="af9345b6-be5a-4e0a-a9ac-9384e3152232" containerName="redis"
Jul 28 17:08:07.486782 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:07.486660    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="af9345b6-be5a-4e0a-a9ac-9384e3152232" containerName="redis"
Jul 28 17:08:07.486782 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:07.486668    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="41b4d2c6-ccf8-4710-a1d5-f2c2cbd5b4c2" containerName="manager"
Jul 28 17:08:07.486782 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:07.486675    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="f48b9c26-abc5-4c18-9606-8bb0b3b786ed" containerName="postgres"
Jul 28 17:08:07.489249 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:07.489234    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-9v468"
Jul 28 17:08:07.492239 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:07.492214    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-pg7xz\""
Jul 28 17:08:07.493404 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:07.493377    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
Jul 28 17:08:07.493404 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:07.493399    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
Jul 28 17:08:07.511334 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:07.511304    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-9v468"]
Jul 28 17:08:07.606803 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:07.606771    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tbfps\" (UniqueName: \"kubernetes.io/projected/94caf8a8-34b0-41e4-9abe-38aa931bda41-kube-api-access-tbfps\") pod \"feast-operator-controller-manager-7495bcd-9v468\" (UID: \"94caf8a8-34b0-41e4-9abe-38aa931bda41\") " pod="feast-operator-system/feast-operator-controller-manager-7495bcd-9v468"
Jul 28 17:08:07.707787 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:07.707706    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tbfps\" (UniqueName: \"kubernetes.io/projected/94caf8a8-34b0-41e4-9abe-38aa931bda41-kube-api-access-tbfps\") pod \"feast-operator-controller-manager-7495bcd-9v468\" (UID: \"94caf8a8-34b0-41e4-9abe-38aa931bda41\") " pod="feast-operator-system/feast-operator-controller-manager-7495bcd-9v468"
Jul 28 17:08:07.719284 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:07.719261    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tbfps\" (UniqueName: \"kubernetes.io/projected/94caf8a8-34b0-41e4-9abe-38aa931bda41-kube-api-access-tbfps\") pod \"feast-operator-controller-manager-7495bcd-9v468\" (UID: \"94caf8a8-34b0-41e4-9abe-38aa931bda41\") " pod="feast-operator-system/feast-operator-controller-manager-7495bcd-9v468"
Jul 28 17:08:07.798838 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:07.798805    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-9v468"
Jul 28 17:08:07.933571 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:07.933545    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-9v468"]
Jul 28 17:08:07.936282 ip-10-0-128-92 kubenswrapper[2561]: W0728 17:08:07.936258    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94caf8a8_34b0_41e4_9abe_38aa931bda41.slice/crio-c1c71db4cc4e0221fe8135e04ca3251e04f3373805aded2e66c0b8bf52e2170e WatchSource:0}: Error finding container c1c71db4cc4e0221fe8135e04ca3251e04f3373805aded2e66c0b8bf52e2170e: Status 404 returned error can't find the container with id c1c71db4cc4e0221fe8135e04ca3251e04f3373805aded2e66c0b8bf52e2170e
Jul 28 17:08:07.938067 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:07.938051    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 17:08:08.157313 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:08.157271    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-84f65bb66f-447t4" podUID="a0be23bb-8bf7-4363-88a5-aaf513a298fe" containerName="online" probeResult="failure" output="Get \"https://10.134.0.29:6567/health\": dial tcp 10.134.0.29:6567: connect: connection refused"
Jul 28 17:08:08.513232 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:08.513150    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-9v468" event={"ID":"94caf8a8-34b0-41e4-9abe-38aa931bda41","Type":"ContainerStarted","Data":"c1c71db4cc4e0221fe8135e04ca3251e04f3373805aded2e66c0b8bf52e2170e"}
Jul 28 17:08:09.495400 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:09.495361    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn" podUID="607ded59-7849-4afa-aa03-2050af36d552" containerName="online" probeResult="failure" output="Get \"https://10.134.0.30:6567/health\": dial tcp 10.134.0.30:6567: connect: connection refused"
Jul 28 17:08:10.522734 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:10.522643    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-9v468" event={"ID":"94caf8a8-34b0-41e4-9abe-38aa931bda41","Type":"ContainerStarted","Data":"a55a4a38469375a18e4a4acc7109ef8415b2c8cdbe53d4aa004b1f35ac32c38d"}
Jul 28 17:08:10.523124 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:10.522762    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-9v468"
Jul 28 17:08:10.554581 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:10.554528    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-9v468" podStartSLOduration=1.2349618310000001 podStartE2EDuration="3.554510632s" totalImagesPullingTime="2.319548801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:08:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:08:10.553413552 +0000 UTC m=+1080.024827213" watchObservedRunningTime="2026-07-28 17:08:10.554510632 +0000 UTC m=+1080.025924292"
Jul 28 17:08:18.157427 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:18.157377    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-84f65bb66f-447t4" podUID="a0be23bb-8bf7-4363-88a5-aaf513a298fe" containerName="online" probeResult="failure" output="Get \"https://10.134.0.29:6567/health\": dial tcp 10.134.0.29:6567: connect: connection refused"
Jul 28 17:08:18.157856 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:18.157520    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-84f65bb66f-447t4"
Jul 28 17:08:19.495617 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:19.495574    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn" podUID="607ded59-7849-4afa-aa03-2050af36d552" containerName="online" probeResult="failure" output="Get \"https://10.134.0.30:6567/health\": dial tcp 10.134.0.30:6567: connect: connection refused"
Jul 28 17:08:19.496025 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:19.495707    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn"
Jul 28 17:08:21.528929 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:21.528901    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-9v468"
Jul 28 17:08:23.709375 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:23.709336    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:08:23.802536 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:23.802508    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:08:25.488576 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:25.488540    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn" podUID="607ded59-7849-4afa-aa03-2050af36d552" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.30:6571: connect: connection refused"
Jul 28 17:08:25.579553 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:25.579526    2561 generic.go:356] "Generic (PLEG): container finished" podID="607ded59-7849-4afa-aa03-2050af36d552" containerID="7666e48bb6a9ff2ecffebeb9106d6b22edcf4964ee6ab5793751e3f49ec8cab8" exitCode=137
Jul 28 17:08:25.579685 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:25.579588    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn" event={"ID":"607ded59-7849-4afa-aa03-2050af36d552","Type":"ContainerDied","Data":"7666e48bb6a9ff2ecffebeb9106d6b22edcf4964ee6ab5793751e3f49ec8cab8"}
Jul 28 17:08:25.581705 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:25.581682    2561 generic.go:356] "Generic (PLEG): container finished" podID="a0be23bb-8bf7-4363-88a5-aaf513a298fe" containerID="260718b66fae12d2a1fa16c6192abbdb8a60685f15b815f5ac2991882de675b5" exitCode=137
Jul 28 17:08:25.581816 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:25.581746    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-84f65bb66f-447t4" event={"ID":"a0be23bb-8bf7-4363-88a5-aaf513a298fe","Type":"ContainerDied","Data":"260718b66fae12d2a1fa16c6192abbdb8a60685f15b815f5ac2991882de675b5"}
Jul 28 17:08:26.097186 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:26.097165    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-84f65bb66f-447t4"
Jul 28 17:08:26.099594 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:26.099577    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn"
Jul 28 17:08:26.160194 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:26.160169    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a0be23bb-8bf7-4363-88a5-aaf513a298fe-online-tls\") pod \"a0be23bb-8bf7-4363-88a5-aaf513a298fe\" (UID: \"a0be23bb-8bf7-4363-88a5-aaf513a298fe\") "
Jul 28 17:08:26.160354 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:26.160201    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a0be23bb-8bf7-4363-88a5-aaf513a298fe-registry-tls\") pod \"a0be23bb-8bf7-4363-88a5-aaf513a298fe\" (UID: \"a0be23bb-8bf7-4363-88a5-aaf513a298fe\") "
Jul 28 17:08:26.160354 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:26.160220    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qtzxx\" (UniqueName: \"kubernetes.io/projected/607ded59-7849-4afa-aa03-2050af36d552-kube-api-access-qtzxx\") pod \"607ded59-7849-4afa-aa03-2050af36d552\" (UID: \"607ded59-7849-4afa-aa03-2050af36d552\") "
Jul 28 17:08:26.160354 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:26.160244    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lxtcg\" (UniqueName: \"kubernetes.io/projected/a0be23bb-8bf7-4363-88a5-aaf513a298fe-kube-api-access-lxtcg\") pod \"a0be23bb-8bf7-4363-88a5-aaf513a298fe\" (UID: \"a0be23bb-8bf7-4363-88a5-aaf513a298fe\") "
Jul 28 17:08:26.160354 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:26.160303    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/607ded59-7849-4afa-aa03-2050af36d552-online-tls\") pod \"607ded59-7849-4afa-aa03-2050af36d552\" (UID: \"607ded59-7849-4afa-aa03-2050af36d552\") "
Jul 28 17:08:26.160354 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:26.160353    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/607ded59-7849-4afa-aa03-2050af36d552-registry-tls\") pod \"607ded59-7849-4afa-aa03-2050af36d552\" (UID: \"607ded59-7849-4afa-aa03-2050af36d552\") "
Jul 28 17:08:26.160624 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:26.160389    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/607ded59-7849-4afa-aa03-2050af36d552-feast-data\") pod \"607ded59-7849-4afa-aa03-2050af36d552\" (UID: \"607ded59-7849-4afa-aa03-2050af36d552\") "
Jul 28 17:08:26.160624 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:26.160424    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a0be23bb-8bf7-4363-88a5-aaf513a298fe-feast-data\") pod \"a0be23bb-8bf7-4363-88a5-aaf513a298fe\" (UID: \"a0be23bb-8bf7-4363-88a5-aaf513a298fe\") "
Jul 28 17:08:26.161795 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:26.161045    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/607ded59-7849-4afa-aa03-2050af36d552-feast-data" (OuterVolumeSpecName: "feast-data") pod "607ded59-7849-4afa-aa03-2050af36d552" (UID: "607ded59-7849-4afa-aa03-2050af36d552"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:08:26.163466 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:26.163101    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0be23bb-8bf7-4363-88a5-aaf513a298fe-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a0be23bb-8bf7-4363-88a5-aaf513a298fe" (UID: "a0be23bb-8bf7-4363-88a5-aaf513a298fe"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:08:26.163466 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:26.163105    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/607ded59-7849-4afa-aa03-2050af36d552-online-tls" (OuterVolumeSpecName: "online-tls") pod "607ded59-7849-4afa-aa03-2050af36d552" (UID: "607ded59-7849-4afa-aa03-2050af36d552"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:08:26.163639 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:26.163569    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0be23bb-8bf7-4363-88a5-aaf513a298fe-online-tls" (OuterVolumeSpecName: "online-tls") pod "a0be23bb-8bf7-4363-88a5-aaf513a298fe" (UID: "a0be23bb-8bf7-4363-88a5-aaf513a298fe"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:08:26.163639 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:26.163621    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/607ded59-7849-4afa-aa03-2050af36d552-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "607ded59-7849-4afa-aa03-2050af36d552" (UID: "607ded59-7849-4afa-aa03-2050af36d552"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:08:26.163805 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:26.163783    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/607ded59-7849-4afa-aa03-2050af36d552-kube-api-access-qtzxx" (OuterVolumeSpecName: "kube-api-access-qtzxx") pod "607ded59-7849-4afa-aa03-2050af36d552" (UID: "607ded59-7849-4afa-aa03-2050af36d552"). InnerVolumeSpecName "kube-api-access-qtzxx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:08:26.164006 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:26.163967    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0be23bb-8bf7-4363-88a5-aaf513a298fe-kube-api-access-lxtcg" (OuterVolumeSpecName: "kube-api-access-lxtcg") pod "a0be23bb-8bf7-4363-88a5-aaf513a298fe" (UID: "a0be23bb-8bf7-4363-88a5-aaf513a298fe"). InnerVolumeSpecName "kube-api-access-lxtcg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:08:26.170895 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:26.170874    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0be23bb-8bf7-4363-88a5-aaf513a298fe-feast-data" (OuterVolumeSpecName: "feast-data") pod "a0be23bb-8bf7-4363-88a5-aaf513a298fe" (UID: "a0be23bb-8bf7-4363-88a5-aaf513a298fe"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:08:26.261418 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:26.261383    2561 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/a0be23bb-8bf7-4363-88a5-aaf513a298fe-online-tls\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:08:26.261418 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:26.261417    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/a0be23bb-8bf7-4363-88a5-aaf513a298fe-registry-tls\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:08:26.261418 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:26.261426    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qtzxx\" (UniqueName: \"kubernetes.io/projected/607ded59-7849-4afa-aa03-2050af36d552-kube-api-access-qtzxx\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:08:26.261602 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:26.261436    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lxtcg\" (UniqueName: \"kubernetes.io/projected/a0be23bb-8bf7-4363-88a5-aaf513a298fe-kube-api-access-lxtcg\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:08:26.261602 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:26.261444    2561 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/607ded59-7849-4afa-aa03-2050af36d552-online-tls\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:08:26.261602 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:26.261452    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/607ded59-7849-4afa-aa03-2050af36d552-registry-tls\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:08:26.261602 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:26.261460    2561 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/607ded59-7849-4afa-aa03-2050af36d552-feast-data\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:08:26.261602 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:26.261467    2561 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/a0be23bb-8bf7-4363-88a5-aaf513a298fe-feast-data\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:08:26.588353 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:26.588278    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-84f65bb66f-447t4"
Jul 28 17:08:26.588353 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:26.588303    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-84f65bb66f-447t4" event={"ID":"a0be23bb-8bf7-4363-88a5-aaf513a298fe","Type":"ContainerDied","Data":"df43910601ae3d4b444eeb987e5527353de75f77736101e52b5df83068ef73e8"}
Jul 28 17:08:26.588845 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:26.588370    2561 scope.go:117] "RemoveContainer" containerID="db8b28f3f1f20b654a3366e88987df5d5e86bf94d064be1c27390346077b0456"
Jul 28 17:08:26.590867 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:26.590845    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn" event={"ID":"607ded59-7849-4afa-aa03-2050af36d552","Type":"ContainerDied","Data":"a20263396cefd170aabb68fb55542364d444380af49d1a6c50102b6d5eed65f8"}
Jul 28 17:08:26.590867 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:26.590874    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn"
Jul 28 17:08:26.598038 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:26.598001    2561 scope.go:117] "RemoveContainer" containerID="260718b66fae12d2a1fa16c6192abbdb8a60685f15b815f5ac2991882de675b5"
Jul 28 17:08:26.605718 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:26.605699    2561 scope.go:117] "RemoveContainer" containerID="ff811df7f9d219d3edc9d64531bccf68262833540b5f10eee10d19024afa0c37"
Jul 28 17:08:26.612682 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:26.612668    2561 scope.go:117] "RemoveContainer" containerID="66370c24247963cfd66faf3368df6264d48d42ef5a8e59fd9d32f9ec04e31d34"
Jul 28 17:08:26.621248 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:26.621232    2561 scope.go:117] "RemoveContainer" containerID="4949eb61f2fbe744963374506dc1e1a68313fc1153efc733ee596dcbea170f52"
Jul 28 17:08:26.628285 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:26.628253    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn"]
Jul 28 17:08:26.633048 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:26.633028    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-6975d78fcd-8d5gn"]
Jul 28 17:08:26.634280 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:26.634268    2561 scope.go:117] "RemoveContainer" containerID="7666e48bb6a9ff2ecffebeb9106d6b22edcf4964ee6ab5793751e3f49ec8cab8"
Jul 28 17:08:26.641676 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:26.641660    2561 scope.go:117] "RemoveContainer" containerID="b563ffff7c687a13ca88d114e9067accdb35d58af4fd74dc538bb0b6ecf24cdc"
Jul 28 17:08:26.648492 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:26.648476    2561 scope.go:117] "RemoveContainer" containerID="70540d75bb4c5b37dc9715a231f561f40aeb4870d326401413a585afcec5b744"
Jul 28 17:08:26.653272 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:26.653251    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-84f65bb66f-447t4"]
Jul 28 17:08:26.660514 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:26.660496    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-84f65bb66f-447t4"]
Jul 28 17:08:27.075214 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:27.075186    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="607ded59-7849-4afa-aa03-2050af36d552" path="/var/lib/kubelet/pods/607ded59-7849-4afa-aa03-2050af36d552/volumes"
Jul 28 17:08:27.075643 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:27.075631    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0be23bb-8bf7-4363-88a5-aaf513a298fe" path="/var/lib/kubelet/pods/a0be23bb-8bf7-4363-88a5-aaf513a298fe/volumes"
Jul 28 17:08:33.740470 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:33.740423    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:08:33.819353 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:33.819320    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:08:34.080783 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:34.080690    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:08:34.703259 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:34.703222    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:08:34.797242 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:34.797179    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:08:34.944514 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:34.944479    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q"]
Jul 28 17:08:34.944826 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:34.944804    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0be23bb-8bf7-4363-88a5-aaf513a298fe" containerName="feast-init"
Jul 28 17:08:34.944826 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:34.944821    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0be23bb-8bf7-4363-88a5-aaf513a298fe" containerName="feast-init"
Jul 28 17:08:34.944826 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:34.944831    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0be23bb-8bf7-4363-88a5-aaf513a298fe" containerName="registry"
Jul 28 17:08:34.945111 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:34.944837    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0be23bb-8bf7-4363-88a5-aaf513a298fe" containerName="registry"
Jul 28 17:08:34.945111 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:34.944846    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0be23bb-8bf7-4363-88a5-aaf513a298fe" containerName="feast-apply"
Jul 28 17:08:34.945111 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:34.944853    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0be23bb-8bf7-4363-88a5-aaf513a298fe" containerName="feast-apply"
Jul 28 17:08:34.945111 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:34.944864    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="607ded59-7849-4afa-aa03-2050af36d552" containerName="feast-apply"
Jul 28 17:08:34.945111 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:34.944870    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="607ded59-7849-4afa-aa03-2050af36d552" containerName="feast-apply"
Jul 28 17:08:34.945111 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:34.944876    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="607ded59-7849-4afa-aa03-2050af36d552" containerName="online"
Jul 28 17:08:34.945111 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:34.944881    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="607ded59-7849-4afa-aa03-2050af36d552" containerName="online"
Jul 28 17:08:34.945111 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:34.944887    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="607ded59-7849-4afa-aa03-2050af36d552" containerName="feast-init"
Jul 28 17:08:34.945111 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:34.944892    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="607ded59-7849-4afa-aa03-2050af36d552" containerName="feast-init"
Jul 28 17:08:34.945111 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:34.944900    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="607ded59-7849-4afa-aa03-2050af36d552" containerName="registry"
Jul 28 17:08:34.945111 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:34.944908    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="607ded59-7849-4afa-aa03-2050af36d552" containerName="registry"
Jul 28 17:08:34.945111 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:34.944919    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0be23bb-8bf7-4363-88a5-aaf513a298fe" containerName="online"
Jul 28 17:08:34.945111 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:34.944925    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0be23bb-8bf7-4363-88a5-aaf513a298fe" containerName="online"
Jul 28 17:08:34.945111 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:34.944993    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0be23bb-8bf7-4363-88a5-aaf513a298fe" containerName="online"
Jul 28 17:08:34.945111 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:34.945002    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="607ded59-7849-4afa-aa03-2050af36d552" containerName="online"
Jul 28 17:08:34.945111 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:34.945008    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0be23bb-8bf7-4363-88a5-aaf513a298fe" containerName="registry"
Jul 28 17:08:34.945111 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:34.945013    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="607ded59-7849-4afa-aa03-2050af36d552" containerName="registry"
Jul 28 17:08:34.945909 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:34.945521    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:08:34.950366 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:34.950347    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q"
Jul 28 17:08:34.953342 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:34.953250    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Jul 28 17:08:34.953342 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:34.953334    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Jul 28 17:08:34.953539 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:34.953455    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Jul 28 17:08:34.953603 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:34.953571    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Jul 28 17:08:34.954477 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:34.954459    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Jul 28 17:08:34.954592 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:34.954464    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-7c6h8\""
Jul 28 17:08:34.954592 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:34.954466    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Jul 28 17:08:34.960107 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:34.960083    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q"]
Jul 28 17:08:35.027440 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:35.027401    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfvnm\" (UniqueName: \"kubernetes.io/projected/44b87468-c82e-47b3-87cc-a24d752a8836-kube-api-access-qfvnm\") pod \"feast-simple-feast-setup-777d6cc998-6rc4q\" (UID: \"44b87468-c82e-47b3-87cc-a24d752a8836\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q"
Jul 28 17:08:35.027614 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:35.027451    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/44b87468-c82e-47b3-87cc-a24d752a8836-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-6rc4q\" (UID: \"44b87468-c82e-47b3-87cc-a24d752a8836\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q"
Jul 28 17:08:35.027614 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:35.027519    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/44b87468-c82e-47b3-87cc-a24d752a8836-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-6rc4q\" (UID: \"44b87468-c82e-47b3-87cc-a24d752a8836\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q"
Jul 28 17:08:35.027614 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:35.027584    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/44b87468-c82e-47b3-87cc-a24d752a8836-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-6rc4q\" (UID: \"44b87468-c82e-47b3-87cc-a24d752a8836\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q"
Jul 28 17:08:35.027614 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:35.027612    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/44b87468-c82e-47b3-87cc-a24d752a8836-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-6rc4q\" (UID: \"44b87468-c82e-47b3-87cc-a24d752a8836\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q"
Jul 28 17:08:35.027751 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:35.027649    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/44b87468-c82e-47b3-87cc-a24d752a8836-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-6rc4q\" (UID: \"44b87468-c82e-47b3-87cc-a24d752a8836\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q"
Jul 28 17:08:35.041261 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:35.041198    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:08:35.128676 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:35.128643    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/44b87468-c82e-47b3-87cc-a24d752a8836-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-6rc4q\" (UID: \"44b87468-c82e-47b3-87cc-a24d752a8836\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q"
Jul 28 17:08:35.128842 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:35.128688    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/44b87468-c82e-47b3-87cc-a24d752a8836-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-6rc4q\" (UID: \"44b87468-c82e-47b3-87cc-a24d752a8836\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q"
Jul 28 17:08:35.128842 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:35.128710    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/44b87468-c82e-47b3-87cc-a24d752a8836-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-6rc4q\" (UID: \"44b87468-c82e-47b3-87cc-a24d752a8836\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q"
Jul 28 17:08:35.128842 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:35.128740    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfvnm\" (UniqueName: \"kubernetes.io/projected/44b87468-c82e-47b3-87cc-a24d752a8836-kube-api-access-qfvnm\") pod \"feast-simple-feast-setup-777d6cc998-6rc4q\" (UID: \"44b87468-c82e-47b3-87cc-a24d752a8836\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q"
Jul 28 17:08:35.128842 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:35.128773    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/44b87468-c82e-47b3-87cc-a24d752a8836-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-6rc4q\" (UID: \"44b87468-c82e-47b3-87cc-a24d752a8836\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q"
Jul 28 17:08:35.128842 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:35.128800    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/44b87468-c82e-47b3-87cc-a24d752a8836-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-6rc4q\" (UID: \"44b87468-c82e-47b3-87cc-a24d752a8836\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q"
Jul 28 17:08:35.132964 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:35.129652    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/44b87468-c82e-47b3-87cc-a24d752a8836-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-6rc4q\" (UID: \"44b87468-c82e-47b3-87cc-a24d752a8836\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q"
Jul 28 17:08:35.132964 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:35.132259    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/44b87468-c82e-47b3-87cc-a24d752a8836-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-6rc4q\" (UID: \"44b87468-c82e-47b3-87cc-a24d752a8836\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q"
Jul 28 17:08:35.132964 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:35.132295    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/44b87468-c82e-47b3-87cc-a24d752a8836-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-6rc4q\" (UID: \"44b87468-c82e-47b3-87cc-a24d752a8836\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q"
Jul 28 17:08:35.132964 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:35.132361    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/44b87468-c82e-47b3-87cc-a24d752a8836-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-6rc4q\" (UID: \"44b87468-c82e-47b3-87cc-a24d752a8836\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q"
Jul 28 17:08:35.132964 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:35.132463    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/44b87468-c82e-47b3-87cc-a24d752a8836-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-6rc4q\" (UID: \"44b87468-c82e-47b3-87cc-a24d752a8836\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q"
Jul 28 17:08:35.139596 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:35.139570    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfvnm\" (UniqueName: \"kubernetes.io/projected/44b87468-c82e-47b3-87cc-a24d752a8836-kube-api-access-qfvnm\") pod \"feast-simple-feast-setup-777d6cc998-6rc4q\" (UID: \"44b87468-c82e-47b3-87cc-a24d752a8836\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q"
Jul 28 17:08:35.141347 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:35.141314    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:08:35.273252 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:35.273221    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q"
Jul 28 17:08:35.355477 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:35.355442    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:08:35.414850 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:35.414822    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q"]
Jul 28 17:08:35.418014 ip-10-0-128-92 kubenswrapper[2561]: W0728 17:08:35.417974    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod44b87468_c82e_47b3_87cc_a24d752a8836.slice/crio-721ebfe08bf8261f4045d420ef353d1bb7059d7dc2baacad332d090656f47225 WatchSource:0}: Error finding container 721ebfe08bf8261f4045d420ef353d1bb7059d7dc2baacad332d090656f47225: Status 404 returned error can't find the container with id 721ebfe08bf8261f4045d420ef353d1bb7059d7dc2baacad332d090656f47225
Jul 28 17:08:35.631909 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:35.631827    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q" event={"ID":"44b87468-c82e-47b3-87cc-a24d752a8836","Type":"ContainerStarted","Data":"721ebfe08bf8261f4045d420ef353d1bb7059d7dc2baacad332d090656f47225"}
Jul 28 17:08:50.703337 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:50.703289    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q" event={"ID":"44b87468-c82e-47b3-87cc-a24d752a8836","Type":"ContainerStarted","Data":"da386f6a24a5b9385cf595e64ab1f2d7dfd4011e11a3757ae7a7ba3b99781798"}
Jul 28 17:08:54.719421 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:54.719387    2561 generic.go:356] "Generic (PLEG): container finished" podID="44b87468-c82e-47b3-87cc-a24d752a8836" containerID="da386f6a24a5b9385cf595e64ab1f2d7dfd4011e11a3757ae7a7ba3b99781798" exitCode=0
Jul 28 17:08:54.719854 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:54.719456    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q" event={"ID":"44b87468-c82e-47b3-87cc-a24d752a8836","Type":"ContainerDied","Data":"da386f6a24a5b9385cf595e64ab1f2d7dfd4011e11a3757ae7a7ba3b99781798"}
Jul 28 17:08:55.731398 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:08:55.731360    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q" event={"ID":"44b87468-c82e-47b3-87cc-a24d752a8836","Type":"ContainerStarted","Data":"029279c797c4a2b206d515535b03ae761863fc0109cd1c21cf3b7773edd59e37"}
Jul 28 17:09:00.753627 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:09:00.753591    2561 generic.go:356] "Generic (PLEG): container finished" podID="44b87468-c82e-47b3-87cc-a24d752a8836" containerID="029279c797c4a2b206d515535b03ae761863fc0109cd1c21cf3b7773edd59e37" exitCode=0
Jul 28 17:09:00.754045 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:09:00.753640    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q" event={"ID":"44b87468-c82e-47b3-87cc-a24d752a8836","Type":"ContainerDied","Data":"029279c797c4a2b206d515535b03ae761863fc0109cd1c21cf3b7773edd59e37"}
Jul 28 17:09:01.764982 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:09:01.764917    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q" event={"ID":"44b87468-c82e-47b3-87cc-a24d752a8836","Type":"ContainerStarted","Data":"5a8b682bcaf1db4de8d6673ba344b8b9dc5119098c6e3ead2c38c223eb7e8892"}
Jul 28 17:09:01.765486 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:09:01.764996    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q" event={"ID":"44b87468-c82e-47b3-87cc-a24d752a8836","Type":"ContainerStarted","Data":"12835ef81e38bd91f9cf7b725d8b913b85fabc8638f622a73633d07a1e03f6ba"}
Jul 28 17:09:01.765486 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:09:01.765017    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q" event={"ID":"44b87468-c82e-47b3-87cc-a24d752a8836","Type":"ContainerStarted","Data":"d6320635ff1136b6d1ff7fb4447f5b1166f4349696c99307690360bcac028425"}
Jul 28 17:09:01.765486 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:09:01.765034    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q" event={"ID":"44b87468-c82e-47b3-87cc-a24d752a8836","Type":"ContainerStarted","Data":"8ce3e4914ad830e80164d69840603451018ab8c5a0c96893e83612627587ee2e"}
Jul 28 17:09:01.798096 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:09:01.798013    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q" podStartSLOduration=13.564581562 podStartE2EDuration="27.79798948s" totalImagesPullingTime="14.233407918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:08:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:09:01.79456633 +0000 UTC m=+1131.265980016" watchObservedRunningTime="2026-07-28 17:09:01.79798948 +0000 UTC m=+1131.269403142"
Jul 28 17:09:02.274313 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:09:02.274278    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q"
Jul 28 17:09:02.274596 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:09:02.274572    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q"
Jul 28 17:09:02.274596 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:09:02.274602    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q"
Jul 28 17:09:02.274805 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:09:02.274618    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q"
Jul 28 17:09:02.276473 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:09:02.276431    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q" podUID="44b87468-c82e-47b3-87cc-a24d752a8836" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.32:8443: connect: connection refused"
Jul 28 17:09:02.276604 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:09:02.276458    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q" podUID="44b87468-c82e-47b3-87cc-a24d752a8836" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.32:6571: connect: connection refused"
Jul 28 17:09:02.276604 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:09:02.276506    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q" podUID="44b87468-c82e-47b3-87cc-a24d752a8836" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.32:8816: connect: connection refused"
Jul 28 17:09:02.276604 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:09:02.276560    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q" podUID="44b87468-c82e-47b3-87cc-a24d752a8836" containerName="online" probeResult="failure" output="Get \"https://10.134.0.32:6567/health\": dial tcp 10.134.0.32:6567: connect: connection refused"
Jul 28 17:09:05.274665 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:09:05.274316    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q"
Jul 28 17:09:05.274665 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:09:05.274380    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q"
Jul 28 17:09:05.274665 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:09:05.274528    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q" podUID="44b87468-c82e-47b3-87cc-a24d752a8836" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.32:8443: connect: connection refused"
Jul 28 17:09:05.274665 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:09:05.274574    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q" podUID="44b87468-c82e-47b3-87cc-a24d752a8836" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.32:6571: connect: connection refused"
Jul 28 17:09:05.274665 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:09:05.274579    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q" podUID="44b87468-c82e-47b3-87cc-a24d752a8836" containerName="online" probeResult="failure" output="Get \"https://10.134.0.32:6567/health\": dial tcp 10.134.0.32:6567: connect: connection refused"
Jul 28 17:09:05.275416 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:09:05.274883    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q"
Jul 28 17:09:05.275416 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:09:05.274965    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q"
Jul 28 17:09:05.275416 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:09:05.275271    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q" podUID="44b87468-c82e-47b3-87cc-a24d752a8836" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.32:8816: connect: connection refused"
Jul 28 17:09:08.274992 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:09:08.274961    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q"
Jul 28 17:09:08.275381 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:09:08.275118    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q"
Jul 28 17:09:08.275509 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:09:08.275487    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q"
Jul 28 17:09:08.276017 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:09:08.275996    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q"
Jul 28 17:09:08.276126 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:09:08.276046    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q"
Jul 28 17:09:08.276126 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:09:08.276075    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q"
Jul 28 17:09:08.279855 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:09:08.279839    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q"
Jul 28 17:09:08.807077 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:09:08.807048    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q"
Jul 28 17:10:11.876651 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:11.876614    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:10:11.877151 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:11.876657    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q"]
Jul 28 17:10:11.877151 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:11.876954    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q" podUID="44b87468-c82e-47b3-87cc-a24d752a8836" containerName="registry" containerID="cri-o://8ce3e4914ad830e80164d69840603451018ab8c5a0c96893e83612627587ee2e" gracePeriod=30
Jul 28 17:10:11.877151 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:11.877002    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q" podUID="44b87468-c82e-47b3-87cc-a24d752a8836" containerName="ui" containerID="cri-o://5a8b682bcaf1db4de8d6673ba344b8b9dc5119098c6e3ead2c38c223eb7e8892" gracePeriod=30
Jul 28 17:10:11.877151 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:11.876987    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q" podUID="44b87468-c82e-47b3-87cc-a24d752a8836" containerName="online" containerID="cri-o://d6320635ff1136b6d1ff7fb4447f5b1166f4349696c99307690360bcac028425" gracePeriod=30
Jul 28 17:10:11.877151 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:11.876999    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q" podUID="44b87468-c82e-47b3-87cc-a24d752a8836" containerName="offline" containerID="cri-o://12835ef81e38bd91f9cf7b725d8b913b85fabc8638f622a73633d07a1e03f6ba" gracePeriod=30
Jul 28 17:10:11.953116 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:11.953073    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:10:12.069835 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:12.069793    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:10:12.168012 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:12.167887    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:10:12.272537 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:12.272484    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:10:12.274524 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:12.274500    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn"]
Jul 28 17:10:12.278307 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:12.278291    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn"
Jul 28 17:10:12.280886 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:12.280870    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-snp5j\""
Jul 28 17:10:12.298316 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:12.298284    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn"]
Jul 28 17:10:12.371638 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:12.371603    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3090665c-f527-4e02-b64e-3df0f7355f1e-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-8s4hn\" (UID: \"3090665c-f527-4e02-b64e-3df0f7355f1e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn"
Jul 28 17:10:12.371827 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:12.371691    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3090665c-f527-4e02-b64e-3df0f7355f1e-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-8s4hn\" (UID: \"3090665c-f527-4e02-b64e-3df0f7355f1e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn"
Jul 28 17:10:12.371827 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:12.371742    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3090665c-f527-4e02-b64e-3df0f7355f1e-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-8s4hn\" (UID: \"3090665c-f527-4e02-b64e-3df0f7355f1e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn"
Jul 28 17:10:12.371827 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:12.371772    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3090665c-f527-4e02-b64e-3df0f7355f1e-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-8s4hn\" (UID: \"3090665c-f527-4e02-b64e-3df0f7355f1e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn"
Jul 28 17:10:12.371827 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:12.371802    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84m7h\" (UniqueName: \"kubernetes.io/projected/3090665c-f527-4e02-b64e-3df0f7355f1e-kube-api-access-84m7h\") pod \"feast-simple-feast-setup-777d6cc998-8s4hn\" (UID: \"3090665c-f527-4e02-b64e-3df0f7355f1e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn"
Jul 28 17:10:12.372004 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:12.371853    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3090665c-f527-4e02-b64e-3df0f7355f1e-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-8s4hn\" (UID: \"3090665c-f527-4e02-b64e-3df0f7355f1e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn"
Jul 28 17:10:12.472574 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:12.472540    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3090665c-f527-4e02-b64e-3df0f7355f1e-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-8s4hn\" (UID: \"3090665c-f527-4e02-b64e-3df0f7355f1e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn"
Jul 28 17:10:12.472737 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:12.472595    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3090665c-f527-4e02-b64e-3df0f7355f1e-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-8s4hn\" (UID: \"3090665c-f527-4e02-b64e-3df0f7355f1e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn"
Jul 28 17:10:12.472737 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:12.472616    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3090665c-f527-4e02-b64e-3df0f7355f1e-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-8s4hn\" (UID: \"3090665c-f527-4e02-b64e-3df0f7355f1e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn"
Jul 28 17:10:12.472737 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:12.472632    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3090665c-f527-4e02-b64e-3df0f7355f1e-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-8s4hn\" (UID: \"3090665c-f527-4e02-b64e-3df0f7355f1e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn"
Jul 28 17:10:12.472737 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:12.472649    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3090665c-f527-4e02-b64e-3df0f7355f1e-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-8s4hn\" (UID: \"3090665c-f527-4e02-b64e-3df0f7355f1e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn"
Jul 28 17:10:12.472737 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:12.472669    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84m7h\" (UniqueName: \"kubernetes.io/projected/3090665c-f527-4e02-b64e-3df0f7355f1e-kube-api-access-84m7h\") pod \"feast-simple-feast-setup-777d6cc998-8s4hn\" (UID: \"3090665c-f527-4e02-b64e-3df0f7355f1e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn"
Jul 28 17:10:12.472737 ip-10-0-128-92 kubenswrapper[2561]: E0728 17:10:12.472709    2561 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Jul 28 17:10:12.473082 ip-10-0-128-92 kubenswrapper[2561]: E0728 17:10:12.472795    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3090665c-f527-4e02-b64e-3df0f7355f1e-ui-tls podName:3090665c-f527-4e02-b64e-3df0f7355f1e nodeName:}" failed. No retries permitted until 2026-07-28 17:10:12.972771646 +0000 UTC m=+1202.444185303 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/3090665c-f527-4e02-b64e-3df0f7355f1e-ui-tls") pod "feast-simple-feast-setup-777d6cc998-8s4hn" (UID: "3090665c-f527-4e02-b64e-3df0f7355f1e") : secret "feast-simple-feast-setup-ui-tls" not found
Jul 28 17:10:12.473191 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:12.473166    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3090665c-f527-4e02-b64e-3df0f7355f1e-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-8s4hn\" (UID: \"3090665c-f527-4e02-b64e-3df0f7355f1e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn"
Jul 28 17:10:12.475378 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:12.475353    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3090665c-f527-4e02-b64e-3df0f7355f1e-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-8s4hn\" (UID: \"3090665c-f527-4e02-b64e-3df0f7355f1e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn"
Jul 28 17:10:12.475480 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:12.475416    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3090665c-f527-4e02-b64e-3df0f7355f1e-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-8s4hn\" (UID: \"3090665c-f527-4e02-b64e-3df0f7355f1e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn"
Jul 28 17:10:12.475524 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:12.475495    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3090665c-f527-4e02-b64e-3df0f7355f1e-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-8s4hn\" (UID: \"3090665c-f527-4e02-b64e-3df0f7355f1e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn"
Jul 28 17:10:12.483555 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:12.483530    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84m7h\" (UniqueName: \"kubernetes.io/projected/3090665c-f527-4e02-b64e-3df0f7355f1e-kube-api-access-84m7h\") pod \"feast-simple-feast-setup-777d6cc998-8s4hn\" (UID: \"3090665c-f527-4e02-b64e-3df0f7355f1e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn"
Jul 28 17:10:12.494190 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:12.494163    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:10:12.598142 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:12.598092    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:10:12.976240 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:12.976217    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3090665c-f527-4e02-b64e-3df0f7355f1e-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-8s4hn\" (UID: \"3090665c-f527-4e02-b64e-3df0f7355f1e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn"
Jul 28 17:10:12.978656 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:12.978634    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3090665c-f527-4e02-b64e-3df0f7355f1e-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-8s4hn\" (UID: \"3090665c-f527-4e02-b64e-3df0f7355f1e\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn"
Jul 28 17:10:13.042270 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:13.042241    2561 generic.go:356] "Generic (PLEG): container finished" podID="44b87468-c82e-47b3-87cc-a24d752a8836" containerID="5a8b682bcaf1db4de8d6673ba344b8b9dc5119098c6e3ead2c38c223eb7e8892" exitCode=0
Jul 28 17:10:13.042270 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:13.042264    2561 generic.go:356] "Generic (PLEG): container finished" podID="44b87468-c82e-47b3-87cc-a24d752a8836" containerID="d6320635ff1136b6d1ff7fb4447f5b1166f4349696c99307690360bcac028425" exitCode=0
Jul 28 17:10:13.042417 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:13.042315    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q" event={"ID":"44b87468-c82e-47b3-87cc-a24d752a8836","Type":"ContainerDied","Data":"5a8b682bcaf1db4de8d6673ba344b8b9dc5119098c6e3ead2c38c223eb7e8892"}
Jul 28 17:10:13.042417 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:13.042351    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q" event={"ID":"44b87468-c82e-47b3-87cc-a24d752a8836","Type":"ContainerDied","Data":"d6320635ff1136b6d1ff7fb4447f5b1166f4349696c99307690360bcac028425"}
Jul 28 17:10:13.189378 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:13.189356    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn"
Jul 28 17:10:13.336041 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:13.331949    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn"]
Jul 28 17:10:13.340150 ip-10-0-128-92 kubenswrapper[2561]: W0728 17:10:13.340122    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3090665c_f527_4e02_b64e_3df0f7355f1e.slice/crio-433d35ab33f4e993005e0ccbd6a43fc907e80fdb5dd8a5be8c6b663ad0fcc904 WatchSource:0}: Error finding container 433d35ab33f4e993005e0ccbd6a43fc907e80fdb5dd8a5be8c6b663ad0fcc904: Status 404 returned error can't find the container with id 433d35ab33f4e993005e0ccbd6a43fc907e80fdb5dd8a5be8c6b663ad0fcc904
Jul 28 17:10:14.047710 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:14.047675    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn" event={"ID":"3090665c-f527-4e02-b64e-3df0f7355f1e","Type":"ContainerStarted","Data":"73671544ba5643098f690ba52fbd41e566d55c05b87414d51fe8bef2f94c997f"}
Jul 28 17:10:14.048204 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:14.047721    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn" event={"ID":"3090665c-f527-4e02-b64e-3df0f7355f1e","Type":"ContainerStarted","Data":"433d35ab33f4e993005e0ccbd6a43fc907e80fdb5dd8a5be8c6b663ad0fcc904"}
Jul 28 17:10:18.063382 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:18.063352    2561 generic.go:356] "Generic (PLEG): container finished" podID="3090665c-f527-4e02-b64e-3df0f7355f1e" containerID="73671544ba5643098f690ba52fbd41e566d55c05b87414d51fe8bef2f94c997f" exitCode=0
Jul 28 17:10:18.063709 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:18.063406    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn" event={"ID":"3090665c-f527-4e02-b64e-3df0f7355f1e","Type":"ContainerDied","Data":"73671544ba5643098f690ba52fbd41e566d55c05b87414d51fe8bef2f94c997f"}
Jul 28 17:10:18.276299 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:18.276205    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q" podUID="44b87468-c82e-47b3-87cc-a24d752a8836" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.32:8443: connect: connection refused"
Jul 28 17:10:18.804391 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:18.804345    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q" podUID="44b87468-c82e-47b3-87cc-a24d752a8836" containerName="online" probeResult="failure" output="Get \"https://10.134.0.32:6567/health\": dial tcp 10.134.0.32:6567: connect: connection refused"
Jul 28 17:10:19.068954 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:19.068851    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn" event={"ID":"3090665c-f527-4e02-b64e-3df0f7355f1e","Type":"ContainerStarted","Data":"4098c46217235941146099f8849fdb29e8b598fb8f701d926ea8705c6e125a2d"}
Jul 28 17:10:24.093678 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:24.093646    2561 generic.go:356] "Generic (PLEG): container finished" podID="3090665c-f527-4e02-b64e-3df0f7355f1e" containerID="4098c46217235941146099f8849fdb29e8b598fb8f701d926ea8705c6e125a2d" exitCode=0
Jul 28 17:10:24.094071 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:24.093708    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn" event={"ID":"3090665c-f527-4e02-b64e-3df0f7355f1e","Type":"ContainerDied","Data":"4098c46217235941146099f8849fdb29e8b598fb8f701d926ea8705c6e125a2d"}
Jul 28 17:10:25.103328 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:25.103283    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn" event={"ID":"3090665c-f527-4e02-b64e-3df0f7355f1e","Type":"ContainerStarted","Data":"3edc50233c1534ff84710694875ca2cac6c3f6493da049180db9e7f1fe646937"}
Jul 28 17:10:25.103824 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:25.103347    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn" event={"ID":"3090665c-f527-4e02-b64e-3df0f7355f1e","Type":"ContainerStarted","Data":"cc5b923324acff7dd71f989e9a2ec14fb8cd2cb2b9ca099fa3abf506b4576398"}
Jul 28 17:10:25.103824 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:25.103368    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn" event={"ID":"3090665c-f527-4e02-b64e-3df0f7355f1e","Type":"ContainerStarted","Data":"094b55e12ee71dd1de42150c9fbbb350af3d26ddeb564a503e81ae442b01e56f"}
Jul 28 17:10:25.103824 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:25.103386    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn" event={"ID":"3090665c-f527-4e02-b64e-3df0f7355f1e","Type":"ContainerStarted","Data":"05b7517eaa6f1214a4d640d1cba50abe89f90e5cd6b8b5b8d8350cd7322b2c4b"}
Jul 28 17:10:25.137027 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:25.136958    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn" podStartSLOduration=13.136918359 podStartE2EDuration="13.136918359s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:10:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:10:25.132908521 +0000 UTC m=+1214.604322204" watchObservedRunningTime="2026-07-28 17:10:25.136918359 +0000 UTC m=+1214.608332021"
Jul 28 17:10:25.190179 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:25.190129    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn"
Jul 28 17:10:25.190372 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:25.190190    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn"
Jul 28 17:10:25.190372 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:25.190210    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn"
Jul 28 17:10:25.190372 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:25.190228    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn"
Jul 28 17:10:25.192124 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:25.192087    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn" podUID="3090665c-f527-4e02-b64e-3df0f7355f1e" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.33:8816: connect: connection refused"
Jul 28 17:10:25.192410 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:25.192144    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn" podUID="3090665c-f527-4e02-b64e-3df0f7355f1e" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.33:6571: connect: connection refused"
Jul 28 17:10:25.192410 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:25.192162    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn" podUID="3090665c-f527-4e02-b64e-3df0f7355f1e" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.33:8443: connect: connection refused"
Jul 28 17:10:25.192613 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:25.192162    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn" podUID="3090665c-f527-4e02-b64e-3df0f7355f1e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.33:6567/health\": dial tcp 10.134.0.33:6567: connect: connection refused"
Jul 28 17:10:28.190029 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:28.189979    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn" podUID="3090665c-f527-4e02-b64e-3df0f7355f1e" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.33:6571: connect: connection refused"
Jul 28 17:10:28.190687 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:28.190008    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn" podUID="3090665c-f527-4e02-b64e-3df0f7355f1e" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.33:8443: connect: connection refused"
Jul 28 17:10:28.190880 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:28.190008    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn" podUID="3090665c-f527-4e02-b64e-3df0f7355f1e" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.33:8816: connect: connection refused"
Jul 28 17:10:28.190880 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:28.190046    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn" podUID="3090665c-f527-4e02-b64e-3df0f7355f1e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.33:6567/health\": dial tcp 10.134.0.33:6567: connect: connection refused"
Jul 28 17:10:28.276571 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:28.276361    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q" podUID="44b87468-c82e-47b3-87cc-a24d752a8836" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.32:8443: connect: connection refused"
Jul 28 17:10:28.804601 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:28.804551    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q" podUID="44b87468-c82e-47b3-87cc-a24d752a8836" containerName="online" probeResult="failure" output="Get \"https://10.134.0.32:6567/health\": dial tcp 10.134.0.32:6567: connect: connection refused"
Jul 28 17:10:31.191095 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:31.191070    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn"
Jul 28 17:10:31.192780 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:31.191169    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn"
Jul 28 17:10:31.192780 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:31.191444    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn"
Jul 28 17:10:31.192780 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:31.191888    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn"
Jul 28 17:10:31.192780 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:31.191923    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn"
Jul 28 17:10:31.192780 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:31.191960    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn"
Jul 28 17:10:31.192780 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:31.192093    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn"
Jul 28 17:10:31.192780 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:31.192155    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn"
Jul 28 17:10:31.192780 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:31.192323    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn"
Jul 28 17:10:31.196030 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:31.196014    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn"
Jul 28 17:10:32.137987 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:32.137955    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn"
Jul 28 17:10:32.141098 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:32.141080    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn"
Jul 28 17:10:38.275952 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:38.275881    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q" podUID="44b87468-c82e-47b3-87cc-a24d752a8836" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.32:8443: connect: connection refused"
Jul 28 17:10:38.276417 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:38.276060    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q"
Jul 28 17:10:38.804330 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:38.804290    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q" podUID="44b87468-c82e-47b3-87cc-a24d752a8836" containerName="online" probeResult="failure" output="Get \"https://10.134.0.32:6567/health\": dial tcp 10.134.0.32:6567: connect: connection refused"
Jul 28 17:10:38.804524 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:38.804439    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q"
Jul 28 17:10:41.933016 ip-10-0-128-92 kubenswrapper[2561]: E0728 17:10:41.932979    2561 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod44b87468_c82e_47b3_87cc_a24d752a8836.slice/crio-conmon-8ce3e4914ad830e80164d69840603451018ab8c5a0c96893e83612627587ee2e.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod44b87468_c82e_47b3_87cc_a24d752a8836.slice/crio-conmon-12835ef81e38bd91f9cf7b725d8b913b85fabc8638f622a73633d07a1e03f6ba.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod44b87468_c82e_47b3_87cc_a24d752a8836.slice/crio-8ce3e4914ad830e80164d69840603451018ab8c5a0c96893e83612627587ee2e.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod44b87468_c82e_47b3_87cc_a24d752a8836.slice/crio-12835ef81e38bd91f9cf7b725d8b913b85fabc8638f622a73633d07a1e03f6ba.scope\": RecentStats: unable to find data in memory cache]"
Jul 28 17:10:42.179612 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:42.179530    2561 generic.go:356] "Generic (PLEG): container finished" podID="44b87468-c82e-47b3-87cc-a24d752a8836" containerID="12835ef81e38bd91f9cf7b725d8b913b85fabc8638f622a73633d07a1e03f6ba" exitCode=137
Jul 28 17:10:42.179612 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:42.179555    2561 generic.go:356] "Generic (PLEG): container finished" podID="44b87468-c82e-47b3-87cc-a24d752a8836" containerID="8ce3e4914ad830e80164d69840603451018ab8c5a0c96893e83612627587ee2e" exitCode=137
Jul 28 17:10:42.179612 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:42.179596    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q" event={"ID":"44b87468-c82e-47b3-87cc-a24d752a8836","Type":"ContainerDied","Data":"12835ef81e38bd91f9cf7b725d8b913b85fabc8638f622a73633d07a1e03f6ba"}
Jul 28 17:10:42.179818 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:42.179637    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q" event={"ID":"44b87468-c82e-47b3-87cc-a24d752a8836","Type":"ContainerDied","Data":"8ce3e4914ad830e80164d69840603451018ab8c5a0c96893e83612627587ee2e"}
Jul 28 17:10:42.526233 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:42.526211    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q"
Jul 28 17:10:42.607230 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:42.607206    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/44b87468-c82e-47b3-87cc-a24d752a8836-online-tls\") pod \"44b87468-c82e-47b3-87cc-a24d752a8836\" (UID: \"44b87468-c82e-47b3-87cc-a24d752a8836\") "
Jul 28 17:10:42.607391 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:42.607244    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qfvnm\" (UniqueName: \"kubernetes.io/projected/44b87468-c82e-47b3-87cc-a24d752a8836-kube-api-access-qfvnm\") pod \"44b87468-c82e-47b3-87cc-a24d752a8836\" (UID: \"44b87468-c82e-47b3-87cc-a24d752a8836\") "
Jul 28 17:10:42.607391 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:42.607289    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/44b87468-c82e-47b3-87cc-a24d752a8836-ui-tls\") pod \"44b87468-c82e-47b3-87cc-a24d752a8836\" (UID: \"44b87468-c82e-47b3-87cc-a24d752a8836\") "
Jul 28 17:10:42.607391 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:42.607346    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/44b87468-c82e-47b3-87cc-a24d752a8836-offline-tls\") pod \"44b87468-c82e-47b3-87cc-a24d752a8836\" (UID: \"44b87468-c82e-47b3-87cc-a24d752a8836\") "
Jul 28 17:10:42.607391 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:42.607380    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/44b87468-c82e-47b3-87cc-a24d752a8836-registry-tls\") pod \"44b87468-c82e-47b3-87cc-a24d752a8836\" (UID: \"44b87468-c82e-47b3-87cc-a24d752a8836\") "
Jul 28 17:10:42.607596 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:42.607406    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/44b87468-c82e-47b3-87cc-a24d752a8836-feast-data\") pod \"44b87468-c82e-47b3-87cc-a24d752a8836\" (UID: \"44b87468-c82e-47b3-87cc-a24d752a8836\") "
Jul 28 17:10:42.608277 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:42.608239    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44b87468-c82e-47b3-87cc-a24d752a8836-feast-data" (OuterVolumeSpecName: "feast-data") pod "44b87468-c82e-47b3-87cc-a24d752a8836" (UID: "44b87468-c82e-47b3-87cc-a24d752a8836"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:10:42.609681 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:42.609656    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44b87468-c82e-47b3-87cc-a24d752a8836-online-tls" (OuterVolumeSpecName: "online-tls") pod "44b87468-c82e-47b3-87cc-a24d752a8836" (UID: "44b87468-c82e-47b3-87cc-a24d752a8836"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:10:42.609770 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:42.609677    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44b87468-c82e-47b3-87cc-a24d752a8836-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "44b87468-c82e-47b3-87cc-a24d752a8836" (UID: "44b87468-c82e-47b3-87cc-a24d752a8836"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:10:42.609770 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:42.609675    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44b87468-c82e-47b3-87cc-a24d752a8836-kube-api-access-qfvnm" (OuterVolumeSpecName: "kube-api-access-qfvnm") pod "44b87468-c82e-47b3-87cc-a24d752a8836" (UID: "44b87468-c82e-47b3-87cc-a24d752a8836"). InnerVolumeSpecName "kube-api-access-qfvnm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:10:42.610029 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:42.610006    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44b87468-c82e-47b3-87cc-a24d752a8836-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "44b87468-c82e-47b3-87cc-a24d752a8836" (UID: "44b87468-c82e-47b3-87cc-a24d752a8836"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:10:42.610107 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:42.610086    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/44b87468-c82e-47b3-87cc-a24d752a8836-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "44b87468-c82e-47b3-87cc-a24d752a8836" (UID: "44b87468-c82e-47b3-87cc-a24d752a8836"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:10:42.707902 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:42.707850    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/44b87468-c82e-47b3-87cc-a24d752a8836-registry-tls\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:10:42.707902 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:42.707869    2561 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/44b87468-c82e-47b3-87cc-a24d752a8836-feast-data\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:10:42.707902 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:42.707895    2561 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/44b87468-c82e-47b3-87cc-a24d752a8836-online-tls\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:10:42.707902 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:42.707904    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qfvnm\" (UniqueName: \"kubernetes.io/projected/44b87468-c82e-47b3-87cc-a24d752a8836-kube-api-access-qfvnm\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:10:42.708133 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:42.707912    2561 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/44b87468-c82e-47b3-87cc-a24d752a8836-ui-tls\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:10:42.708133 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:42.707921    2561 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/44b87468-c82e-47b3-87cc-a24d752a8836-offline-tls\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:10:43.186153 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:43.186127    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q" event={"ID":"44b87468-c82e-47b3-87cc-a24d752a8836","Type":"ContainerDied","Data":"721ebfe08bf8261f4045d420ef353d1bb7059d7dc2baacad332d090656f47225"}
Jul 28 17:10:43.186491 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:43.186184    2561 scope.go:117] "RemoveContainer" containerID="5a8b682bcaf1db4de8d6673ba344b8b9dc5119098c6e3ead2c38c223eb7e8892"
Jul 28 17:10:43.186491 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:43.186183    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q"
Jul 28 17:10:43.194860 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:43.194833    2561 scope.go:117] "RemoveContainer" containerID="12835ef81e38bd91f9cf7b725d8b913b85fabc8638f622a73633d07a1e03f6ba"
Jul 28 17:10:43.202595 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:43.202581    2561 scope.go:117] "RemoveContainer" containerID="d6320635ff1136b6d1ff7fb4447f5b1166f4349696c99307690360bcac028425"
Jul 28 17:10:43.209789 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:43.209771    2561 scope.go:117] "RemoveContainer" containerID="8ce3e4914ad830e80164d69840603451018ab8c5a0c96893e83612627587ee2e"
Jul 28 17:10:43.215049 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:43.214916    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q"]
Jul 28 17:10:43.218011 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:43.217994    2561 scope.go:117] "RemoveContainer" containerID="029279c797c4a2b206d515535b03ae761863fc0109cd1c21cf3b7773edd59e37"
Jul 28 17:10:43.219880 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:43.219863    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-6rc4q"]
Jul 28 17:10:43.225249 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:43.225234    2561 scope.go:117] "RemoveContainer" containerID="da386f6a24a5b9385cf595e64ab1f2d7dfd4011e11a3757ae7a7ba3b99781798"
Jul 28 17:10:45.076094 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:10:45.076064    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44b87468-c82e-47b3-87cc-a24d752a8836" path="/var/lib/kubelet/pods/44b87468-c82e-47b3-87cc-a24d752a8836/volumes"
Jul 28 17:11:33.725795 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:33.725755    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:11:34.176464 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:34.176371    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk"]
Jul 28 17:11:34.177056 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:34.177034    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44b87468-c82e-47b3-87cc-a24d752a8836" containerName="offline"
Jul 28 17:11:34.177187 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:34.177058    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="44b87468-c82e-47b3-87cc-a24d752a8836" containerName="offline"
Jul 28 17:11:34.177187 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:34.177087    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44b87468-c82e-47b3-87cc-a24d752a8836" containerName="registry"
Jul 28 17:11:34.177187 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:34.177096    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="44b87468-c82e-47b3-87cc-a24d752a8836" containerName="registry"
Jul 28 17:11:34.177187 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:34.177117    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44b87468-c82e-47b3-87cc-a24d752a8836" containerName="feast-apply"
Jul 28 17:11:34.177187 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:34.177125    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="44b87468-c82e-47b3-87cc-a24d752a8836" containerName="feast-apply"
Jul 28 17:11:34.177187 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:34.177135    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44b87468-c82e-47b3-87cc-a24d752a8836" containerName="ui"
Jul 28 17:11:34.177187 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:34.177143    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="44b87468-c82e-47b3-87cc-a24d752a8836" containerName="ui"
Jul 28 17:11:34.177187 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:34.177175    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44b87468-c82e-47b3-87cc-a24d752a8836" containerName="online"
Jul 28 17:11:34.177187 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:34.177184    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="44b87468-c82e-47b3-87cc-a24d752a8836" containerName="online"
Jul 28 17:11:34.177651 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:34.177203    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44b87468-c82e-47b3-87cc-a24d752a8836" containerName="feast-init"
Jul 28 17:11:34.177651 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:34.177212    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="44b87468-c82e-47b3-87cc-a24d752a8836" containerName="feast-init"
Jul 28 17:11:34.177651 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:34.177328    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="44b87468-c82e-47b3-87cc-a24d752a8836" containerName="online"
Jul 28 17:11:34.177651 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:34.177344    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="44b87468-c82e-47b3-87cc-a24d752a8836" containerName="registry"
Jul 28 17:11:34.177651 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:34.177364    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="44b87468-c82e-47b3-87cc-a24d752a8836" containerName="offline"
Jul 28 17:11:34.177651 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:34.177372    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="44b87468-c82e-47b3-87cc-a24d752a8836" containerName="ui"
Jul 28 17:11:34.183262 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:34.183228    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk"
Jul 28 17:11:34.187529 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:34.187508    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Jul 28 17:11:34.187665 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:34.187552    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Jul 28 17:11:34.187665 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:34.187514    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Jul 28 17:11:34.187665 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:34.187642    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-mjcjp\""
Jul 28 17:11:34.188125 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:34.188108    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Jul 28 17:11:34.188773 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:34.188755    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Jul 28 17:11:34.188853 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:34.188780    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Jul 28 17:11:34.193649 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:34.193630    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk"]
Jul 28 17:11:34.287598 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:34.287571    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1eced11f-82fa-4432-b099-9f3538fe1525-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-wkglk\" (UID: \"1eced11f-82fa-4432-b099-9f3538fe1525\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk"
Jul 28 17:11:34.287598 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:34.287598    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1eced11f-82fa-4432-b099-9f3538fe1525-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-wkglk\" (UID: \"1eced11f-82fa-4432-b099-9f3538fe1525\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk"
Jul 28 17:11:34.287767 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:34.287621    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/1eced11f-82fa-4432-b099-9f3538fe1525-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-wkglk\" (UID: \"1eced11f-82fa-4432-b099-9f3538fe1525\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk"
Jul 28 17:11:34.287767 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:34.287689    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1eced11f-82fa-4432-b099-9f3538fe1525-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-wkglk\" (UID: \"1eced11f-82fa-4432-b099-9f3538fe1525\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk"
Jul 28 17:11:34.287767 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:34.287734    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rjcn\" (UniqueName: \"kubernetes.io/projected/1eced11f-82fa-4432-b099-9f3538fe1525-kube-api-access-5rjcn\") pod \"feast-simple-feast-remote-setup-db6955c6c-wkglk\" (UID: \"1eced11f-82fa-4432-b099-9f3538fe1525\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk"
Jul 28 17:11:34.287880 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:34.287771    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1eced11f-82fa-4432-b099-9f3538fe1525-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-wkglk\" (UID: \"1eced11f-82fa-4432-b099-9f3538fe1525\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk"
Jul 28 17:11:34.388299 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:34.388277    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rjcn\" (UniqueName: \"kubernetes.io/projected/1eced11f-82fa-4432-b099-9f3538fe1525-kube-api-access-5rjcn\") pod \"feast-simple-feast-remote-setup-db6955c6c-wkglk\" (UID: \"1eced11f-82fa-4432-b099-9f3538fe1525\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk"
Jul 28 17:11:34.388435 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:34.388305    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1eced11f-82fa-4432-b099-9f3538fe1525-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-wkglk\" (UID: \"1eced11f-82fa-4432-b099-9f3538fe1525\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk"
Jul 28 17:11:34.388435 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:34.388342    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1eced11f-82fa-4432-b099-9f3538fe1525-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-wkglk\" (UID: \"1eced11f-82fa-4432-b099-9f3538fe1525\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk"
Jul 28 17:11:34.388435 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:34.388361    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1eced11f-82fa-4432-b099-9f3538fe1525-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-wkglk\" (UID: \"1eced11f-82fa-4432-b099-9f3538fe1525\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk"
Jul 28 17:11:34.388435 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:34.388386    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/1eced11f-82fa-4432-b099-9f3538fe1525-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-wkglk\" (UID: \"1eced11f-82fa-4432-b099-9f3538fe1525\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk"
Jul 28 17:11:34.388435 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:34.388430    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1eced11f-82fa-4432-b099-9f3538fe1525-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-wkglk\" (UID: \"1eced11f-82fa-4432-b099-9f3538fe1525\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk"
Jul 28 17:11:34.388705 ip-10-0-128-92 kubenswrapper[2561]: E0728 17:11:34.388435    2561 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-offline-tls: secret "feast-simple-feast-remote-setup-offline-tls" not found
Jul 28 17:11:34.388705 ip-10-0-128-92 kubenswrapper[2561]: E0728 17:11:34.388505    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1eced11f-82fa-4432-b099-9f3538fe1525-offline-tls podName:1eced11f-82fa-4432-b099-9f3538fe1525 nodeName:}" failed. No retries permitted until 2026-07-28 17:11:34.888483918 +0000 UTC m=+1284.359897570 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/1eced11f-82fa-4432-b099-9f3538fe1525-offline-tls") pod "feast-simple-feast-remote-setup-db6955c6c-wkglk" (UID: "1eced11f-82fa-4432-b099-9f3538fe1525") : secret "feast-simple-feast-remote-setup-offline-tls" not found
Jul 28 17:11:34.388824 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:34.388775    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1eced11f-82fa-4432-b099-9f3538fe1525-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-wkglk\" (UID: \"1eced11f-82fa-4432-b099-9f3538fe1525\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk"
Jul 28 17:11:34.389145 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:34.389125    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/1eced11f-82fa-4432-b099-9f3538fe1525-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-wkglk\" (UID: \"1eced11f-82fa-4432-b099-9f3538fe1525\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk"
Jul 28 17:11:34.391097 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:34.391066    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1eced11f-82fa-4432-b099-9f3538fe1525-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-wkglk\" (UID: \"1eced11f-82fa-4432-b099-9f3538fe1525\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk"
Jul 28 17:11:34.391338 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:34.391323    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1eced11f-82fa-4432-b099-9f3538fe1525-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-wkglk\" (UID: \"1eced11f-82fa-4432-b099-9f3538fe1525\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk"
Jul 28 17:11:34.398825 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:34.398803    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rjcn\" (UniqueName: \"kubernetes.io/projected/1eced11f-82fa-4432-b099-9f3538fe1525-kube-api-access-5rjcn\") pod \"feast-simple-feast-remote-setup-db6955c6c-wkglk\" (UID: \"1eced11f-82fa-4432-b099-9f3538fe1525\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk"
Jul 28 17:11:34.891540 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:34.891504    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1eced11f-82fa-4432-b099-9f3538fe1525-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-wkglk\" (UID: \"1eced11f-82fa-4432-b099-9f3538fe1525\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk"
Jul 28 17:11:34.894159 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:34.894131    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1eced11f-82fa-4432-b099-9f3538fe1525-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-wkglk\" (UID: \"1eced11f-82fa-4432-b099-9f3538fe1525\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk"
Jul 28 17:11:34.944151 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:34.944116    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:11:35.091989 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:35.091956    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk"
Jul 28 17:11:35.227106 ip-10-0-128-92 kubenswrapper[2561]: W0728 17:11:35.227062    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1eced11f_82fa_4432_b099_9f3538fe1525.slice/crio-588d852da63a65fe71c6e8491264bce375620478d99e065cd237f6e24cbffa9d WatchSource:0}: Error finding container 588d852da63a65fe71c6e8491264bce375620478d99e065cd237f6e24cbffa9d: Status 404 returned error can't find the container with id 588d852da63a65fe71c6e8491264bce375620478d99e065cd237f6e24cbffa9d
Jul 28 17:11:35.228433 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:35.228409    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk"]
Jul 28 17:11:35.397314 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:35.397273    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk" event={"ID":"1eced11f-82fa-4432-b099-9f3538fe1525","Type":"ContainerStarted","Data":"87fe65f70c4817f1ca23e2c5a1e7761086eb33d993a6425d38b50d1f444541d9"}
Jul 28 17:11:35.397500 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:35.397330    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk" event={"ID":"1eced11f-82fa-4432-b099-9f3538fe1525","Type":"ContainerStarted","Data":"588d852da63a65fe71c6e8491264bce375620478d99e065cd237f6e24cbffa9d"}
Jul 28 17:11:40.417914 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:40.417878    2561 generic.go:356] "Generic (PLEG): container finished" podID="1eced11f-82fa-4432-b099-9f3538fe1525" containerID="87fe65f70c4817f1ca23e2c5a1e7761086eb33d993a6425d38b50d1f444541d9" exitCode=0
Jul 28 17:11:40.418294 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:40.417964    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk" event={"ID":"1eced11f-82fa-4432-b099-9f3538fe1525","Type":"ContainerDied","Data":"87fe65f70c4817f1ca23e2c5a1e7761086eb33d993a6425d38b50d1f444541d9"}
Jul 28 17:11:41.424243 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:41.424199    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk" event={"ID":"1eced11f-82fa-4432-b099-9f3538fe1525","Type":"ContainerStarted","Data":"6688fe62df2ae00471e978949992cc0b701aaa3f6f621e31b2050720cc41dd11"}
Jul 28 17:11:42.761170 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:42.761134    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:11:46.445866 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:46.445771    2561 generic.go:356] "Generic (PLEG): container finished" podID="1eced11f-82fa-4432-b099-9f3538fe1525" containerID="6688fe62df2ae00471e978949992cc0b701aaa3f6f621e31b2050720cc41dd11" exitCode=0
Jul 28 17:11:46.445866 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:46.445845    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk" event={"ID":"1eced11f-82fa-4432-b099-9f3538fe1525","Type":"ContainerDied","Data":"6688fe62df2ae00471e978949992cc0b701aaa3f6f621e31b2050720cc41dd11"}
Jul 28 17:11:47.453732 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:47.453690    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk" event={"ID":"1eced11f-82fa-4432-b099-9f3538fe1525","Type":"ContainerStarted","Data":"7460df9c4ba57de24e996fd8efc4665b4710d9b92a88aa88184df6ba169653f1"}
Jul 28 17:11:47.454137 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:47.453753    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk" event={"ID":"1eced11f-82fa-4432-b099-9f3538fe1525","Type":"ContainerStarted","Data":"cb1bc1a77d942c2657a5cab57995b7777fac8b892aeb81ffb90bc4151c4c1f8e"}
Jul 28 17:11:47.454137 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:47.453774    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk" event={"ID":"1eced11f-82fa-4432-b099-9f3538fe1525","Type":"ContainerStarted","Data":"c8fc5d90236ad3f407b43a7d887420ceeaeeafd2aa1dc6b01aa81bdad94de736"}
Jul 28 17:11:47.499745 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:47.499688    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk" podStartSLOduration=13.499668173 podStartE2EDuration="13.499668173s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:11:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:11:47.499485773 +0000 UTC m=+1296.970899467" watchObservedRunningTime="2026-07-28 17:11:47.499668173 +0000 UTC m=+1296.971081834"
Jul 28 17:11:50.093098 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:50.093060    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk"
Jul 28 17:11:50.093700 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:50.093676    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk"
Jul 28 17:11:50.093831 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:50.093705    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk"
Jul 28 17:11:50.094833 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:50.094796    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk" podUID="1eced11f-82fa-4432-b099-9f3538fe1525" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.34:8816: connect: connection refused"
Jul 28 17:11:50.094959 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:50.094828    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk" podUID="1eced11f-82fa-4432-b099-9f3538fe1525" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.34:8443: connect: connection refused"
Jul 28 17:11:50.094959 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:50.094837    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk" podUID="1eced11f-82fa-4432-b099-9f3538fe1525" containerName="online" probeResult="failure" output="Get \"https://10.134.0.34:6567/health\": dial tcp 10.134.0.34:6567: connect: connection refused"
Jul 28 17:11:53.093557 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:53.093529    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk"
Jul 28 17:11:53.094101 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:53.094072    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk"
Jul 28 17:11:53.094239 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:53.094122    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk"
Jul 28 17:11:53.094382 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:53.094367    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk"
Jul 28 17:11:53.100079 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:53.100057    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk"
Jul 28 17:11:53.483424 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:53.483392    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk"
Jul 28 17:11:53.483616 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:53.483442    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk"
Jul 28 17:11:53.483981 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:53.483955    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk"
Jul 28 17:11:53.487720 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:11:53.487698    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk"
Jul 28 17:12:55.844066 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:12:55.843997    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:12:55.870971 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:12:55.870926    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk"]
Jul 28 17:12:55.871178 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:12:55.871147    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk" podUID="1eced11f-82fa-4432-b099-9f3538fe1525" containerName="online" containerID="cri-o://c8fc5d90236ad3f407b43a7d887420ceeaeeafd2aa1dc6b01aa81bdad94de736" gracePeriod=30
Jul 28 17:12:55.871316 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:12:55.871203    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk" podUID="1eced11f-82fa-4432-b099-9f3538fe1525" containerName="ui" containerID="cri-o://7460df9c4ba57de24e996fd8efc4665b4710d9b92a88aa88184df6ba169653f1" gracePeriod=30
Jul 28 17:12:55.871316 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:12:55.871255    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk" podUID="1eced11f-82fa-4432-b099-9f3538fe1525" containerName="offline" containerID="cri-o://cb1bc1a77d942c2657a5cab57995b7777fac8b892aeb81ffb90bc4151c4c1f8e" gracePeriod=30
Jul 28 17:12:55.945126 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:12:55.945091    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:12:55.966288 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:12:55.966262    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn"]
Jul 28 17:12:55.966550 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:12:55.966489    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn" podUID="3090665c-f527-4e02-b64e-3df0f7355f1e" containerName="registry" containerID="cri-o://05b7517eaa6f1214a4d640d1cba50abe89f90e5cd6b8b5b8d8350cd7322b2c4b" gracePeriod=30
Jul 28 17:12:55.966673 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:12:55.966546    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn" podUID="3090665c-f527-4e02-b64e-3df0f7355f1e" containerName="offline" containerID="cri-o://cc5b923324acff7dd71f989e9a2ec14fb8cd2cb2b9ca099fa3abf506b4576398" gracePeriod=30
Jul 28 17:12:55.966673 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:12:55.966562    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn" podUID="3090665c-f527-4e02-b64e-3df0f7355f1e" containerName="ui" containerID="cri-o://3edc50233c1534ff84710694875ca2cac6c3f6493da049180db9e7f1fe646937" gracePeriod=30
Jul 28 17:12:55.966673 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:12:55.966554    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn" podUID="3090665c-f527-4e02-b64e-3df0f7355f1e" containerName="online" containerID="cri-o://094b55e12ee71dd1de42150c9fbbb350af3d26ddeb564a503e81ae442b01e56f" gracePeriod=30
Jul 28 17:12:56.046188 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:12:56.046152    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:12:56.108037 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:12:56.107925    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:12:56.728110 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:12:56.728080    2561 generic.go:356] "Generic (PLEG): container finished" podID="3090665c-f527-4e02-b64e-3df0f7355f1e" containerID="3edc50233c1534ff84710694875ca2cac6c3f6493da049180db9e7f1fe646937" exitCode=0
Jul 28 17:12:56.728110 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:12:56.728108    2561 generic.go:356] "Generic (PLEG): container finished" podID="3090665c-f527-4e02-b64e-3df0f7355f1e" containerID="094b55e12ee71dd1de42150c9fbbb350af3d26ddeb564a503e81ae442b01e56f" exitCode=0
Jul 28 17:12:56.728249 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:12:56.728152    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn" event={"ID":"3090665c-f527-4e02-b64e-3df0f7355f1e","Type":"ContainerDied","Data":"3edc50233c1534ff84710694875ca2cac6c3f6493da049180db9e7f1fe646937"}
Jul 28 17:12:56.728249 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:12:56.728191    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn" event={"ID":"3090665c-f527-4e02-b64e-3df0f7355f1e","Type":"ContainerDied","Data":"094b55e12ee71dd1de42150c9fbbb350af3d26ddeb564a503e81ae442b01e56f"}
Jul 28 17:12:56.730656 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:12:56.730638    2561 generic.go:356] "Generic (PLEG): container finished" podID="1eced11f-82fa-4432-b099-9f3538fe1525" containerID="7460df9c4ba57de24e996fd8efc4665b4710d9b92a88aa88184df6ba169653f1" exitCode=0
Jul 28 17:12:56.730656 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:12:56.730654    2561 generic.go:356] "Generic (PLEG): container finished" podID="1eced11f-82fa-4432-b099-9f3538fe1525" containerID="c8fc5d90236ad3f407b43a7d887420ceeaeeafd2aa1dc6b01aa81bdad94de736" exitCode=0
Jul 28 17:12:56.730780 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:12:56.730671    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk" event={"ID":"1eced11f-82fa-4432-b099-9f3538fe1525","Type":"ContainerDied","Data":"7460df9c4ba57de24e996fd8efc4665b4710d9b92a88aa88184df6ba169653f1"}
Jul 28 17:12:56.730780 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:12:56.730696    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk" event={"ID":"1eced11f-82fa-4432-b099-9f3538fe1525","Type":"ContainerDied","Data":"c8fc5d90236ad3f407b43a7d887420ceeaeeafd2aa1dc6b01aa81bdad94de736"}
Jul 28 17:13:01.153324 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:01.153287    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:13:01.192529 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:01.192491    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn" podUID="3090665c-f527-4e02-b64e-3df0f7355f1e" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.33:8443: connect: connection refused"
Jul 28 17:13:02.139029 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:02.138988    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn" podUID="3090665c-f527-4e02-b64e-3df0f7355f1e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.33:6567/health\": dial tcp 10.134.0.33:6567: connect: connection refused"
Jul 28 17:13:03.483953 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:03.483890    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk" podUID="1eced11f-82fa-4432-b099-9f3538fe1525" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.34:8443: connect: connection refused"
Jul 28 17:13:03.483953 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:03.483891    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk" podUID="1eced11f-82fa-4432-b099-9f3538fe1525" containerName="online" probeResult="failure" output="Get \"https://10.134.0.34:6567/health\": dial tcp 10.134.0.34:6567: connect: connection refused"
Jul 28 17:13:11.192578 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:11.192528    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn" podUID="3090665c-f527-4e02-b64e-3df0f7355f1e" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.33:8443: connect: connection refused"
Jul 28 17:13:12.138501 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:12.138455    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn" podUID="3090665c-f527-4e02-b64e-3df0f7355f1e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.33:6567/health\": dial tcp 10.134.0.33:6567: connect: connection refused"
Jul 28 17:13:13.484300 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:13.484255    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk" podUID="1eced11f-82fa-4432-b099-9f3538fe1525" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.34:8443: connect: connection refused"
Jul 28 17:13:13.484668 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:13.484292    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk" podUID="1eced11f-82fa-4432-b099-9f3538fe1525" containerName="online" probeResult="failure" output="Get \"https://10.134.0.34:6567/health\": dial tcp 10.134.0.34:6567: connect: connection refused"
Jul 28 17:13:21.192208 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:21.192170    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn" podUID="3090665c-f527-4e02-b64e-3df0f7355f1e" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.33:8443: connect: connection refused"
Jul 28 17:13:21.192703 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:21.192299    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn"
Jul 28 17:13:22.138286 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:22.138242    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn" podUID="3090665c-f527-4e02-b64e-3df0f7355f1e" containerName="online" probeResult="failure" output="Get \"https://10.134.0.33:6567/health\": dial tcp 10.134.0.33:6567: connect: connection refused"
Jul 28 17:13:22.138440 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:22.138362    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn"
Jul 28 17:13:23.484347 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:23.484306    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk" podUID="1eced11f-82fa-4432-b099-9f3538fe1525" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.34:8443: connect: connection refused"
Jul 28 17:13:23.484721 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:23.484382    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk" podUID="1eced11f-82fa-4432-b099-9f3538fe1525" containerName="online" probeResult="failure" output="Get \"https://10.134.0.34:6567/health\": dial tcp 10.134.0.34:6567: connect: connection refused"
Jul 28 17:13:23.484721 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:23.484424    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk"
Jul 28 17:13:23.484721 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:23.484470    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk"
Jul 28 17:13:26.094833 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.094810    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk"
Jul 28 17:13:26.131166 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.131103    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5rjcn\" (UniqueName: \"kubernetes.io/projected/1eced11f-82fa-4432-b099-9f3538fe1525-kube-api-access-5rjcn\") pod \"1eced11f-82fa-4432-b099-9f3538fe1525\" (UID: \"1eced11f-82fa-4432-b099-9f3538fe1525\") "
Jul 28 17:13:26.131166 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.131138    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1eced11f-82fa-4432-b099-9f3538fe1525-online-tls\") pod \"1eced11f-82fa-4432-b099-9f3538fe1525\" (UID: \"1eced11f-82fa-4432-b099-9f3538fe1525\") "
Jul 28 17:13:26.131166 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.131159    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1eced11f-82fa-4432-b099-9f3538fe1525-ui-tls\") pod \"1eced11f-82fa-4432-b099-9f3538fe1525\" (UID: \"1eced11f-82fa-4432-b099-9f3538fe1525\") "
Jul 28 17:13:26.131400 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.131173    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1eced11f-82fa-4432-b099-9f3538fe1525-offline-tls\") pod \"1eced11f-82fa-4432-b099-9f3538fe1525\" (UID: \"1eced11f-82fa-4432-b099-9f3538fe1525\") "
Jul 28 17:13:26.131400 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.131221    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/1eced11f-82fa-4432-b099-9f3538fe1525-registry-tls\") pod \"1eced11f-82fa-4432-b099-9f3538fe1525\" (UID: \"1eced11f-82fa-4432-b099-9f3538fe1525\") "
Jul 28 17:13:26.131400 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.131256    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1eced11f-82fa-4432-b099-9f3538fe1525-feast-data\") pod \"1eced11f-82fa-4432-b099-9f3538fe1525\" (UID: \"1eced11f-82fa-4432-b099-9f3538fe1525\") "
Jul 28 17:13:26.132085 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.132043    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1eced11f-82fa-4432-b099-9f3538fe1525-feast-data" (OuterVolumeSpecName: "feast-data") pod "1eced11f-82fa-4432-b099-9f3538fe1525" (UID: "1eced11f-82fa-4432-b099-9f3538fe1525"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:13:26.132085 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.132067    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1eced11f-82fa-4432-b099-9f3538fe1525-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1eced11f-82fa-4432-b099-9f3538fe1525" (UID: "1eced11f-82fa-4432-b099-9f3538fe1525"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:13:26.134142 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.134111    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1eced11f-82fa-4432-b099-9f3538fe1525-online-tls" (OuterVolumeSpecName: "online-tls") pod "1eced11f-82fa-4432-b099-9f3538fe1525" (UID: "1eced11f-82fa-4432-b099-9f3538fe1525"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:13:26.134142 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.134124    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1eced11f-82fa-4432-b099-9f3538fe1525-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "1eced11f-82fa-4432-b099-9f3538fe1525" (UID: "1eced11f-82fa-4432-b099-9f3538fe1525"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:13:26.134298 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.134178    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1eced11f-82fa-4432-b099-9f3538fe1525-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "1eced11f-82fa-4432-b099-9f3538fe1525" (UID: "1eced11f-82fa-4432-b099-9f3538fe1525"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:13:26.134298 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.134191    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1eced11f-82fa-4432-b099-9f3538fe1525-kube-api-access-5rjcn" (OuterVolumeSpecName: "kube-api-access-5rjcn") pod "1eced11f-82fa-4432-b099-9f3538fe1525" (UID: "1eced11f-82fa-4432-b099-9f3538fe1525"). InnerVolumeSpecName "kube-api-access-5rjcn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:13:26.232208 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.232182    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5rjcn\" (UniqueName: \"kubernetes.io/projected/1eced11f-82fa-4432-b099-9f3538fe1525-kube-api-access-5rjcn\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:13:26.232208 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.232205    2561 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/1eced11f-82fa-4432-b099-9f3538fe1525-online-tls\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:13:26.232361 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.232217    2561 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/1eced11f-82fa-4432-b099-9f3538fe1525-ui-tls\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:13:26.232361 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.232225    2561 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/1eced11f-82fa-4432-b099-9f3538fe1525-offline-tls\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:13:26.232361 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.232232    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/1eced11f-82fa-4432-b099-9f3538fe1525-registry-tls\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:13:26.232361 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.232240    2561 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/1eced11f-82fa-4432-b099-9f3538fe1525-feast-data\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:13:26.605030 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.605005    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn"
Jul 28 17:13:26.635430 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.635406    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3090665c-f527-4e02-b64e-3df0f7355f1e-ui-tls\") pod \"3090665c-f527-4e02-b64e-3df0f7355f1e\" (UID: \"3090665c-f527-4e02-b64e-3df0f7355f1e\") "
Jul 28 17:13:26.635526 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.635433    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3090665c-f527-4e02-b64e-3df0f7355f1e-registry-tls\") pod \"3090665c-f527-4e02-b64e-3df0f7355f1e\" (UID: \"3090665c-f527-4e02-b64e-3df0f7355f1e\") "
Jul 28 17:13:26.635526 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.635457    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3090665c-f527-4e02-b64e-3df0f7355f1e-online-tls\") pod \"3090665c-f527-4e02-b64e-3df0f7355f1e\" (UID: \"3090665c-f527-4e02-b64e-3df0f7355f1e\") "
Jul 28 17:13:26.635526 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.635472    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84m7h\" (UniqueName: \"kubernetes.io/projected/3090665c-f527-4e02-b64e-3df0f7355f1e-kube-api-access-84m7h\") pod \"3090665c-f527-4e02-b64e-3df0f7355f1e\" (UID: \"3090665c-f527-4e02-b64e-3df0f7355f1e\") "
Jul 28 17:13:26.635526 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.635498    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3090665c-f527-4e02-b64e-3df0f7355f1e-feast-data\") pod \"3090665c-f527-4e02-b64e-3df0f7355f1e\" (UID: \"3090665c-f527-4e02-b64e-3df0f7355f1e\") "
Jul 28 17:13:26.635704 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.635532    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3090665c-f527-4e02-b64e-3df0f7355f1e-offline-tls\") pod \"3090665c-f527-4e02-b64e-3df0f7355f1e\" (UID: \"3090665c-f527-4e02-b64e-3df0f7355f1e\") "
Jul 28 17:13:26.636165 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.636059    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3090665c-f527-4e02-b64e-3df0f7355f1e-feast-data" (OuterVolumeSpecName: "feast-data") pod "3090665c-f527-4e02-b64e-3df0f7355f1e" (UID: "3090665c-f527-4e02-b64e-3df0f7355f1e"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:13:26.638067 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.638041    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3090665c-f527-4e02-b64e-3df0f7355f1e-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "3090665c-f527-4e02-b64e-3df0f7355f1e" (UID: "3090665c-f527-4e02-b64e-3df0f7355f1e"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:13:26.638727 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.638695    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3090665c-f527-4e02-b64e-3df0f7355f1e-online-tls" (OuterVolumeSpecName: "online-tls") pod "3090665c-f527-4e02-b64e-3df0f7355f1e" (UID: "3090665c-f527-4e02-b64e-3df0f7355f1e"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:13:26.638980 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.638907    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3090665c-f527-4e02-b64e-3df0f7355f1e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "3090665c-f527-4e02-b64e-3df0f7355f1e" (UID: "3090665c-f527-4e02-b64e-3df0f7355f1e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:13:26.638980 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.638924    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3090665c-f527-4e02-b64e-3df0f7355f1e-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "3090665c-f527-4e02-b64e-3df0f7355f1e" (UID: "3090665c-f527-4e02-b64e-3df0f7355f1e"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:13:26.638980 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.638923    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3090665c-f527-4e02-b64e-3df0f7355f1e-kube-api-access-84m7h" (OuterVolumeSpecName: "kube-api-access-84m7h") pod "3090665c-f527-4e02-b64e-3df0f7355f1e" (UID: "3090665c-f527-4e02-b64e-3df0f7355f1e"). InnerVolumeSpecName "kube-api-access-84m7h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:13:26.736796 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.736744    2561 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3090665c-f527-4e02-b64e-3df0f7355f1e-ui-tls\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:13:26.736796 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.736764    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3090665c-f527-4e02-b64e-3df0f7355f1e-registry-tls\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:13:26.736796 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.736773    2561 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3090665c-f527-4e02-b64e-3df0f7355f1e-online-tls\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:13:26.736796 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.736781    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84m7h\" (UniqueName: \"kubernetes.io/projected/3090665c-f527-4e02-b64e-3df0f7355f1e-kube-api-access-84m7h\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:13:26.736796 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.736789    2561 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3090665c-f527-4e02-b64e-3df0f7355f1e-feast-data\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:13:26.736796 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.736797    2561 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3090665c-f527-4e02-b64e-3df0f7355f1e-offline-tls\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:13:26.843504 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.843474    2561 generic.go:356] "Generic (PLEG): container finished" podID="3090665c-f527-4e02-b64e-3df0f7355f1e" containerID="cc5b923324acff7dd71f989e9a2ec14fb8cd2cb2b9ca099fa3abf506b4576398" exitCode=137
Jul 28 17:13:26.843504 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.843503    2561 generic.go:356] "Generic (PLEG): container finished" podID="3090665c-f527-4e02-b64e-3df0f7355f1e" containerID="05b7517eaa6f1214a4d640d1cba50abe89f90e5cd6b8b5b8d8350cd7322b2c4b" exitCode=137
Jul 28 17:13:26.843647 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.843594    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn" event={"ID":"3090665c-f527-4e02-b64e-3df0f7355f1e","Type":"ContainerDied","Data":"cc5b923324acff7dd71f989e9a2ec14fb8cd2cb2b9ca099fa3abf506b4576398"}
Jul 28 17:13:26.843647 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.843608    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn"
Jul 28 17:13:26.843647 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.843629    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn" event={"ID":"3090665c-f527-4e02-b64e-3df0f7355f1e","Type":"ContainerDied","Data":"05b7517eaa6f1214a4d640d1cba50abe89f90e5cd6b8b5b8d8350cd7322b2c4b"}
Jul 28 17:13:26.843788 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.843651    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn" event={"ID":"3090665c-f527-4e02-b64e-3df0f7355f1e","Type":"ContainerDied","Data":"433d35ab33f4e993005e0ccbd6a43fc907e80fdb5dd8a5be8c6b663ad0fcc904"}
Jul 28 17:13:26.843788 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.843677    2561 scope.go:117] "RemoveContainer" containerID="3edc50233c1534ff84710694875ca2cac6c3f6493da049180db9e7f1fe646937"
Jul 28 17:13:26.846757 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.846729    2561 generic.go:356] "Generic (PLEG): container finished" podID="1eced11f-82fa-4432-b099-9f3538fe1525" containerID="cb1bc1a77d942c2657a5cab57995b7777fac8b892aeb81ffb90bc4151c4c1f8e" exitCode=137
Jul 28 17:13:26.846884 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.846805    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk"
Jul 28 17:13:26.846884 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.846804    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk" event={"ID":"1eced11f-82fa-4432-b099-9f3538fe1525","Type":"ContainerDied","Data":"cb1bc1a77d942c2657a5cab57995b7777fac8b892aeb81ffb90bc4151c4c1f8e"}
Jul 28 17:13:26.846884 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.846846    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk" event={"ID":"1eced11f-82fa-4432-b099-9f3538fe1525","Type":"ContainerDied","Data":"588d852da63a65fe71c6e8491264bce375620478d99e065cd237f6e24cbffa9d"}
Jul 28 17:13:26.854294 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.854273    2561 scope.go:117] "RemoveContainer" containerID="cc5b923324acff7dd71f989e9a2ec14fb8cd2cb2b9ca099fa3abf506b4576398"
Jul 28 17:13:26.862327 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.862302    2561 scope.go:117] "RemoveContainer" containerID="094b55e12ee71dd1de42150c9fbbb350af3d26ddeb564a503e81ae442b01e56f"
Jul 28 17:13:26.871356 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.871285    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn"]
Jul 28 17:13:26.871417 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.871388    2561 scope.go:117] "RemoveContainer" containerID="05b7517eaa6f1214a4d640d1cba50abe89f90e5cd6b8b5b8d8350cd7322b2c4b"
Jul 28 17:13:26.876373 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.876353    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-8s4hn"]
Jul 28 17:13:26.879843 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.879699    2561 scope.go:117] "RemoveContainer" containerID="4098c46217235941146099f8849fdb29e8b598fb8f701d926ea8705c6e125a2d"
Jul 28 17:13:26.886681 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.886658    2561 scope.go:117] "RemoveContainer" containerID="73671544ba5643098f690ba52fbd41e566d55c05b87414d51fe8bef2f94c997f"
Jul 28 17:13:26.890325 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.890306    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk"]
Jul 28 17:13:26.895874 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.895825    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-wkglk"]
Jul 28 17:13:26.903876 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.903858    2561 scope.go:117] "RemoveContainer" containerID="3edc50233c1534ff84710694875ca2cac6c3f6493da049180db9e7f1fe646937"
Jul 28 17:13:26.904199 ip-10-0-128-92 kubenswrapper[2561]: E0728 17:13:26.904182    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3edc50233c1534ff84710694875ca2cac6c3f6493da049180db9e7f1fe646937\": container with ID starting with 3edc50233c1534ff84710694875ca2cac6c3f6493da049180db9e7f1fe646937 not found: ID does not exist" containerID="3edc50233c1534ff84710694875ca2cac6c3f6493da049180db9e7f1fe646937"
Jul 28 17:13:26.904251 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.904208    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3edc50233c1534ff84710694875ca2cac6c3f6493da049180db9e7f1fe646937"} err="failed to get container status \"3edc50233c1534ff84710694875ca2cac6c3f6493da049180db9e7f1fe646937\": rpc error: code = NotFound desc = could not find container \"3edc50233c1534ff84710694875ca2cac6c3f6493da049180db9e7f1fe646937\": container with ID starting with 3edc50233c1534ff84710694875ca2cac6c3f6493da049180db9e7f1fe646937 not found: ID does not exist"
Jul 28 17:13:26.904251 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.904226    2561 scope.go:117] "RemoveContainer" containerID="cc5b923324acff7dd71f989e9a2ec14fb8cd2cb2b9ca099fa3abf506b4576398"
Jul 28 17:13:26.904479 ip-10-0-128-92 kubenswrapper[2561]: E0728 17:13:26.904460    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc5b923324acff7dd71f989e9a2ec14fb8cd2cb2b9ca099fa3abf506b4576398\": container with ID starting with cc5b923324acff7dd71f989e9a2ec14fb8cd2cb2b9ca099fa3abf506b4576398 not found: ID does not exist" containerID="cc5b923324acff7dd71f989e9a2ec14fb8cd2cb2b9ca099fa3abf506b4576398"
Jul 28 17:13:26.904515 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.904498    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc5b923324acff7dd71f989e9a2ec14fb8cd2cb2b9ca099fa3abf506b4576398"} err="failed to get container status \"cc5b923324acff7dd71f989e9a2ec14fb8cd2cb2b9ca099fa3abf506b4576398\": rpc error: code = NotFound desc = could not find container \"cc5b923324acff7dd71f989e9a2ec14fb8cd2cb2b9ca099fa3abf506b4576398\": container with ID starting with cc5b923324acff7dd71f989e9a2ec14fb8cd2cb2b9ca099fa3abf506b4576398 not found: ID does not exist"
Jul 28 17:13:26.904552 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.904514    2561 scope.go:117] "RemoveContainer" containerID="094b55e12ee71dd1de42150c9fbbb350af3d26ddeb564a503e81ae442b01e56f"
Jul 28 17:13:26.904738 ip-10-0-128-92 kubenswrapper[2561]: E0728 17:13:26.904722    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"094b55e12ee71dd1de42150c9fbbb350af3d26ddeb564a503e81ae442b01e56f\": container with ID starting with 094b55e12ee71dd1de42150c9fbbb350af3d26ddeb564a503e81ae442b01e56f not found: ID does not exist" containerID="094b55e12ee71dd1de42150c9fbbb350af3d26ddeb564a503e81ae442b01e56f"
Jul 28 17:13:26.904775 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.904750    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"094b55e12ee71dd1de42150c9fbbb350af3d26ddeb564a503e81ae442b01e56f"} err="failed to get container status \"094b55e12ee71dd1de42150c9fbbb350af3d26ddeb564a503e81ae442b01e56f\": rpc error: code = NotFound desc = could not find container \"094b55e12ee71dd1de42150c9fbbb350af3d26ddeb564a503e81ae442b01e56f\": container with ID starting with 094b55e12ee71dd1de42150c9fbbb350af3d26ddeb564a503e81ae442b01e56f not found: ID does not exist"
Jul 28 17:13:26.904775 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.904763    2561 scope.go:117] "RemoveContainer" containerID="05b7517eaa6f1214a4d640d1cba50abe89f90e5cd6b8b5b8d8350cd7322b2c4b"
Jul 28 17:13:26.905054 ip-10-0-128-92 kubenswrapper[2561]: E0728 17:13:26.905037    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05b7517eaa6f1214a4d640d1cba50abe89f90e5cd6b8b5b8d8350cd7322b2c4b\": container with ID starting with 05b7517eaa6f1214a4d640d1cba50abe89f90e5cd6b8b5b8d8350cd7322b2c4b not found: ID does not exist" containerID="05b7517eaa6f1214a4d640d1cba50abe89f90e5cd6b8b5b8d8350cd7322b2c4b"
Jul 28 17:13:26.905116 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.905056    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05b7517eaa6f1214a4d640d1cba50abe89f90e5cd6b8b5b8d8350cd7322b2c4b"} err="failed to get container status \"05b7517eaa6f1214a4d640d1cba50abe89f90e5cd6b8b5b8d8350cd7322b2c4b\": rpc error: code = NotFound desc = could not find container \"05b7517eaa6f1214a4d640d1cba50abe89f90e5cd6b8b5b8d8350cd7322b2c4b\": container with ID starting with 05b7517eaa6f1214a4d640d1cba50abe89f90e5cd6b8b5b8d8350cd7322b2c4b not found: ID does not exist"
Jul 28 17:13:26.905116 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.905068    2561 scope.go:117] "RemoveContainer" containerID="4098c46217235941146099f8849fdb29e8b598fb8f701d926ea8705c6e125a2d"
Jul 28 17:13:26.905285 ip-10-0-128-92 kubenswrapper[2561]: E0728 17:13:26.905270    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4098c46217235941146099f8849fdb29e8b598fb8f701d926ea8705c6e125a2d\": container with ID starting with 4098c46217235941146099f8849fdb29e8b598fb8f701d926ea8705c6e125a2d not found: ID does not exist" containerID="4098c46217235941146099f8849fdb29e8b598fb8f701d926ea8705c6e125a2d"
Jul 28 17:13:26.905325 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.905297    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4098c46217235941146099f8849fdb29e8b598fb8f701d926ea8705c6e125a2d"} err="failed to get container status \"4098c46217235941146099f8849fdb29e8b598fb8f701d926ea8705c6e125a2d\": rpc error: code = NotFound desc = could not find container \"4098c46217235941146099f8849fdb29e8b598fb8f701d926ea8705c6e125a2d\": container with ID starting with 4098c46217235941146099f8849fdb29e8b598fb8f701d926ea8705c6e125a2d not found: ID does not exist"
Jul 28 17:13:26.905325 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.905310    2561 scope.go:117] "RemoveContainer" containerID="73671544ba5643098f690ba52fbd41e566d55c05b87414d51fe8bef2f94c997f"
Jul 28 17:13:26.905544 ip-10-0-128-92 kubenswrapper[2561]: E0728 17:13:26.905527    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73671544ba5643098f690ba52fbd41e566d55c05b87414d51fe8bef2f94c997f\": container with ID starting with 73671544ba5643098f690ba52fbd41e566d55c05b87414d51fe8bef2f94c997f not found: ID does not exist" containerID="73671544ba5643098f690ba52fbd41e566d55c05b87414d51fe8bef2f94c997f"
Jul 28 17:13:26.905664 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.905552    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73671544ba5643098f690ba52fbd41e566d55c05b87414d51fe8bef2f94c997f"} err="failed to get container status \"73671544ba5643098f690ba52fbd41e566d55c05b87414d51fe8bef2f94c997f\": rpc error: code = NotFound desc = could not find container \"73671544ba5643098f690ba52fbd41e566d55c05b87414d51fe8bef2f94c997f\": container with ID starting with 73671544ba5643098f690ba52fbd41e566d55c05b87414d51fe8bef2f94c997f not found: ID does not exist"
Jul 28 17:13:26.905664 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.905578    2561 scope.go:117] "RemoveContainer" containerID="3edc50233c1534ff84710694875ca2cac6c3f6493da049180db9e7f1fe646937"
Jul 28 17:13:26.905798 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.905783    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3edc50233c1534ff84710694875ca2cac6c3f6493da049180db9e7f1fe646937"} err="failed to get container status \"3edc50233c1534ff84710694875ca2cac6c3f6493da049180db9e7f1fe646937\": rpc error: code = NotFound desc = could not find container \"3edc50233c1534ff84710694875ca2cac6c3f6493da049180db9e7f1fe646937\": container with ID starting with 3edc50233c1534ff84710694875ca2cac6c3f6493da049180db9e7f1fe646937 not found: ID does not exist"
Jul 28 17:13:26.905839 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.905799    2561 scope.go:117] "RemoveContainer" containerID="cc5b923324acff7dd71f989e9a2ec14fb8cd2cb2b9ca099fa3abf506b4576398"
Jul 28 17:13:26.906009 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.905994    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc5b923324acff7dd71f989e9a2ec14fb8cd2cb2b9ca099fa3abf506b4576398"} err="failed to get container status \"cc5b923324acff7dd71f989e9a2ec14fb8cd2cb2b9ca099fa3abf506b4576398\": rpc error: code = NotFound desc = could not find container \"cc5b923324acff7dd71f989e9a2ec14fb8cd2cb2b9ca099fa3abf506b4576398\": container with ID starting with cc5b923324acff7dd71f989e9a2ec14fb8cd2cb2b9ca099fa3abf506b4576398 not found: ID does not exist"
Jul 28 17:13:26.906061 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.906009    2561 scope.go:117] "RemoveContainer" containerID="094b55e12ee71dd1de42150c9fbbb350af3d26ddeb564a503e81ae442b01e56f"
Jul 28 17:13:26.906228 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.906214    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"094b55e12ee71dd1de42150c9fbbb350af3d26ddeb564a503e81ae442b01e56f"} err="failed to get container status \"094b55e12ee71dd1de42150c9fbbb350af3d26ddeb564a503e81ae442b01e56f\": rpc error: code = NotFound desc = could not find container \"094b55e12ee71dd1de42150c9fbbb350af3d26ddeb564a503e81ae442b01e56f\": container with ID starting with 094b55e12ee71dd1de42150c9fbbb350af3d26ddeb564a503e81ae442b01e56f not found: ID does not exist"
Jul 28 17:13:26.906281 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.906228    2561 scope.go:117] "RemoveContainer" containerID="05b7517eaa6f1214a4d640d1cba50abe89f90e5cd6b8b5b8d8350cd7322b2c4b"
Jul 28 17:13:26.906481 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.906465    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05b7517eaa6f1214a4d640d1cba50abe89f90e5cd6b8b5b8d8350cd7322b2c4b"} err="failed to get container status \"05b7517eaa6f1214a4d640d1cba50abe89f90e5cd6b8b5b8d8350cd7322b2c4b\": rpc error: code = NotFound desc = could not find container \"05b7517eaa6f1214a4d640d1cba50abe89f90e5cd6b8b5b8d8350cd7322b2c4b\": container with ID starting with 05b7517eaa6f1214a4d640d1cba50abe89f90e5cd6b8b5b8d8350cd7322b2c4b not found: ID does not exist"
Jul 28 17:13:26.906481 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.906480    2561 scope.go:117] "RemoveContainer" containerID="4098c46217235941146099f8849fdb29e8b598fb8f701d926ea8705c6e125a2d"
Jul 28 17:13:26.906761 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.906740    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4098c46217235941146099f8849fdb29e8b598fb8f701d926ea8705c6e125a2d"} err="failed to get container status \"4098c46217235941146099f8849fdb29e8b598fb8f701d926ea8705c6e125a2d\": rpc error: code = NotFound desc = could not find container \"4098c46217235941146099f8849fdb29e8b598fb8f701d926ea8705c6e125a2d\": container with ID starting with 4098c46217235941146099f8849fdb29e8b598fb8f701d926ea8705c6e125a2d not found: ID does not exist"
Jul 28 17:13:26.906829 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.906762    2561 scope.go:117] "RemoveContainer" containerID="73671544ba5643098f690ba52fbd41e566d55c05b87414d51fe8bef2f94c997f"
Jul 28 17:13:26.907043 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.907023    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73671544ba5643098f690ba52fbd41e566d55c05b87414d51fe8bef2f94c997f"} err="failed to get container status \"73671544ba5643098f690ba52fbd41e566d55c05b87414d51fe8bef2f94c997f\": rpc error: code = NotFound desc = could not find container \"73671544ba5643098f690ba52fbd41e566d55c05b87414d51fe8bef2f94c997f\": container with ID starting with 73671544ba5643098f690ba52fbd41e566d55c05b87414d51fe8bef2f94c997f not found: ID does not exist"
Jul 28 17:13:26.907092 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.907044    2561 scope.go:117] "RemoveContainer" containerID="7460df9c4ba57de24e996fd8efc4665b4710d9b92a88aa88184df6ba169653f1"
Jul 28 17:13:26.914669 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.914653    2561 scope.go:117] "RemoveContainer" containerID="cb1bc1a77d942c2657a5cab57995b7777fac8b892aeb81ffb90bc4151c4c1f8e"
Jul 28 17:13:26.921880 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.921867    2561 scope.go:117] "RemoveContainer" containerID="c8fc5d90236ad3f407b43a7d887420ceeaeeafd2aa1dc6b01aa81bdad94de736"
Jul 28 17:13:26.930622 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.930603    2561 scope.go:117] "RemoveContainer" containerID="6688fe62df2ae00471e978949992cc0b701aaa3f6f621e31b2050720cc41dd11"
Jul 28 17:13:26.937483 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.937467    2561 scope.go:117] "RemoveContainer" containerID="87fe65f70c4817f1ca23e2c5a1e7761086eb33d993a6425d38b50d1f444541d9"
Jul 28 17:13:26.944199 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.944118    2561 scope.go:117] "RemoveContainer" containerID="7460df9c4ba57de24e996fd8efc4665b4710d9b92a88aa88184df6ba169653f1"
Jul 28 17:13:26.944355 ip-10-0-128-92 kubenswrapper[2561]: E0728 17:13:26.944338    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7460df9c4ba57de24e996fd8efc4665b4710d9b92a88aa88184df6ba169653f1\": container with ID starting with 7460df9c4ba57de24e996fd8efc4665b4710d9b92a88aa88184df6ba169653f1 not found: ID does not exist" containerID="7460df9c4ba57de24e996fd8efc4665b4710d9b92a88aa88184df6ba169653f1"
Jul 28 17:13:26.944426 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.944364    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7460df9c4ba57de24e996fd8efc4665b4710d9b92a88aa88184df6ba169653f1"} err="failed to get container status \"7460df9c4ba57de24e996fd8efc4665b4710d9b92a88aa88184df6ba169653f1\": rpc error: code = NotFound desc = could not find container \"7460df9c4ba57de24e996fd8efc4665b4710d9b92a88aa88184df6ba169653f1\": container with ID starting with 7460df9c4ba57de24e996fd8efc4665b4710d9b92a88aa88184df6ba169653f1 not found: ID does not exist"
Jul 28 17:13:26.944426 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.944387    2561 scope.go:117] "RemoveContainer" containerID="cb1bc1a77d942c2657a5cab57995b7777fac8b892aeb81ffb90bc4151c4c1f8e"
Jul 28 17:13:26.944601 ip-10-0-128-92 kubenswrapper[2561]: E0728 17:13:26.944585    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb1bc1a77d942c2657a5cab57995b7777fac8b892aeb81ffb90bc4151c4c1f8e\": container with ID starting with cb1bc1a77d942c2657a5cab57995b7777fac8b892aeb81ffb90bc4151c4c1f8e not found: ID does not exist" containerID="cb1bc1a77d942c2657a5cab57995b7777fac8b892aeb81ffb90bc4151c4c1f8e"
Jul 28 17:13:26.944646 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.944605    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb1bc1a77d942c2657a5cab57995b7777fac8b892aeb81ffb90bc4151c4c1f8e"} err="failed to get container status \"cb1bc1a77d942c2657a5cab57995b7777fac8b892aeb81ffb90bc4151c4c1f8e\": rpc error: code = NotFound desc = could not find container \"cb1bc1a77d942c2657a5cab57995b7777fac8b892aeb81ffb90bc4151c4c1f8e\": container with ID starting with cb1bc1a77d942c2657a5cab57995b7777fac8b892aeb81ffb90bc4151c4c1f8e not found: ID does not exist"
Jul 28 17:13:26.944646 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.944620    2561 scope.go:117] "RemoveContainer" containerID="c8fc5d90236ad3f407b43a7d887420ceeaeeafd2aa1dc6b01aa81bdad94de736"
Jul 28 17:13:26.944823 ip-10-0-128-92 kubenswrapper[2561]: E0728 17:13:26.944809    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c8fc5d90236ad3f407b43a7d887420ceeaeeafd2aa1dc6b01aa81bdad94de736\": container with ID starting with c8fc5d90236ad3f407b43a7d887420ceeaeeafd2aa1dc6b01aa81bdad94de736 not found: ID does not exist" containerID="c8fc5d90236ad3f407b43a7d887420ceeaeeafd2aa1dc6b01aa81bdad94de736"
Jul 28 17:13:26.944864 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.944826    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c8fc5d90236ad3f407b43a7d887420ceeaeeafd2aa1dc6b01aa81bdad94de736"} err="failed to get container status \"c8fc5d90236ad3f407b43a7d887420ceeaeeafd2aa1dc6b01aa81bdad94de736\": rpc error: code = NotFound desc = could not find container \"c8fc5d90236ad3f407b43a7d887420ceeaeeafd2aa1dc6b01aa81bdad94de736\": container with ID starting with c8fc5d90236ad3f407b43a7d887420ceeaeeafd2aa1dc6b01aa81bdad94de736 not found: ID does not exist"
Jul 28 17:13:26.944864 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.944837    2561 scope.go:117] "RemoveContainer" containerID="6688fe62df2ae00471e978949992cc0b701aaa3f6f621e31b2050720cc41dd11"
Jul 28 17:13:26.945055 ip-10-0-128-92 kubenswrapper[2561]: E0728 17:13:26.945039    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6688fe62df2ae00471e978949992cc0b701aaa3f6f621e31b2050720cc41dd11\": container with ID starting with 6688fe62df2ae00471e978949992cc0b701aaa3f6f621e31b2050720cc41dd11 not found: ID does not exist" containerID="6688fe62df2ae00471e978949992cc0b701aaa3f6f621e31b2050720cc41dd11"
Jul 28 17:13:26.945106 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.945060    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6688fe62df2ae00471e978949992cc0b701aaa3f6f621e31b2050720cc41dd11"} err="failed to get container status \"6688fe62df2ae00471e978949992cc0b701aaa3f6f621e31b2050720cc41dd11\": rpc error: code = NotFound desc = could not find container \"6688fe62df2ae00471e978949992cc0b701aaa3f6f621e31b2050720cc41dd11\": container with ID starting with 6688fe62df2ae00471e978949992cc0b701aaa3f6f621e31b2050720cc41dd11 not found: ID does not exist"
Jul 28 17:13:26.945106 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.945072    2561 scope.go:117] "RemoveContainer" containerID="87fe65f70c4817f1ca23e2c5a1e7761086eb33d993a6425d38b50d1f444541d9"
Jul 28 17:13:26.945270 ip-10-0-128-92 kubenswrapper[2561]: E0728 17:13:26.945250    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87fe65f70c4817f1ca23e2c5a1e7761086eb33d993a6425d38b50d1f444541d9\": container with ID starting with 87fe65f70c4817f1ca23e2c5a1e7761086eb33d993a6425d38b50d1f444541d9 not found: ID does not exist" containerID="87fe65f70c4817f1ca23e2c5a1e7761086eb33d993a6425d38b50d1f444541d9"
Jul 28 17:13:26.945311 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:26.945278    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87fe65f70c4817f1ca23e2c5a1e7761086eb33d993a6425d38b50d1f444541d9"} err="failed to get container status \"87fe65f70c4817f1ca23e2c5a1e7761086eb33d993a6425d38b50d1f444541d9\": rpc error: code = NotFound desc = could not find container \"87fe65f70c4817f1ca23e2c5a1e7761086eb33d993a6425d38b50d1f444541d9\": container with ID starting with 87fe65f70c4817f1ca23e2c5a1e7761086eb33d993a6425d38b50d1f444541d9 not found: ID does not exist"
Jul 28 17:13:27.075025 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:27.074974    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1eced11f-82fa-4432-b099-9f3538fe1525" path="/var/lib/kubelet/pods/1eced11f-82fa-4432-b099-9f3538fe1525/volumes"
Jul 28 17:13:27.075462 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:27.075449    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3090665c-f527-4e02-b64e-3df0f7355f1e" path="/var/lib/kubelet/pods/3090665c-f527-4e02-b64e-3df0f7355f1e/volumes"
Jul 28 17:13:39.141241 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:39.141207    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:13:39.268671 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:39.268639    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:13:45.299665 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:45.299635    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:13:45.376559 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:45.376524    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:13:45.426272 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:45.426239    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-9v468"]
Jul 28 17:13:45.426449 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:45.426430    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-9v468" podUID="94caf8a8-34b0-41e4-9abe-38aa931bda41" containerName="manager" containerID="cri-o://a55a4a38469375a18e4a4acc7109ef8415b2c8cdbe53d4aa004b1f35ac32c38d" gracePeriod=10
Jul 28 17:13:45.663428 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:45.663407    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-9v468"
Jul 28 17:13:45.773346 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:45.773320    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tbfps\" (UniqueName: \"kubernetes.io/projected/94caf8a8-34b0-41e4-9abe-38aa931bda41-kube-api-access-tbfps\") pod \"94caf8a8-34b0-41e4-9abe-38aa931bda41\" (UID: \"94caf8a8-34b0-41e4-9abe-38aa931bda41\") "
Jul 28 17:13:45.775422 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:45.775396    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94caf8a8-34b0-41e4-9abe-38aa931bda41-kube-api-access-tbfps" (OuterVolumeSpecName: "kube-api-access-tbfps") pod "94caf8a8-34b0-41e4-9abe-38aa931bda41" (UID: "94caf8a8-34b0-41e4-9abe-38aa931bda41"). InnerVolumeSpecName "kube-api-access-tbfps". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:13:45.874342 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:45.874267    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tbfps\" (UniqueName: \"kubernetes.io/projected/94caf8a8-34b0-41e4-9abe-38aa931bda41-kube-api-access-tbfps\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:13:45.920281 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:45.920250    2561 generic.go:356] "Generic (PLEG): container finished" podID="94caf8a8-34b0-41e4-9abe-38aa931bda41" containerID="a55a4a38469375a18e4a4acc7109ef8415b2c8cdbe53d4aa004b1f35ac32c38d" exitCode=0
Jul 28 17:13:45.920381 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:45.920298    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-9v468"
Jul 28 17:13:45.920381 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:45.920332    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-9v468" event={"ID":"94caf8a8-34b0-41e4-9abe-38aa931bda41","Type":"ContainerDied","Data":"a55a4a38469375a18e4a4acc7109ef8415b2c8cdbe53d4aa004b1f35ac32c38d"}
Jul 28 17:13:45.920450 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:45.920382    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-9v468" event={"ID":"94caf8a8-34b0-41e4-9abe-38aa931bda41","Type":"ContainerDied","Data":"c1c71db4cc4e0221fe8135e04ca3251e04f3373805aded2e66c0b8bf52e2170e"}
Jul 28 17:13:45.920450 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:45.920410    2561 scope.go:117] "RemoveContainer" containerID="a55a4a38469375a18e4a4acc7109ef8415b2c8cdbe53d4aa004b1f35ac32c38d"
Jul 28 17:13:45.928583 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:45.928565    2561 scope.go:117] "RemoveContainer" containerID="a55a4a38469375a18e4a4acc7109ef8415b2c8cdbe53d4aa004b1f35ac32c38d"
Jul 28 17:13:45.928827 ip-10-0-128-92 kubenswrapper[2561]: E0728 17:13:45.928809    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a55a4a38469375a18e4a4acc7109ef8415b2c8cdbe53d4aa004b1f35ac32c38d\": container with ID starting with a55a4a38469375a18e4a4acc7109ef8415b2c8cdbe53d4aa004b1f35ac32c38d not found: ID does not exist" containerID="a55a4a38469375a18e4a4acc7109ef8415b2c8cdbe53d4aa004b1f35ac32c38d"
Jul 28 17:13:45.928888 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:45.928834    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a55a4a38469375a18e4a4acc7109ef8415b2c8cdbe53d4aa004b1f35ac32c38d"} err="failed to get container status \"a55a4a38469375a18e4a4acc7109ef8415b2c8cdbe53d4aa004b1f35ac32c38d\": rpc error: code = NotFound desc = could not find container \"a55a4a38469375a18e4a4acc7109ef8415b2c8cdbe53d4aa004b1f35ac32c38d\": container with ID starting with a55a4a38469375a18e4a4acc7109ef8415b2c8cdbe53d4aa004b1f35ac32c38d not found: ID does not exist"
Jul 28 17:13:45.942731 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:45.942710    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-9v468"]
Jul 28 17:13:45.949007 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:45.948983    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-9v468"]
Jul 28 17:13:47.074403 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:47.074368    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94caf8a8-34b0-41e4-9abe-38aa931bda41" path="/var/lib/kubelet/pods/94caf8a8-34b0-41e4-9abe-38aa931bda41/volumes"
Jul 28 17:13:50.781599 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:50.781569    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-rqf2r"]
Jul 28 17:13:50.781987 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:50.781829    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1eced11f-82fa-4432-b099-9f3538fe1525" containerName="feast-init"
Jul 28 17:13:50.781987 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:50.781839    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1eced11f-82fa-4432-b099-9f3538fe1525" containerName="feast-init"
Jul 28 17:13:50.781987 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:50.781846    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1eced11f-82fa-4432-b099-9f3538fe1525" containerName="online"
Jul 28 17:13:50.781987 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:50.781852    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1eced11f-82fa-4432-b099-9f3538fe1525" containerName="online"
Jul 28 17:13:50.781987 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:50.781859    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1eced11f-82fa-4432-b099-9f3538fe1525" containerName="offline"
Jul 28 17:13:50.781987 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:50.781864    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1eced11f-82fa-4432-b099-9f3538fe1525" containerName="offline"
Jul 28 17:13:50.781987 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:50.781871    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1eced11f-82fa-4432-b099-9f3538fe1525" containerName="ui"
Jul 28 17:13:50.781987 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:50.781877    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1eced11f-82fa-4432-b099-9f3538fe1525" containerName="ui"
Jul 28 17:13:50.781987 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:50.781883    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3090665c-f527-4e02-b64e-3df0f7355f1e" containerName="feast-init"
Jul 28 17:13:50.781987 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:50.781888    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3090665c-f527-4e02-b64e-3df0f7355f1e" containerName="feast-init"
Jul 28 17:13:50.781987 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:50.781894    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3090665c-f527-4e02-b64e-3df0f7355f1e" containerName="ui"
Jul 28 17:13:50.781987 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:50.781899    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3090665c-f527-4e02-b64e-3df0f7355f1e" containerName="ui"
Jul 28 17:13:50.781987 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:50.781907    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3090665c-f527-4e02-b64e-3df0f7355f1e" containerName="registry"
Jul 28 17:13:50.781987 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:50.781913    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3090665c-f527-4e02-b64e-3df0f7355f1e" containerName="registry"
Jul 28 17:13:50.781987 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:50.781920    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3090665c-f527-4e02-b64e-3df0f7355f1e" containerName="online"
Jul 28 17:13:50.781987 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:50.781925    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3090665c-f527-4e02-b64e-3df0f7355f1e" containerName="online"
Jul 28 17:13:50.781987 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:50.781944    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3090665c-f527-4e02-b64e-3df0f7355f1e" containerName="offline"
Jul 28 17:13:50.781987 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:50.781950    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3090665c-f527-4e02-b64e-3df0f7355f1e" containerName="offline"
Jul 28 17:13:50.781987 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:50.781960    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1eced11f-82fa-4432-b099-9f3538fe1525" containerName="feast-apply"
Jul 28 17:13:50.781987 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:50.781969    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1eced11f-82fa-4432-b099-9f3538fe1525" containerName="feast-apply"
Jul 28 17:13:50.781987 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:50.781983    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94caf8a8-34b0-41e4-9abe-38aa931bda41" containerName="manager"
Jul 28 17:13:50.781987 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:50.781988    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="94caf8a8-34b0-41e4-9abe-38aa931bda41" containerName="manager"
Jul 28 17:13:50.781987 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:50.781995    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3090665c-f527-4e02-b64e-3df0f7355f1e" containerName="feast-apply"
Jul 28 17:13:50.781987 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:50.782000    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3090665c-f527-4e02-b64e-3df0f7355f1e" containerName="feast-apply"
Jul 28 17:13:50.782700 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:50.782040    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3090665c-f527-4e02-b64e-3df0f7355f1e" containerName="online"
Jul 28 17:13:50.782700 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:50.782047    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1eced11f-82fa-4432-b099-9f3538fe1525" containerName="ui"
Jul 28 17:13:50.782700 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:50.782052    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1eced11f-82fa-4432-b099-9f3538fe1525" containerName="online"
Jul 28 17:13:50.782700 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:50.782058    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1eced11f-82fa-4432-b099-9f3538fe1525" containerName="offline"
Jul 28 17:13:50.782700 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:50.782064    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3090665c-f527-4e02-b64e-3df0f7355f1e" containerName="ui"
Jul 28 17:13:50.782700 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:50.782069    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3090665c-f527-4e02-b64e-3df0f7355f1e" containerName="offline"
Jul 28 17:13:50.782700 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:50.782073    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3090665c-f527-4e02-b64e-3df0f7355f1e" containerName="registry"
Jul 28 17:13:50.782700 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:50.782078    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="94caf8a8-34b0-41e4-9abe-38aa931bda41" containerName="manager"
Jul 28 17:13:50.786122 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:50.786106    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-rqf2r"
Jul 28 17:13:50.790060 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:50.790038    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
Jul 28 17:13:50.791167 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:50.791149    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
Jul 28 17:13:50.791280 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:50.791172    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-pg7xz\""
Jul 28 17:13:50.799566 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:50.799539    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-rqf2r"]
Jul 28 17:13:50.912081 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:50.912048    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw4rl\" (UniqueName: \"kubernetes.io/projected/3be84f98-dc70-4ce7-afeb-7aa5d85bb4cd-kube-api-access-gw4rl\") pod \"feast-operator-controller-manager-7495bcd-rqf2r\" (UID: \"3be84f98-dc70-4ce7-afeb-7aa5d85bb4cd\") " pod="feast-operator-system/feast-operator-controller-manager-7495bcd-rqf2r"
Jul 28 17:13:51.013145 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:51.013115    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw4rl\" (UniqueName: \"kubernetes.io/projected/3be84f98-dc70-4ce7-afeb-7aa5d85bb4cd-kube-api-access-gw4rl\") pod \"feast-operator-controller-manager-7495bcd-rqf2r\" (UID: \"3be84f98-dc70-4ce7-afeb-7aa5d85bb4cd\") " pod="feast-operator-system/feast-operator-controller-manager-7495bcd-rqf2r"
Jul 28 17:13:51.030191 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:51.030167    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw4rl\" (UniqueName: \"kubernetes.io/projected/3be84f98-dc70-4ce7-afeb-7aa5d85bb4cd-kube-api-access-gw4rl\") pod \"feast-operator-controller-manager-7495bcd-rqf2r\" (UID: \"3be84f98-dc70-4ce7-afeb-7aa5d85bb4cd\") " pod="feast-operator-system/feast-operator-controller-manager-7495bcd-rqf2r"
Jul 28 17:13:51.098430 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:51.098361    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-rqf2r"
Jul 28 17:13:51.233284 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:51.233255    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-7495bcd-rqf2r"]
Jul 28 17:13:51.236314 ip-10-0-128-92 kubenswrapper[2561]: W0728 17:13:51.236290    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3be84f98_dc70_4ce7_afeb_7aa5d85bb4cd.slice/crio-8bc947151cc1ab85671328925cc419f911130648930008efd2c1f5f5037de20f WatchSource:0}: Error finding container 8bc947151cc1ab85671328925cc419f911130648930008efd2c1f5f5037de20f: Status 404 returned error can't find the container with id 8bc947151cc1ab85671328925cc419f911130648930008efd2c1f5f5037de20f
Jul 28 17:13:51.943421 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:51.943381    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-rqf2r" event={"ID":"3be84f98-dc70-4ce7-afeb-7aa5d85bb4cd","Type":"ContainerStarted","Data":"8da2492b36f0783bc939d36b9087d6bf6cb836306107b7460d14c3d3da6ab33c"}
Jul 28 17:13:51.943863 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:51.943433    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-rqf2r" event={"ID":"3be84f98-dc70-4ce7-afeb-7aa5d85bb4cd","Type":"ContainerStarted","Data":"8bc947151cc1ab85671328925cc419f911130648930008efd2c1f5f5037de20f"}
Jul 28 17:13:51.943863 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:51.943515    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-rqf2r"
Jul 28 17:13:51.972400 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:13:51.972358    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-rqf2r" podStartSLOduration=1.972345654 podStartE2EDuration="1.972345654s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:13:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:13:51.971569745 +0000 UTC m=+1421.442983406" watchObservedRunningTime="2026-07-28 17:13:51.972345654 +0000 UTC m=+1421.443759351"
Jul 28 17:14:02.949626 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:02.949547    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-7495bcd-rqf2r"
Jul 28 17:14:06.509089 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:06.509057    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:14:07.108599 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:07.108565    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:14:07.210694 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:07.210657    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:14:09.544779 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:09.544744    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:14:09.644255 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:09.644222    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:14:09.696372 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:09.696345    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg"]
Jul 28 17:14:09.699660 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:09.699641    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg"
Jul 28 17:14:09.703311 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:09.703293    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Jul 28 17:14:09.703429 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:09.703337    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Jul 28 17:14:09.703496 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:09.703482    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Jul 28 17:14:09.704196 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:09.704176    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-5wgfm\""
Jul 28 17:14:09.704196 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:09.704187    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Jul 28 17:14:09.704369 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:09.704186    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Jul 28 17:14:09.704369 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:09.704178    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Jul 28 17:14:09.719630 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:09.719605    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg"]
Jul 28 17:14:09.728928 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:09.728889    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:14:09.829229 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:09.829144    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:14:09.850248 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:09.850225    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-8bsqg\" (UID: \"279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg"
Jul 28 17:14:09.850382 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:09.850265    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-8bsqg\" (UID: \"279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg"
Jul 28 17:14:09.850382 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:09.850325    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-8bsqg\" (UID: \"279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg"
Jul 28 17:14:09.850479 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:09.850390    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-8bsqg\" (UID: \"279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg"
Jul 28 17:14:09.850479 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:09.850414    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-8bsqg\" (UID: \"279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg"
Jul 28 17:14:09.850479 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:09.850431    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-25fq2\" (UniqueName: \"kubernetes.io/projected/279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f-kube-api-access-25fq2\") pod \"feast-simple-feast-setup-777d6cc998-8bsqg\" (UID: \"279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg"
Jul 28 17:14:09.928452 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:09.928425    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:14:09.950872 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:09.950846    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-8bsqg\" (UID: \"279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg"
Jul 28 17:14:09.950994 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:09.950875    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-25fq2\" (UniqueName: \"kubernetes.io/projected/279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f-kube-api-access-25fq2\") pod \"feast-simple-feast-setup-777d6cc998-8bsqg\" (UID: \"279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg"
Jul 28 17:14:09.950994 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:09.950913    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-8bsqg\" (UID: \"279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg"
Jul 28 17:14:09.951087 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:09.950994    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-8bsqg\" (UID: \"279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg"
Jul 28 17:14:09.951087 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:09.951051    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-8bsqg\" (UID: \"279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg"
Jul 28 17:14:09.951087 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:09.951072    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-8bsqg\" (UID: \"279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg"
Jul 28 17:14:09.951246 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:09.951226    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-8bsqg\" (UID: \"279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg"
Jul 28 17:14:09.953852 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:09.953832    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-8bsqg\" (UID: \"279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg"
Jul 28 17:14:09.954014 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:09.953996    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-8bsqg\" (UID: \"279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg"
Jul 28 17:14:09.954085 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:09.954009    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-8bsqg\" (UID: \"279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg"
Jul 28 17:14:09.954085 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:09.954009    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-8bsqg\" (UID: \"279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg"
Jul 28 17:14:09.963135 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:09.963117    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-25fq2\" (UniqueName: \"kubernetes.io/projected/279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f-kube-api-access-25fq2\") pod \"feast-simple-feast-setup-777d6cc998-8bsqg\" (UID: \"279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg"
Jul 28 17:14:10.021431 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:10.021406    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg"
Jul 28 17:14:10.029571 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:10.029515    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:14:10.159636 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:10.159478    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg"]
Jul 28 17:14:10.162207 ip-10-0-128-92 kubenswrapper[2561]: W0728 17:14:10.162181    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod279a7ccd_97d0_4e3c_b6d5_20bcacd08a9f.slice/crio-35c13f49ebff3156a3ecfdd75cc00973ab184869bf8a1af116d6696d806b0f87 WatchSource:0}: Error finding container 35c13f49ebff3156a3ecfdd75cc00973ab184869bf8a1af116d6696d806b0f87: Status 404 returned error can't find the container with id 35c13f49ebff3156a3ecfdd75cc00973ab184869bf8a1af116d6696d806b0f87
Jul 28 17:14:11.017185 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:11.017137    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg" event={"ID":"279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f","Type":"ContainerStarted","Data":"a663a1c598999afeb344d58f5f3c6bfb43e266aab6c796d11d3ee5ce0afc3a4c"}
Jul 28 17:14:11.017652 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:11.017194    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg" event={"ID":"279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f","Type":"ContainerStarted","Data":"35c13f49ebff3156a3ecfdd75cc00973ab184869bf8a1af116d6696d806b0f87"}
Jul 28 17:14:15.035694 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:15.035660    2561 generic.go:356] "Generic (PLEG): container finished" podID="279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f" containerID="a663a1c598999afeb344d58f5f3c6bfb43e266aab6c796d11d3ee5ce0afc3a4c" exitCode=0
Jul 28 17:14:15.036142 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:15.035722    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg" event={"ID":"279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f","Type":"ContainerDied","Data":"a663a1c598999afeb344d58f5f3c6bfb43e266aab6c796d11d3ee5ce0afc3a4c"}
Jul 28 17:14:16.041105 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:16.041064    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg" event={"ID":"279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f","Type":"ContainerStarted","Data":"aa52ffa933559d7ed5aaf77536b9b765b02320fcb44508ae7893997aa518dc62"}
Jul 28 17:14:21.062679 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:21.062647    2561 generic.go:356] "Generic (PLEG): container finished" podID="279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f" containerID="aa52ffa933559d7ed5aaf77536b9b765b02320fcb44508ae7893997aa518dc62" exitCode=0
Jul 28 17:14:21.063095 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:21.062728    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg" event={"ID":"279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f","Type":"ContainerDied","Data":"aa52ffa933559d7ed5aaf77536b9b765b02320fcb44508ae7893997aa518dc62"}
Jul 28 17:14:22.072871 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:22.072825    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg" event={"ID":"279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f","Type":"ContainerStarted","Data":"eb5ff5fb0bda24ee8533fa039bb24a1cc621f47065c013be9c96d82b5a10caf4"}
Jul 28 17:14:22.073369 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:22.072889    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg" event={"ID":"279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f","Type":"ContainerStarted","Data":"8ccea4c54b514f0d4328d297c41f9a9af8fadcac1463ada3705bc52712aaf71f"}
Jul 28 17:14:22.073369 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:22.072911    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg" event={"ID":"279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f","Type":"ContainerStarted","Data":"248421e8826d9a03d1c88da1c9455890ff3f8ed84a9b007e712e47c8b8c819be"}
Jul 28 17:14:22.073369 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:22.072952    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg" event={"ID":"279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f","Type":"ContainerStarted","Data":"00f6f4008a4debcd976a187b8a3372241a1f2d9d82fbcf4840a5b66db25b662a"}
Jul 28 17:14:22.117280 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:22.117201    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg" podStartSLOduration=13.117177845 podStartE2EDuration="13.117177845s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:14:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:14:22.116278428 +0000 UTC m=+1451.587692089" watchObservedRunningTime="2026-07-28 17:14:22.117177845 +0000 UTC m=+1451.588591506"
Jul 28 17:14:25.022060 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:25.022023    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg"
Jul 28 17:14:25.022558 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:25.022200    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg"
Jul 28 17:14:25.022558 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:25.022267    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg"
Jul 28 17:14:25.022680 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:25.022594    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg"
Jul 28 17:14:25.024525 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:25.024466    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg" podUID="279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.36:8816: connect: connection refused"
Jul 28 17:14:25.024525 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:25.024514    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg" podUID="279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.36:6571: connect: connection refused"
Jul 28 17:14:25.024743 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:25.024532    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg" podUID="279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f" containerName="online" probeResult="failure" output="Get \"https://10.134.0.36:6567/health\": dial tcp 10.134.0.36:6567: connect: connection refused"
Jul 28 17:14:25.024743 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:25.024625    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg" podUID="279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.36:8443: connect: connection refused"
Jul 28 17:14:28.023599 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:28.023574    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg"
Jul 28 17:14:28.024014 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:28.023695    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg"
Jul 28 17:14:28.024014 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:28.023880    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg"
Jul 28 17:14:28.024260 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:28.024235    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg"
Jul 28 17:14:28.024395 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:28.024280    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg"
Jul 28 17:14:28.024395 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:28.024302    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg"
Jul 28 17:14:28.024514 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:28.024494    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg"
Jul 28 17:14:28.024848 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:28.024832    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg"
Jul 28 17:14:28.024957 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:28.024879    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg"
Jul 28 17:14:28.028600 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:28.028583    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg"
Jul 28 17:14:28.103889 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:28.103861    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg"
Jul 28 17:14:28.108568 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:14:28.108541    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg"
Jul 28 17:15:13.213629 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:13.213595    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:15:29.072002 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:29.071962    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:15:29.090835 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:29.090802    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg"]
Jul 28 17:15:29.091237 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:29.091032    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg" podUID="279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f" containerName="registry" containerID="cri-o://00f6f4008a4debcd976a187b8a3372241a1f2d9d82fbcf4840a5b66db25b662a" gracePeriod=30
Jul 28 17:15:29.091237 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:29.091081    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg" podUID="279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f" containerName="offline" containerID="cri-o://8ccea4c54b514f0d4328d297c41f9a9af8fadcac1463ada3705bc52712aaf71f" gracePeriod=30
Jul 28 17:15:29.091237 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:29.091128    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg" podUID="279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f" containerName="ui" containerID="cri-o://eb5ff5fb0bda24ee8533fa039bb24a1cc621f47065c013be9c96d82b5a10caf4" gracePeriod=30
Jul 28 17:15:29.091237 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:29.091115    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg" podUID="279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f" containerName="online" containerID="cri-o://248421e8826d9a03d1c88da1c9455890ff3f8ed84a9b007e712e47c8b8c819be" gracePeriod=30
Jul 28 17:15:29.175516 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:29.175482    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:15:29.310657 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:29.310621    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:15:29.406506 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:29.406419    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:15:29.548375 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:29.548335    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh"]
Jul 28 17:15:29.552427 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:29.552402    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh"
Jul 28 17:15:29.555720 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:29.555695    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-9r7ts\""
Jul 28 17:15:29.568884 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:29.568856    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh"]
Jul 28 17:15:29.688693 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:29.688607    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5bbb01e0-2001-45ac-af47-24854d7079c4-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-xx2mh\" (UID: \"5bbb01e0-2001-45ac-af47-24854d7079c4\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh"
Jul 28 17:15:29.688693 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:29.688653    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5bbb01e0-2001-45ac-af47-24854d7079c4-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-xx2mh\" (UID: \"5bbb01e0-2001-45ac-af47-24854d7079c4\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh"
Jul 28 17:15:29.688693 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:29.688686    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5bbb01e0-2001-45ac-af47-24854d7079c4-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-xx2mh\" (UID: \"5bbb01e0-2001-45ac-af47-24854d7079c4\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh"
Jul 28 17:15:29.688964 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:29.688734    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5bbb01e0-2001-45ac-af47-24854d7079c4-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-xx2mh\" (UID: \"5bbb01e0-2001-45ac-af47-24854d7079c4\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh"
Jul 28 17:15:29.688964 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:29.688771    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5bbb01e0-2001-45ac-af47-24854d7079c4-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-xx2mh\" (UID: \"5bbb01e0-2001-45ac-af47-24854d7079c4\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh"
Jul 28 17:15:29.688964 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:29.688793    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vzm9j\" (UniqueName: \"kubernetes.io/projected/5bbb01e0-2001-45ac-af47-24854d7079c4-kube-api-access-vzm9j\") pod \"feast-simple-feast-setup-777d6cc998-xx2mh\" (UID: \"5bbb01e0-2001-45ac-af47-24854d7079c4\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh"
Jul 28 17:15:29.709039 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:29.709004    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:15:29.790079 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:29.790046    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5bbb01e0-2001-45ac-af47-24854d7079c4-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-xx2mh\" (UID: \"5bbb01e0-2001-45ac-af47-24854d7079c4\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh"
Jul 28 17:15:29.790233 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:29.790086    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5bbb01e0-2001-45ac-af47-24854d7079c4-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-xx2mh\" (UID: \"5bbb01e0-2001-45ac-af47-24854d7079c4\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh"
Jul 28 17:15:29.790233 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:29.790116    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5bbb01e0-2001-45ac-af47-24854d7079c4-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-xx2mh\" (UID: \"5bbb01e0-2001-45ac-af47-24854d7079c4\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh"
Jul 28 17:15:29.790233 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:29.790215    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vzm9j\" (UniqueName: \"kubernetes.io/projected/5bbb01e0-2001-45ac-af47-24854d7079c4-kube-api-access-vzm9j\") pod \"feast-simple-feast-setup-777d6cc998-xx2mh\" (UID: \"5bbb01e0-2001-45ac-af47-24854d7079c4\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh"
Jul 28 17:15:29.790405 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:29.790246    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5bbb01e0-2001-45ac-af47-24854d7079c4-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-xx2mh\" (UID: \"5bbb01e0-2001-45ac-af47-24854d7079c4\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh"
Jul 28 17:15:29.790405 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:29.790278    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5bbb01e0-2001-45ac-af47-24854d7079c4-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-xx2mh\" (UID: \"5bbb01e0-2001-45ac-af47-24854d7079c4\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh"
Jul 28 17:15:29.790405 ip-10-0-128-92 kubenswrapper[2561]: E0728 17:15:29.790382    2561 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Jul 28 17:15:29.790573 ip-10-0-128-92 kubenswrapper[2561]: E0728 17:15:29.790466    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5bbb01e0-2001-45ac-af47-24854d7079c4-ui-tls podName:5bbb01e0-2001-45ac-af47-24854d7079c4 nodeName:}" failed. No retries permitted until 2026-07-28 17:15:30.290441572 +0000 UTC m=+1519.761855231 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/5bbb01e0-2001-45ac-af47-24854d7079c4-ui-tls") pod "feast-simple-feast-setup-777d6cc998-xx2mh" (UID: "5bbb01e0-2001-45ac-af47-24854d7079c4") : secret "feast-simple-feast-setup-ui-tls" not found
Jul 28 17:15:29.790687 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:29.790655    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5bbb01e0-2001-45ac-af47-24854d7079c4-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-xx2mh\" (UID: \"5bbb01e0-2001-45ac-af47-24854d7079c4\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh"
Jul 28 17:15:29.792614 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:29.792586    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5bbb01e0-2001-45ac-af47-24854d7079c4-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-xx2mh\" (UID: \"5bbb01e0-2001-45ac-af47-24854d7079c4\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh"
Jul 28 17:15:29.792701 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:29.792668    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5bbb01e0-2001-45ac-af47-24854d7079c4-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-xx2mh\" (UID: \"5bbb01e0-2001-45ac-af47-24854d7079c4\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh"
Jul 28 17:15:29.792701 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:29.792687    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5bbb01e0-2001-45ac-af47-24854d7079c4-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-xx2mh\" (UID: \"5bbb01e0-2001-45ac-af47-24854d7079c4\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh"
Jul 28 17:15:29.801083 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:29.801052    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vzm9j\" (UniqueName: \"kubernetes.io/projected/5bbb01e0-2001-45ac-af47-24854d7079c4-kube-api-access-vzm9j\") pod \"feast-simple-feast-setup-777d6cc998-xx2mh\" (UID: \"5bbb01e0-2001-45ac-af47-24854d7079c4\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh"
Jul 28 17:15:29.810224 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:29.810203    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:15:30.103532 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:30.103493    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:15:30.294195 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:30.294166    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5bbb01e0-2001-45ac-af47-24854d7079c4-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-xx2mh\" (UID: \"5bbb01e0-2001-45ac-af47-24854d7079c4\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh"
Jul 28 17:15:30.296736 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:30.296705    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5bbb01e0-2001-45ac-af47-24854d7079c4-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-xx2mh\" (UID: \"5bbb01e0-2001-45ac-af47-24854d7079c4\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh"
Jul 28 17:15:30.337742 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:30.337715    2561 generic.go:356] "Generic (PLEG): container finished" podID="279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f" containerID="eb5ff5fb0bda24ee8533fa039bb24a1cc621f47065c013be9c96d82b5a10caf4" exitCode=0
Jul 28 17:15:30.337742 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:30.337738    2561 generic.go:356] "Generic (PLEG): container finished" podID="279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f" containerID="248421e8826d9a03d1c88da1c9455890ff3f8ed84a9b007e712e47c8b8c819be" exitCode=0
Jul 28 17:15:30.337925 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:30.337780    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg" event={"ID":"279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f","Type":"ContainerDied","Data":"eb5ff5fb0bda24ee8533fa039bb24a1cc621f47065c013be9c96d82b5a10caf4"}
Jul 28 17:15:30.337925 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:30.337821    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg" event={"ID":"279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f","Type":"ContainerDied","Data":"248421e8826d9a03d1c88da1c9455890ff3f8ed84a9b007e712e47c8b8c819be"}
Jul 28 17:15:30.462217 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:30.462139    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh"
Jul 28 17:15:30.597640 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:30.597614    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh"]
Jul 28 17:15:30.599694 ip-10-0-128-92 kubenswrapper[2561]: W0728 17:15:30.599668    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5bbb01e0_2001_45ac_af47_24854d7079c4.slice/crio-37a32bf63a59596c353495f8b475e928bd4a69cbcefb49e6bd0df2e154f8c0a5 WatchSource:0}: Error finding container 37a32bf63a59596c353495f8b475e928bd4a69cbcefb49e6bd0df2e154f8c0a5: Status 404 returned error can't find the container with id 37a32bf63a59596c353495f8b475e928bd4a69cbcefb49e6bd0df2e154f8c0a5
Jul 28 17:15:31.343102 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:31.343066    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh" event={"ID":"5bbb01e0-2001-45ac-af47-24854d7079c4","Type":"ContainerStarted","Data":"eb3617715321562c1ee5335f368869af7f3dca8c184e0cb3e8df7c671207a12c"}
Jul 28 17:15:31.345417 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:31.343115    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh" event={"ID":"5bbb01e0-2001-45ac-af47-24854d7079c4","Type":"ContainerStarted","Data":"37a32bf63a59596c353495f8b475e928bd4a69cbcefb49e6bd0df2e154f8c0a5"}
Jul 28 17:15:35.359900 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:35.359868    2561 generic.go:356] "Generic (PLEG): container finished" podID="5bbb01e0-2001-45ac-af47-24854d7079c4" containerID="eb3617715321562c1ee5335f368869af7f3dca8c184e0cb3e8df7c671207a12c" exitCode=0
Jul 28 17:15:35.360260 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:35.359965    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh" event={"ID":"5bbb01e0-2001-45ac-af47-24854d7079c4","Type":"ContainerDied","Data":"eb3617715321562c1ee5335f368869af7f3dca8c184e0cb3e8df7c671207a12c"}
Jul 28 17:15:36.365509 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:36.365471    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh" event={"ID":"5bbb01e0-2001-45ac-af47-24854d7079c4","Type":"ContainerStarted","Data":"e5f9d11f2ccecfcac91b09f740f37fe41df04090dd06ad6136b30a643c0ffc15"}
Jul 28 17:15:38.025192 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:38.025135    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg" podUID="279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.36:8443: connect: connection refused"
Jul 28 17:15:38.104993 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:38.104922    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg" podUID="279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f" containerName="online" probeResult="failure" output="Get \"https://10.134.0.36:6567/health\": dial tcp 10.134.0.36:6567: connect: connection refused"
Jul 28 17:15:41.385101 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:41.385061    2561 generic.go:356] "Generic (PLEG): container finished" podID="5bbb01e0-2001-45ac-af47-24854d7079c4" containerID="e5f9d11f2ccecfcac91b09f740f37fe41df04090dd06ad6136b30a643c0ffc15" exitCode=0
Jul 28 17:15:41.385528 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:41.385133    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh" event={"ID":"5bbb01e0-2001-45ac-af47-24854d7079c4","Type":"ContainerDied","Data":"e5f9d11f2ccecfcac91b09f740f37fe41df04090dd06ad6136b30a643c0ffc15"}
Jul 28 17:15:42.395737 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:42.395696    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh" event={"ID":"5bbb01e0-2001-45ac-af47-24854d7079c4","Type":"ContainerStarted","Data":"28583672aae5690f0186303bf723b27145478018dbefda86ff42385871556cc7"}
Jul 28 17:15:42.396248 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:42.395758    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh" event={"ID":"5bbb01e0-2001-45ac-af47-24854d7079c4","Type":"ContainerStarted","Data":"ff69803e033729445956add10103d747cb912ea329e36c7f8a3ccdc17f271c7b"}
Jul 28 17:15:42.396248 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:42.395779    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh" event={"ID":"5bbb01e0-2001-45ac-af47-24854d7079c4","Type":"ContainerStarted","Data":"665d0dd6924aab67e8ca5c37b0406a1ec728abd856d1fc5660806a5ae75f82e4"}
Jul 28 17:15:42.396248 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:42.395795    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh" event={"ID":"5bbb01e0-2001-45ac-af47-24854d7079c4","Type":"ContainerStarted","Data":"557c7cae4f512575fdcdc483ffc39f757d0e58e69fbcf49215f000c9f4424e3b"}
Jul 28 17:15:42.438522 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:42.438459    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh" podStartSLOduration=13.438436354 podStartE2EDuration="13.438436354s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:15:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:15:42.43803782 +0000 UTC m=+1531.909451485" watchObservedRunningTime="2026-07-28 17:15:42.438436354 +0000 UTC m=+1531.909850016"
Jul 28 17:15:42.463247 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:42.463140    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh"
Jul 28 17:15:42.463437 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:42.463249    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh"
Jul 28 17:15:42.463437 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:42.463280    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh"
Jul 28 17:15:42.463437 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:42.463300    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh"
Jul 28 17:15:42.465120 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:42.465076    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh" podUID="5bbb01e0-2001-45ac-af47-24854d7079c4" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.37:6571: connect: connection refused"
Jul 28 17:15:42.465120 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:42.465104    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh" podUID="5bbb01e0-2001-45ac-af47-24854d7079c4" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.37:8816: connect: connection refused"
Jul 28 17:15:42.465349 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:42.465104    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh" podUID="5bbb01e0-2001-45ac-af47-24854d7079c4" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.37:8443: connect: connection refused"
Jul 28 17:15:42.465349 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:42.465213    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh" podUID="5bbb01e0-2001-45ac-af47-24854d7079c4" containerName="online" probeResult="failure" output="Get \"https://10.134.0.37:6567/health\": dial tcp 10.134.0.37:6567: connect: connection refused"
Jul 28 17:15:45.463370 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:45.463319    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh" podUID="5bbb01e0-2001-45ac-af47-24854d7079c4" containerName="registry" probeResult="failure" output="dial tcp 10.134.0.37:6571: connect: connection refused"
Jul 28 17:15:45.463887 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:45.463321    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh" podUID="5bbb01e0-2001-45ac-af47-24854d7079c4" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.37:8816: connect: connection refused"
Jul 28 17:15:45.463887 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:45.463322    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh" podUID="5bbb01e0-2001-45ac-af47-24854d7079c4" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.37:8443: connect: connection refused"
Jul 28 17:15:45.463887 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:45.463460    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh" podUID="5bbb01e0-2001-45ac-af47-24854d7079c4" containerName="online" probeResult="failure" output="Get \"https://10.134.0.37:6567/health\": dial tcp 10.134.0.37:6567: connect: connection refused"
Jul 28 17:15:48.025017 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:48.024979    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg" podUID="279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.36:8443: connect: connection refused"
Jul 28 17:15:48.104838 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:48.104791    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg" podUID="279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f" containerName="online" probeResult="failure" output="Get \"https://10.134.0.36:6567/health\": dial tcp 10.134.0.36:6567: connect: connection refused"
Jul 28 17:15:48.463315 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:48.463225    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh"
Jul 28 17:15:48.463496 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:48.463356    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh"
Jul 28 17:15:48.463730 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:48.463712    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh"
Jul 28 17:15:48.463804 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:48.463745    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh"
Jul 28 17:15:48.463804 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:48.463757    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh"
Jul 28 17:15:48.463804 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:48.463767    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh"
Jul 28 17:15:48.464067 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:48.464046    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh"
Jul 28 17:15:48.464141 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:48.464112    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh"
Jul 28 17:15:48.464198 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:48.464144    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh"
Jul 28 17:15:48.468368 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:48.468354    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh"
Jul 28 17:15:49.429732 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:49.429687    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh"
Jul 28 17:15:49.432965 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:49.432927    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh"
Jul 28 17:15:58.024897 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:58.024848    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg" podUID="279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.36:8443: connect: connection refused"
Jul 28 17:15:58.025380 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:58.025041    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg"
Jul 28 17:15:58.104728 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:58.104690    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg" podUID="279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f" containerName="online" probeResult="failure" output="Get \"https://10.134.0.36:6567/health\": dial tcp 10.134.0.36:6567: connect: connection refused"
Jul 28 17:15:58.104896 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:58.104779    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg"
Jul 28 17:15:59.467730 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:59.467643    2561 generic.go:356] "Generic (PLEG): container finished" podID="279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f" containerID="8ccea4c54b514f0d4328d297c41f9a9af8fadcac1463ada3705bc52712aaf71f" exitCode=137
Jul 28 17:15:59.467730 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:59.467669    2561 generic.go:356] "Generic (PLEG): container finished" podID="279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f" containerID="00f6f4008a4debcd976a187b8a3372241a1f2d9d82fbcf4840a5b66db25b662a" exitCode=137
Jul 28 17:15:59.467730 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:59.467711    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg" event={"ID":"279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f","Type":"ContainerDied","Data":"8ccea4c54b514f0d4328d297c41f9a9af8fadcac1463ada3705bc52712aaf71f"}
Jul 28 17:15:59.468162 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:59.467753    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg" event={"ID":"279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f","Type":"ContainerDied","Data":"00f6f4008a4debcd976a187b8a3372241a1f2d9d82fbcf4840a5b66db25b662a"}
Jul 28 17:15:59.743832 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:59.743812    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg"
Jul 28 17:15:59.839254 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:59.839225    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f-ui-tls\") pod \"279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f\" (UID: \"279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f\") "
Jul 28 17:15:59.839397 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:59.839283    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-25fq2\" (UniqueName: \"kubernetes.io/projected/279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f-kube-api-access-25fq2\") pod \"279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f\" (UID: \"279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f\") "
Jul 28 17:15:59.839397 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:59.839311    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f-offline-tls\") pod \"279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f\" (UID: \"279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f\") "
Jul 28 17:15:59.839488 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:59.839412    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f-online-tls\") pod \"279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f\" (UID: \"279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f\") "
Jul 28 17:15:59.839488 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:59.839450    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f-feast-data\") pod \"279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f\" (UID: \"279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f\") "
Jul 28 17:15:59.839488 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:59.839469    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f-registry-tls\") pod \"279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f\" (UID: \"279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f\") "
Jul 28 17:15:59.840223 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:59.840176    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f-feast-data" (OuterVolumeSpecName: "feast-data") pod "279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f" (UID: "279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:15:59.841730 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:59.841700    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f-online-tls" (OuterVolumeSpecName: "online-tls") pod "279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f" (UID: "279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:15:59.841730 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:59.841717    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f" (UID: "279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:15:59.841869 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:59.841745    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f" (UID: "279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:15:59.841977 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:59.841918    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f-kube-api-access-25fq2" (OuterVolumeSpecName: "kube-api-access-25fq2") pod "279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f" (UID: "279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f"). InnerVolumeSpecName "kube-api-access-25fq2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:15:59.841977 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:59.841928    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f" (UID: "279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:15:59.940267 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:59.940246    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f-registry-tls\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:15:59.940267 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:59.940265    2561 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f-ui-tls\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:15:59.940411 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:59.940274    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-25fq2\" (UniqueName: \"kubernetes.io/projected/279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f-kube-api-access-25fq2\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:15:59.940411 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:59.940281    2561 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f-offline-tls\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:15:59.940411 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:59.940290    2561 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f-online-tls\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:15:59.940411 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:15:59.940297    2561 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f-feast-data\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:16:00.474009 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:00.473974    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg" event={"ID":"279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f","Type":"ContainerDied","Data":"35c13f49ebff3156a3ecfdd75cc00973ab184869bf8a1af116d6696d806b0f87"}
Jul 28 17:16:00.474009 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:00.474019    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg"
Jul 28 17:16:00.474009 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:00.474030    2561 scope.go:117] "RemoveContainer" containerID="eb5ff5fb0bda24ee8533fa039bb24a1cc621f47065c013be9c96d82b5a10caf4"
Jul 28 17:16:00.483106 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:00.483091    2561 scope.go:117] "RemoveContainer" containerID="8ccea4c54b514f0d4328d297c41f9a9af8fadcac1463ada3705bc52712aaf71f"
Jul 28 17:16:00.490574 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:00.490558    2561 scope.go:117] "RemoveContainer" containerID="248421e8826d9a03d1c88da1c9455890ff3f8ed84a9b007e712e47c8b8c819be"
Jul 28 17:16:00.498231 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:00.498214    2561 scope.go:117] "RemoveContainer" containerID="00f6f4008a4debcd976a187b8a3372241a1f2d9d82fbcf4840a5b66db25b662a"
Jul 28 17:16:00.499124 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:00.499105    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg"]
Jul 28 17:16:00.503641 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:00.503618    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-8bsqg"]
Jul 28 17:16:00.507513 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:00.507490    2561 scope.go:117] "RemoveContainer" containerID="aa52ffa933559d7ed5aaf77536b9b765b02320fcb44508ae7893997aa518dc62"
Jul 28 17:16:00.514827 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:00.514813    2561 scope.go:117] "RemoveContainer" containerID="a663a1c598999afeb344d58f5f3c6bfb43e266aab6c796d11d3ee5ce0afc3a4c"
Jul 28 17:16:01.075257 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:01.075221    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f" path="/var/lib/kubelet/pods/279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f/volumes"
Jul 28 17:16:50.635682 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:50.635628    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:16:51.181401 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:51.181356    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5"]
Jul 28 17:16:51.181667 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:51.181653    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f" containerName="registry"
Jul 28 17:16:51.181718 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:51.181670    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f" containerName="registry"
Jul 28 17:16:51.181718 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:51.181682    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f" containerName="ui"
Jul 28 17:16:51.181718 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:51.181687    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f" containerName="ui"
Jul 28 17:16:51.181718 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:51.181694    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f" containerName="online"
Jul 28 17:16:51.181718 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:51.181699    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f" containerName="online"
Jul 28 17:16:51.181718 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:51.181708    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f" containerName="feast-apply"
Jul 28 17:16:51.181718 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:51.181713    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f" containerName="feast-apply"
Jul 28 17:16:51.181971 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:51.181724    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f" containerName="feast-init"
Jul 28 17:16:51.181971 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:51.181729    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f" containerName="feast-init"
Jul 28 17:16:51.181971 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:51.181737    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f" containerName="offline"
Jul 28 17:16:51.181971 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:51.181741    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f" containerName="offline"
Jul 28 17:16:51.181971 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:51.181801    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f" containerName="ui"
Jul 28 17:16:51.181971 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:51.181810    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f" containerName="offline"
Jul 28 17:16:51.181971 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:51.181817    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f" containerName="registry"
Jul 28 17:16:51.181971 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:51.181823    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="279a7ccd-97d0-4e3c-b6d5-20bcacd08a9f" containerName="online"
Jul 28 17:16:51.185072 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:51.185056    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5"
Jul 28 17:16:51.188270 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:51.188247    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Jul 28 17:16:51.188496 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:51.188475    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Jul 28 17:16:51.188627 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:51.188519    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-m22pv\""
Jul 28 17:16:51.188627 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:51.188542    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Jul 28 17:16:51.188779 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:51.188764    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Jul 28 17:16:51.189353 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:51.189338    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Jul 28 17:16:51.189997 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:51.189981    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Jul 28 17:16:51.206643 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:51.206621    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5"]
Jul 28 17:16:51.236256 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:51.236221    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj9th\" (UniqueName: \"kubernetes.io/projected/d99e0862-2175-4c2f-8198-5b782ced8450-kube-api-access-cj9th\") pod \"feast-simple-feast-remote-setup-db6955c6c-tg6z5\" (UID: \"d99e0862-2175-4c2f-8198-5b782ced8450\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5"
Jul 28 17:16:51.236428 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:51.236268    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d99e0862-2175-4c2f-8198-5b782ced8450-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-tg6z5\" (UID: \"d99e0862-2175-4c2f-8198-5b782ced8450\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5"
Jul 28 17:16:51.236428 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:51.236348    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d99e0862-2175-4c2f-8198-5b782ced8450-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-tg6z5\" (UID: \"d99e0862-2175-4c2f-8198-5b782ced8450\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5"
Jul 28 17:16:51.236428 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:51.236368    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/d99e0862-2175-4c2f-8198-5b782ced8450-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-tg6z5\" (UID: \"d99e0862-2175-4c2f-8198-5b782ced8450\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5"
Jul 28 17:16:51.236428 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:51.236396    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d99e0862-2175-4c2f-8198-5b782ced8450-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-tg6z5\" (UID: \"d99e0862-2175-4c2f-8198-5b782ced8450\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5"
Jul 28 17:16:51.236571 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:51.236432    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d99e0862-2175-4c2f-8198-5b782ced8450-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-tg6z5\" (UID: \"d99e0862-2175-4c2f-8198-5b782ced8450\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5"
Jul 28 17:16:51.337468 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:51.337431    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj9th\" (UniqueName: \"kubernetes.io/projected/d99e0862-2175-4c2f-8198-5b782ced8450-kube-api-access-cj9th\") pod \"feast-simple-feast-remote-setup-db6955c6c-tg6z5\" (UID: \"d99e0862-2175-4c2f-8198-5b782ced8450\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5"
Jul 28 17:16:51.337468 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:51.337475    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d99e0862-2175-4c2f-8198-5b782ced8450-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-tg6z5\" (UID: \"d99e0862-2175-4c2f-8198-5b782ced8450\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5"
Jul 28 17:16:51.337745 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:51.337506    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d99e0862-2175-4c2f-8198-5b782ced8450-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-tg6z5\" (UID: \"d99e0862-2175-4c2f-8198-5b782ced8450\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5"
Jul 28 17:16:51.337745 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:51.337536    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/d99e0862-2175-4c2f-8198-5b782ced8450-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-tg6z5\" (UID: \"d99e0862-2175-4c2f-8198-5b782ced8450\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5"
Jul 28 17:16:51.337745 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:51.337574    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d99e0862-2175-4c2f-8198-5b782ced8450-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-tg6z5\" (UID: \"d99e0862-2175-4c2f-8198-5b782ced8450\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5"
Jul 28 17:16:51.337745 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:51.337597    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d99e0862-2175-4c2f-8198-5b782ced8450-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-tg6z5\" (UID: \"d99e0862-2175-4c2f-8198-5b782ced8450\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5"
Jul 28 17:16:51.337745 ip-10-0-128-92 kubenswrapper[2561]: E0728 17:16:51.337612    2561 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-ui-tls: secret "feast-simple-feast-remote-setup-ui-tls" not found
Jul 28 17:16:51.337745 ip-10-0-128-92 kubenswrapper[2561]: E0728 17:16:51.337689    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d99e0862-2175-4c2f-8198-5b782ced8450-ui-tls podName:d99e0862-2175-4c2f-8198-5b782ced8450 nodeName:}" failed. No retries permitted until 2026-07-28 17:16:51.837667596 +0000 UTC m=+1601.309081238 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/d99e0862-2175-4c2f-8198-5b782ced8450-ui-tls") pod "feast-simple-feast-remote-setup-db6955c6c-tg6z5" (UID: "d99e0862-2175-4c2f-8198-5b782ced8450") : secret "feast-simple-feast-remote-setup-ui-tls" not found
Jul 28 17:16:51.338077 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:51.337921    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d99e0862-2175-4c2f-8198-5b782ced8450-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-tg6z5\" (UID: \"d99e0862-2175-4c2f-8198-5b782ced8450\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5"
Jul 28 17:16:51.338269 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:51.338250    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/d99e0862-2175-4c2f-8198-5b782ced8450-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-tg6z5\" (UID: \"d99e0862-2175-4c2f-8198-5b782ced8450\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5"
Jul 28 17:16:51.340202 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:51.340180    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d99e0862-2175-4c2f-8198-5b782ced8450-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-tg6z5\" (UID: \"d99e0862-2175-4c2f-8198-5b782ced8450\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5"
Jul 28 17:16:51.340299 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:51.340223    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d99e0862-2175-4c2f-8198-5b782ced8450-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-tg6z5\" (UID: \"d99e0862-2175-4c2f-8198-5b782ced8450\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5"
Jul 28 17:16:51.359267 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:51.359238    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj9th\" (UniqueName: \"kubernetes.io/projected/d99e0862-2175-4c2f-8198-5b782ced8450-kube-api-access-cj9th\") pod \"feast-simple-feast-remote-setup-db6955c6c-tg6z5\" (UID: \"d99e0862-2175-4c2f-8198-5b782ced8450\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5"
Jul 28 17:16:51.842266 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:51.842232    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d99e0862-2175-4c2f-8198-5b782ced8450-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-tg6z5\" (UID: \"d99e0862-2175-4c2f-8198-5b782ced8450\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5"
Jul 28 17:16:51.844795 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:51.844769    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d99e0862-2175-4c2f-8198-5b782ced8450-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-tg6z5\" (UID: \"d99e0862-2175-4c2f-8198-5b782ced8450\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5"
Jul 28 17:16:52.096435 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:52.096347    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5"
Jul 28 17:16:52.169772 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:52.169738    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:16:52.239059 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:52.239035    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5"]
Jul 28 17:16:52.241483 ip-10-0-128-92 kubenswrapper[2561]: W0728 17:16:52.241451    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd99e0862_2175_4c2f_8198_5b782ced8450.slice/crio-6d4d6386f4dba6f7175d3352113a747439f0a10fb7f2b414c540a245c6108390 WatchSource:0}: Error finding container 6d4d6386f4dba6f7175d3352113a747439f0a10fb7f2b414c540a245c6108390: Status 404 returned error can't find the container with id 6d4d6386f4dba6f7175d3352113a747439f0a10fb7f2b414c540a245c6108390
Jul 28 17:16:52.665134 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:52.665097    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5" event={"ID":"d99e0862-2175-4c2f-8198-5b782ced8450","Type":"ContainerStarted","Data":"0f6b76a7b4bfc37d435c2d0a47686580ac816f01235968d6c3c77bfd209877d2"}
Jul 28 17:16:52.665134 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:52.665137    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5" event={"ID":"d99e0862-2175-4c2f-8198-5b782ced8450","Type":"ContainerStarted","Data":"6d4d6386f4dba6f7175d3352113a747439f0a10fb7f2b414c540a245c6108390"}
Jul 28 17:16:57.691144 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:57.691107    2561 generic.go:356] "Generic (PLEG): container finished" podID="d99e0862-2175-4c2f-8198-5b782ced8450" containerID="0f6b76a7b4bfc37d435c2d0a47686580ac816f01235968d6c3c77bfd209877d2" exitCode=0
Jul 28 17:16:57.691636 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:57.691155    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5" event={"ID":"d99e0862-2175-4c2f-8198-5b782ced8450","Type":"ContainerDied","Data":"0f6b76a7b4bfc37d435c2d0a47686580ac816f01235968d6c3c77bfd209877d2"}
Jul 28 17:16:58.697083 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:16:58.697050    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5" event={"ID":"d99e0862-2175-4c2f-8198-5b782ced8450","Type":"ContainerStarted","Data":"8b438e796cebefcfd7208e3b1f5aeb437be6a15f13057a9f750877694b39184a"}
Jul 28 17:17:03.719858 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:17:03.719826    2561 generic.go:356] "Generic (PLEG): container finished" podID="d99e0862-2175-4c2f-8198-5b782ced8450" containerID="8b438e796cebefcfd7208e3b1f5aeb437be6a15f13057a9f750877694b39184a" exitCode=0
Jul 28 17:17:03.720286 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:17:03.719890    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5" event={"ID":"d99e0862-2175-4c2f-8198-5b782ced8450","Type":"ContainerDied","Data":"8b438e796cebefcfd7208e3b1f5aeb437be6a15f13057a9f750877694b39184a"}
Jul 28 17:17:04.728896 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:17:04.728865    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5" event={"ID":"d99e0862-2175-4c2f-8198-5b782ced8450","Type":"ContainerStarted","Data":"7fe7bd6f2fd0bc3f8750262ac45937a470f8f44192e7e2b787358c5e474571b6"}
Jul 28 17:17:04.729415 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:17:04.728914    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5" event={"ID":"d99e0862-2175-4c2f-8198-5b782ced8450","Type":"ContainerStarted","Data":"1f5540919cdc570d6a21487a7bbdb68b826099b0830e423ddb4de027dd0f912e"}
Jul 28 17:17:04.729415 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:17:04.728952    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5" event={"ID":"d99e0862-2175-4c2f-8198-5b782ced8450","Type":"ContainerStarted","Data":"e48638c2e48511cc1c5a6f00f0518b2e997281158269457d5af1cff638547e5b"}
Jul 28 17:17:04.783582 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:17:04.783514    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5" podStartSLOduration=13.783492965 podStartE2EDuration="13.783492965s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:16:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:17:04.77870886 +0000 UTC m=+1614.250122547" watchObservedRunningTime="2026-07-28 17:17:04.783492965 +0000 UTC m=+1614.254906628"
Jul 28 17:17:07.097242 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:17:07.097202    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5"
Jul 28 17:17:07.097725 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:17:07.097261    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5"
Jul 28 17:17:07.097725 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:17:07.097280    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5"
Jul 28 17:17:07.098801 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:17:07.098760    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5" podUID="d99e0862-2175-4c2f-8198-5b782ced8450" containerName="offline" probeResult="failure" output="dial tcp 10.134.0.38:8816: connect: connection refused"
Jul 28 17:17:07.098801 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:17:07.098786    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5" podUID="d99e0862-2175-4c2f-8198-5b782ced8450" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.38:8443: connect: connection refused"
Jul 28 17:17:07.098990 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:17:07.098807    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5" podUID="d99e0862-2175-4c2f-8198-5b782ced8450" containerName="online" probeResult="failure" output="Get \"https://10.134.0.38:6567/health\": dial tcp 10.134.0.38:6567: connect: connection refused"
Jul 28 17:17:09.163566 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:17:09.163513    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:17:10.098149 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:17:10.098120    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5"
Jul 28 17:17:10.098351 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:17:10.098257    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5"
Jul 28 17:17:10.098770 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:17:10.098740    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5"
Jul 28 17:17:10.098894 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:17:10.098783    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5"
Jul 28 17:17:10.098992 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:17:10.098975    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5"
Jul 28 17:17:10.099081 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:17:10.099066    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5"
Jul 28 17:17:10.104721 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:17:10.104700    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5"
Jul 28 17:17:10.756450 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:17:10.756416    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5"
Jul 28 17:17:10.761000 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:17:10.760978    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5"
Jul 28 17:18:12.298873 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:12.298839    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:12.339805 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:12.339774    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5"]
Jul 28 17:18:12.340052 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:12.340009    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5" podUID="d99e0862-2175-4c2f-8198-5b782ced8450" containerName="online" containerID="cri-o://e48638c2e48511cc1c5a6f00f0518b2e997281158269457d5af1cff638547e5b" gracePeriod=30
Jul 28 17:18:12.340122 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:12.340084    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5" podUID="d99e0862-2175-4c2f-8198-5b782ced8450" containerName="ui" containerID="cri-o://7fe7bd6f2fd0bc3f8750262ac45937a470f8f44192e7e2b787358c5e474571b6" gracePeriod=30
Jul 28 17:18:12.340122 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:12.340083    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5" podUID="d99e0862-2175-4c2f-8198-5b782ced8450" containerName="offline" containerID="cri-o://1f5540919cdc570d6a21487a7bbdb68b826099b0830e423ddb4de027dd0f912e" gracePeriod=30
Jul 28 17:18:12.401825 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:12.401777    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:12.518761 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:12.518727    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh"]
Jul 28 17:18:12.519046 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:12.518997    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh" podUID="5bbb01e0-2001-45ac-af47-24854d7079c4" containerName="registry" containerID="cri-o://557c7cae4f512575fdcdc483ffc39f757d0e58e69fbcf49215f000c9f4424e3b" gracePeriod=30
Jul 28 17:18:12.519046 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:12.519029    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh" podUID="5bbb01e0-2001-45ac-af47-24854d7079c4" containerName="offline" containerID="cri-o://ff69803e033729445956add10103d747cb912ea329e36c7f8a3ccdc17f271c7b" gracePeriod=30
Jul 28 17:18:12.519272 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:12.519051    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh" podUID="5bbb01e0-2001-45ac-af47-24854d7079c4" containerName="online" containerID="cri-o://665d0dd6924aab67e8ca5c37b0406a1ec728abd856d1fc5660806a5ae75f82e4" gracePeriod=30
Jul 28 17:18:12.519272 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:12.519046    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh" podUID="5bbb01e0-2001-45ac-af47-24854d7079c4" containerName="ui" containerID="cri-o://28583672aae5690f0186303bf723b27145478018dbefda86ff42385871556cc7" gracePeriod=30
Jul 28 17:18:12.525382 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:12.525358    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:12.617670 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:12.617570    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:12.993342 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:12.993310    2561 generic.go:356] "Generic (PLEG): container finished" podID="d99e0862-2175-4c2f-8198-5b782ced8450" containerID="7fe7bd6f2fd0bc3f8750262ac45937a470f8f44192e7e2b787358c5e474571b6" exitCode=0
Jul 28 17:18:12.993574 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:12.993373    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5" event={"ID":"d99e0862-2175-4c2f-8198-5b782ced8450","Type":"ContainerDied","Data":"7fe7bd6f2fd0bc3f8750262ac45937a470f8f44192e7e2b787358c5e474571b6"}
Jul 28 17:18:13.999803 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:13.999769    2561 generic.go:356] "Generic (PLEG): container finished" podID="d99e0862-2175-4c2f-8198-5b782ced8450" containerID="e48638c2e48511cc1c5a6f00f0518b2e997281158269457d5af1cff638547e5b" exitCode=0
Jul 28 17:18:14.000281 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:13.999840    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5" event={"ID":"d99e0862-2175-4c2f-8198-5b782ced8450","Type":"ContainerDied","Data":"e48638c2e48511cc1c5a6f00f0518b2e997281158269457d5af1cff638547e5b"}
Jul 28 17:18:14.002619 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:14.002595    2561 generic.go:356] "Generic (PLEG): container finished" podID="5bbb01e0-2001-45ac-af47-24854d7079c4" containerID="28583672aae5690f0186303bf723b27145478018dbefda86ff42385871556cc7" exitCode=0
Jul 28 17:18:14.002619 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:14.002614    2561 generic.go:356] "Generic (PLEG): container finished" podID="5bbb01e0-2001-45ac-af47-24854d7079c4" containerID="665d0dd6924aab67e8ca5c37b0406a1ec728abd856d1fc5660806a5ae75f82e4" exitCode=0
Jul 28 17:18:14.002765 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:14.002661    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh" event={"ID":"5bbb01e0-2001-45ac-af47-24854d7079c4","Type":"ContainerDied","Data":"28583672aae5690f0186303bf723b27145478018dbefda86ff42385871556cc7"}
Jul 28 17:18:14.002765 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:14.002692    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh" event={"ID":"5bbb01e0-2001-45ac-af47-24854d7079c4","Type":"ContainerDied","Data":"665d0dd6924aab67e8ca5c37b0406a1ec728abd856d1fc5660806a5ae75f82e4"}
Jul 28 17:18:17.657795 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:17.657749    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:18.463980 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:18.463912    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh" podUID="5bbb01e0-2001-45ac-af47-24854d7079c4" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.37:8443: connect: connection refused"
Jul 28 17:18:19.430048 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:19.430011    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh" podUID="5bbb01e0-2001-45ac-af47-24854d7079c4" containerName="online" probeResult="failure" output="Get \"https://10.134.0.37:6567/health\": dial tcp 10.134.0.37:6567: connect: connection refused"
Jul 28 17:18:20.099565 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:20.099523    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5" podUID="d99e0862-2175-4c2f-8198-5b782ced8450" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.38:8443: connect: connection refused"
Jul 28 17:18:20.756655 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:20.756620    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5" podUID="d99e0862-2175-4c2f-8198-5b782ced8450" containerName="online" probeResult="failure" output="Get \"https://10.134.0.38:6567/health\": dial tcp 10.134.0.38:6567: connect: connection refused"
Jul 28 17:18:28.464356 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:28.464311    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh" podUID="5bbb01e0-2001-45ac-af47-24854d7079c4" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.37:8443: connect: connection refused"
Jul 28 17:18:29.430058 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:29.430013    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh" podUID="5bbb01e0-2001-45ac-af47-24854d7079c4" containerName="online" probeResult="failure" output="Get \"https://10.134.0.37:6567/health\": dial tcp 10.134.0.37:6567: connect: connection refused"
Jul 28 17:18:30.099121 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:30.099074    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5" podUID="d99e0862-2175-4c2f-8198-5b782ced8450" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.38:8443: connect: connection refused"
Jul 28 17:18:30.756674 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:30.756635    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5" podUID="d99e0862-2175-4c2f-8198-5b782ced8450" containerName="online" probeResult="failure" output="Get \"https://10.134.0.38:6567/health\": dial tcp 10.134.0.38:6567: connect: connection refused"
Jul 28 17:18:35.092675 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:35.092638    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:38.464377 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:38.464319    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh" podUID="5bbb01e0-2001-45ac-af47-24854d7079c4" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.37:8443: connect: connection refused"
Jul 28 17:18:38.464807 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:38.464484    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh"
Jul 28 17:18:39.430542 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:39.430497    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh" podUID="5bbb01e0-2001-45ac-af47-24854d7079c4" containerName="online" probeResult="failure" output="Get \"https://10.134.0.37:6567/health\": dial tcp 10.134.0.37:6567: connect: connection refused"
Jul 28 17:18:39.430715 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:39.430644    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh"
Jul 28 17:18:40.099219 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:40.099175    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5" podUID="d99e0862-2175-4c2f-8198-5b782ced8450" containerName="ui" probeResult="failure" output="dial tcp 10.134.0.38:8443: connect: connection refused"
Jul 28 17:18:40.099662 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:40.099306    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5"
Jul 28 17:18:40.756798 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:40.756755    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5" podUID="d99e0862-2175-4c2f-8198-5b782ced8450" containerName="online" probeResult="failure" output="Get \"https://10.134.0.38:6567/health\": dial tcp 10.134.0.38:6567: connect: connection refused"
Jul 28 17:18:40.757128 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:40.756878    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5"
Jul 28 17:18:42.995562 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:42.995534    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5"
Jul 28 17:18:43.112178 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.112102    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d99e0862-2175-4c2f-8198-5b782ced8450-online-tls\") pod \"d99e0862-2175-4c2f-8198-5b782ced8450\" (UID: \"d99e0862-2175-4c2f-8198-5b782ced8450\") "
Jul 28 17:18:43.112178 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.112152    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cj9th\" (UniqueName: \"kubernetes.io/projected/d99e0862-2175-4c2f-8198-5b782ced8450-kube-api-access-cj9th\") pod \"d99e0862-2175-4c2f-8198-5b782ced8450\" (UID: \"d99e0862-2175-4c2f-8198-5b782ced8450\") "
Jul 28 17:18:43.112382 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.112189    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d99e0862-2175-4c2f-8198-5b782ced8450-feast-data\") pod \"d99e0862-2175-4c2f-8198-5b782ced8450\" (UID: \"d99e0862-2175-4c2f-8198-5b782ced8450\") "
Jul 28 17:18:43.112382 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.112267    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d99e0862-2175-4c2f-8198-5b782ced8450-ui-tls\") pod \"d99e0862-2175-4c2f-8198-5b782ced8450\" (UID: \"d99e0862-2175-4c2f-8198-5b782ced8450\") "
Jul 28 17:18:43.112382 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.112293    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/d99e0862-2175-4c2f-8198-5b782ced8450-registry-tls\") pod \"d99e0862-2175-4c2f-8198-5b782ced8450\" (UID: \"d99e0862-2175-4c2f-8198-5b782ced8450\") "
Jul 28 17:18:43.112382 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.112340    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d99e0862-2175-4c2f-8198-5b782ced8450-offline-tls\") pod \"d99e0862-2175-4c2f-8198-5b782ced8450\" (UID: \"d99e0862-2175-4c2f-8198-5b782ced8450\") "
Jul 28 17:18:43.113513 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.113243    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d99e0862-2175-4c2f-8198-5b782ced8450-feast-data" (OuterVolumeSpecName: "feast-data") pod "d99e0862-2175-4c2f-8198-5b782ced8450" (UID: "d99e0862-2175-4c2f-8198-5b782ced8450"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:18:43.115385 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.115355    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d99e0862-2175-4c2f-8198-5b782ced8450-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d99e0862-2175-4c2f-8198-5b782ced8450" (UID: "d99e0862-2175-4c2f-8198-5b782ced8450"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 17:18:43.116893 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.116867    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d99e0862-2175-4c2f-8198-5b782ced8450-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "d99e0862-2175-4c2f-8198-5b782ced8450" (UID: "d99e0862-2175-4c2f-8198-5b782ced8450"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:18:43.117033 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.116903    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d99e0862-2175-4c2f-8198-5b782ced8450-online-tls" (OuterVolumeSpecName: "online-tls") pod "d99e0862-2175-4c2f-8198-5b782ced8450" (UID: "d99e0862-2175-4c2f-8198-5b782ced8450"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:18:43.117385 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.117356    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d99e0862-2175-4c2f-8198-5b782ced8450-kube-api-access-cj9th" (OuterVolumeSpecName: "kube-api-access-cj9th") pod "d99e0862-2175-4c2f-8198-5b782ced8450" (UID: "d99e0862-2175-4c2f-8198-5b782ced8450"). InnerVolumeSpecName "kube-api-access-cj9th". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:18:43.118030 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.118006    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d99e0862-2175-4c2f-8198-5b782ced8450-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "d99e0862-2175-4c2f-8198-5b782ced8450" (UID: "d99e0862-2175-4c2f-8198-5b782ced8450"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:18:43.120571 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.120545    2561 generic.go:356] "Generic (PLEG): container finished" podID="5bbb01e0-2001-45ac-af47-24854d7079c4" containerID="ff69803e033729445956add10103d747cb912ea329e36c7f8a3ccdc17f271c7b" exitCode=137
Jul 28 17:18:43.120571 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.120569    2561 generic.go:356] "Generic (PLEG): container finished" podID="5bbb01e0-2001-45ac-af47-24854d7079c4" containerID="557c7cae4f512575fdcdc483ffc39f757d0e58e69fbcf49215f000c9f4424e3b" exitCode=137
Jul 28 17:18:43.120692 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.120610    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh" event={"ID":"5bbb01e0-2001-45ac-af47-24854d7079c4","Type":"ContainerDied","Data":"ff69803e033729445956add10103d747cb912ea329e36c7f8a3ccdc17f271c7b"}
Jul 28 17:18:43.120692 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.120651    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh" event={"ID":"5bbb01e0-2001-45ac-af47-24854d7079c4","Type":"ContainerDied","Data":"557c7cae4f512575fdcdc483ffc39f757d0e58e69fbcf49215f000c9f4424e3b"}
Jul 28 17:18:43.123237 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.123215    2561 generic.go:356] "Generic (PLEG): container finished" podID="d99e0862-2175-4c2f-8198-5b782ced8450" containerID="1f5540919cdc570d6a21487a7bbdb68b826099b0830e423ddb4de027dd0f912e" exitCode=137
Jul 28 17:18:43.123338 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.123259    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5" event={"ID":"d99e0862-2175-4c2f-8198-5b782ced8450","Type":"ContainerDied","Data":"1f5540919cdc570d6a21487a7bbdb68b826099b0830e423ddb4de027dd0f912e"}
Jul 28 17:18:43.123338 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.123289    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5"
Jul 28 17:18:43.123338 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.123299    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5" event={"ID":"d99e0862-2175-4c2f-8198-5b782ced8450","Type":"ContainerDied","Data":"6d4d6386f4dba6f7175d3352113a747439f0a10fb7f2b414c540a245c6108390"}
Jul 28 17:18:43.123338 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.123327    2561 scope.go:117] "RemoveContainer" containerID="7fe7bd6f2fd0bc3f8750262ac45937a470f8f44192e7e2b787358c5e474571b6"
Jul 28 17:18:43.136516 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.136498    2561 scope.go:117] "RemoveContainer" containerID="1f5540919cdc570d6a21487a7bbdb68b826099b0830e423ddb4de027dd0f912e"
Jul 28 17:18:43.146115 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.146097    2561 scope.go:117] "RemoveContainer" containerID="e48638c2e48511cc1c5a6f00f0518b2e997281158269457d5af1cff638547e5b"
Jul 28 17:18:43.154790 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.154763    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5"]
Jul 28 17:18:43.155065 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.155034    2561 scope.go:117] "RemoveContainer" containerID="8b438e796cebefcfd7208e3b1f5aeb437be6a15f13057a9f750877694b39184a"
Jul 28 17:18:43.156436 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.156415    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-tg6z5"]
Jul 28 17:18:43.162799 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.162783    2561 scope.go:117] "RemoveContainer" containerID="0f6b76a7b4bfc37d435c2d0a47686580ac816f01235968d6c3c77bfd209877d2"
Jul 28 17:18:43.170024 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.170004    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh"
Jul 28 17:18:43.170198 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.170167    2561 scope.go:117] "RemoveContainer" containerID="7fe7bd6f2fd0bc3f8750262ac45937a470f8f44192e7e2b787358c5e474571b6"
Jul 28 17:18:43.170435 ip-10-0-128-92 kubenswrapper[2561]: E0728 17:18:43.170418    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fe7bd6f2fd0bc3f8750262ac45937a470f8f44192e7e2b787358c5e474571b6\": container with ID starting with 7fe7bd6f2fd0bc3f8750262ac45937a470f8f44192e7e2b787358c5e474571b6 not found: ID does not exist" containerID="7fe7bd6f2fd0bc3f8750262ac45937a470f8f44192e7e2b787358c5e474571b6"
Jul 28 17:18:43.170498 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.170445    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fe7bd6f2fd0bc3f8750262ac45937a470f8f44192e7e2b787358c5e474571b6"} err="failed to get container status \"7fe7bd6f2fd0bc3f8750262ac45937a470f8f44192e7e2b787358c5e474571b6\": rpc error: code = NotFound desc = could not find container \"7fe7bd6f2fd0bc3f8750262ac45937a470f8f44192e7e2b787358c5e474571b6\": container with ID starting with 7fe7bd6f2fd0bc3f8750262ac45937a470f8f44192e7e2b787358c5e474571b6 not found: ID does not exist"
Jul 28 17:18:43.170498 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.170468    2561 scope.go:117] "RemoveContainer" containerID="1f5540919cdc570d6a21487a7bbdb68b826099b0830e423ddb4de027dd0f912e"
Jul 28 17:18:43.170688 ip-10-0-128-92 kubenswrapper[2561]: E0728 17:18:43.170670    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f5540919cdc570d6a21487a7bbdb68b826099b0830e423ddb4de027dd0f912e\": container with ID starting with 1f5540919cdc570d6a21487a7bbdb68b826099b0830e423ddb4de027dd0f912e not found: ID does not exist" containerID="1f5540919cdc570d6a21487a7bbdb68b826099b0830e423ddb4de027dd0f912e"
Jul 28 17:18:43.170727 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.170694    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f5540919cdc570d6a21487a7bbdb68b826099b0830e423ddb4de027dd0f912e"} err="failed to get container status \"1f5540919cdc570d6a21487a7bbdb68b826099b0830e423ddb4de027dd0f912e\": rpc error: code = NotFound desc = could not find container \"1f5540919cdc570d6a21487a7bbdb68b826099b0830e423ddb4de027dd0f912e\": container with ID starting with 1f5540919cdc570d6a21487a7bbdb68b826099b0830e423ddb4de027dd0f912e not found: ID does not exist"
Jul 28 17:18:43.170727 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.170710    2561 scope.go:117] "RemoveContainer" containerID="e48638c2e48511cc1c5a6f00f0518b2e997281158269457d5af1cff638547e5b"
Jul 28 17:18:43.170890 ip-10-0-128-92 kubenswrapper[2561]: E0728 17:18:43.170875    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e48638c2e48511cc1c5a6f00f0518b2e997281158269457d5af1cff638547e5b\": container with ID starting with e48638c2e48511cc1c5a6f00f0518b2e997281158269457d5af1cff638547e5b not found: ID does not exist" containerID="e48638c2e48511cc1c5a6f00f0518b2e997281158269457d5af1cff638547e5b"
Jul 28 17:18:43.170944 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.170894    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e48638c2e48511cc1c5a6f00f0518b2e997281158269457d5af1cff638547e5b"} err="failed to get container status \"e48638c2e48511cc1c5a6f00f0518b2e997281158269457d5af1cff638547e5b\": rpc error: code = NotFound desc = could not find container \"e48638c2e48511cc1c5a6f00f0518b2e997281158269457d5af1cff638547e5b\": container with ID starting with e48638c2e48511cc1c5a6f00f0518b2e997281158269457d5af1cff638547e5b not found: ID does not exist"
Jul 28 17:18:43.170944 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.170906    2561 scope.go:117] "RemoveContainer" containerID="8b438e796cebefcfd7208e3b1f5aeb437be6a15f13057a9f750877694b39184a"
Jul 28 17:18:43.171146 ip-10-0-128-92 kubenswrapper[2561]: E0728 17:18:43.171130    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b438e796cebefcfd7208e3b1f5aeb437be6a15f13057a9f750877694b39184a\": container with ID starting with 8b438e796cebefcfd7208e3b1f5aeb437be6a15f13057a9f750877694b39184a not found: ID does not exist" containerID="8b438e796cebefcfd7208e3b1f5aeb437be6a15f13057a9f750877694b39184a"
Jul 28 17:18:43.171210 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.171152    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b438e796cebefcfd7208e3b1f5aeb437be6a15f13057a9f750877694b39184a"} err="failed to get container status \"8b438e796cebefcfd7208e3b1f5aeb437be6a15f13057a9f750877694b39184a\": rpc error: code = NotFound desc = could not find container \"8b438e796cebefcfd7208e3b1f5aeb437be6a15f13057a9f750877694b39184a\": container with ID starting with 8b438e796cebefcfd7208e3b1f5aeb437be6a15f13057a9f750877694b39184a not found: ID does not exist"
Jul 28 17:18:43.171210 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.171171    2561 scope.go:117] "RemoveContainer" containerID="0f6b76a7b4bfc37d435c2d0a47686580ac816f01235968d6c3c77bfd209877d2"
Jul 28 17:18:43.171391 ip-10-0-128-92 kubenswrapper[2561]: E0728 17:18:43.171374    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f6b76a7b4bfc37d435c2d0a47686580ac816f01235968d6c3c77bfd209877d2\": container with ID starting with 0f6b76a7b4bfc37d435c2d0a47686580ac816f01235968d6c3c77bfd209877d2 not found: ID does not exist" containerID="0f6b76a7b4bfc37d435c2d0a47686580ac816f01235968d6c3c77bfd209877d2"
Jul 28 17:18:43.171434 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.171394    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f6b76a7b4bfc37d435c2d0a47686580ac816f01235968d6c3c77bfd209877d2"} err="failed to get container status \"0f6b76a7b4bfc37d435c2d0a47686580ac816f01235968d6c3c77bfd209877d2\": rpc error: code = NotFound desc = could not find container \"0f6b76a7b4bfc37d435c2d0a47686580ac816f01235968d6c3c77bfd209877d2\": container with ID starting with 0f6b76a7b4bfc37d435c2d0a47686580ac816f01235968d6c3c77bfd209877d2 not found: ID does not exist"
Jul 28 17:18:43.213789 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.213760    2561 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/d99e0862-2175-4c2f-8198-5b782ced8450-ui-tls\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:18:43.213789 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.213788    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/d99e0862-2175-4c2f-8198-5b782ced8450-registry-tls\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:18:43.214077 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.213801    2561 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/d99e0862-2175-4c2f-8198-5b782ced8450-offline-tls\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:18:43.214077 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.213814    2561 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/d99e0862-2175-4c2f-8198-5b782ced8450-online-tls\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:18:43.214077 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.213826    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cj9th\" (UniqueName: \"kubernetes.io/projected/d99e0862-2175-4c2f-8198-5b782ced8450-kube-api-access-cj9th\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:18:43.214077 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.213838    2561 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/d99e0862-2175-4c2f-8198-5b782ced8450-feast-data\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:18:43.314886 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.314850    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5bbb01e0-2001-45ac-af47-24854d7079c4-ui-tls\") pod \"5bbb01e0-2001-45ac-af47-24854d7079c4\" (UID: \"5bbb01e0-2001-45ac-af47-24854d7079c4\") "
Jul 28 17:18:43.314886 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.314889    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5bbb01e0-2001-45ac-af47-24854d7079c4-registry-tls\") pod \"5bbb01e0-2001-45ac-af47-24854d7079c4\" (UID: \"5bbb01e0-2001-45ac-af47-24854d7079c4\") "
Jul 28 17:18:43.315143 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.314905    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5bbb01e0-2001-45ac-af47-24854d7079c4-offline-tls\") pod \"5bbb01e0-2001-45ac-af47-24854d7079c4\" (UID: \"5bbb01e0-2001-45ac-af47-24854d7079c4\") "
Jul 28 17:18:43.315143 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.314962    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5bbb01e0-2001-45ac-af47-24854d7079c4-online-tls\") pod \"5bbb01e0-2001-45ac-af47-24854d7079c4\" (UID: \"5bbb01e0-2001-45ac-af47-24854d7079c4\") "
Jul 28 17:18:43.315143 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.314994    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5bbb01e0-2001-45ac-af47-24854d7079c4-feast-data\") pod \"5bbb01e0-2001-45ac-af47-24854d7079c4\" (UID: \"5bbb01e0-2001-45ac-af47-24854d7079c4\") "
Jul 28 17:18:43.315143 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.315025    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vzm9j\" (UniqueName: \"kubernetes.io/projected/5bbb01e0-2001-45ac-af47-24854d7079c4-kube-api-access-vzm9j\") pod \"5bbb01e0-2001-45ac-af47-24854d7079c4\" (UID: \"5bbb01e0-2001-45ac-af47-24854d7079c4\") "
Jul 28 17:18:43.315567 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.315541    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5bbb01e0-2001-45ac-af47-24854d7079c4-feast-data" (OuterVolumeSpecName: "feast-data") pod "5bbb01e0-2001-45ac-af47-24854d7079c4" (UID: "5bbb01e0-2001-45ac-af47-24854d7079c4"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:18:43.317219 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.317195    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bbb01e0-2001-45ac-af47-24854d7079c4-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "5bbb01e0-2001-45ac-af47-24854d7079c4" (UID: "5bbb01e0-2001-45ac-af47-24854d7079c4"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:18:43.317644 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.317622    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bbb01e0-2001-45ac-af47-24854d7079c4-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "5bbb01e0-2001-45ac-af47-24854d7079c4" (UID: "5bbb01e0-2001-45ac-af47-24854d7079c4"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:18:43.317644 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.317640    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bbb01e0-2001-45ac-af47-24854d7079c4-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5bbb01e0-2001-45ac-af47-24854d7079c4" (UID: "5bbb01e0-2001-45ac-af47-24854d7079c4"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:18:43.317800 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.317747    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bbb01e0-2001-45ac-af47-24854d7079c4-kube-api-access-vzm9j" (OuterVolumeSpecName: "kube-api-access-vzm9j") pod "5bbb01e0-2001-45ac-af47-24854d7079c4" (UID: "5bbb01e0-2001-45ac-af47-24854d7079c4"). InnerVolumeSpecName "kube-api-access-vzm9j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:18:43.317800 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.317752    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5bbb01e0-2001-45ac-af47-24854d7079c4-online-tls" (OuterVolumeSpecName: "online-tls") pod "5bbb01e0-2001-45ac-af47-24854d7079c4" (UID: "5bbb01e0-2001-45ac-af47-24854d7079c4"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 17:18:43.416641 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.416536    2561 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/5bbb01e0-2001-45ac-af47-24854d7079c4-ui-tls\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:18:43.416641 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.416581    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/5bbb01e0-2001-45ac-af47-24854d7079c4-registry-tls\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:18:43.416641 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.416594    2561 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/5bbb01e0-2001-45ac-af47-24854d7079c4-offline-tls\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:18:43.416641 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.416604    2561 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/5bbb01e0-2001-45ac-af47-24854d7079c4-online-tls\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:18:43.416641 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.416615    2561 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/5bbb01e0-2001-45ac-af47-24854d7079c4-feast-data\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:18:43.416641 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:43.416627    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vzm9j\" (UniqueName: \"kubernetes.io/projected/5bbb01e0-2001-45ac-af47-24854d7079c4-kube-api-access-vzm9j\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:18:44.130137 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:44.130100    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh" event={"ID":"5bbb01e0-2001-45ac-af47-24854d7079c4","Type":"ContainerDied","Data":"37a32bf63a59596c353495f8b475e928bd4a69cbcefb49e6bd0df2e154f8c0a5"}
Jul 28 17:18:44.130137 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:44.130123    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh"
Jul 28 17:18:44.130653 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:44.130160    2561 scope.go:117] "RemoveContainer" containerID="28583672aae5690f0186303bf723b27145478018dbefda86ff42385871556cc7"
Jul 28 17:18:44.138832 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:44.138811    2561 scope.go:117] "RemoveContainer" containerID="ff69803e033729445956add10103d747cb912ea329e36c7f8a3ccdc17f271c7b"
Jul 28 17:18:44.146205 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:44.146189    2561 scope.go:117] "RemoveContainer" containerID="665d0dd6924aab67e8ca5c37b0406a1ec728abd856d1fc5660806a5ae75f82e4"
Jul 28 17:18:44.153458 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:44.153437    2561 scope.go:117] "RemoveContainer" containerID="557c7cae4f512575fdcdc483ffc39f757d0e58e69fbcf49215f000c9f4424e3b"
Jul 28 17:18:44.160462 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:44.160441    2561 scope.go:117] "RemoveContainer" containerID="e5f9d11f2ccecfcac91b09f740f37fe41df04090dd06ad6136b30a643c0ffc15"
Jul 28 17:18:44.167586 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:44.167567    2561 scope.go:117] "RemoveContainer" containerID="eb3617715321562c1ee5335f368869af7f3dca8c184e0cb3e8df7c671207a12c"
Jul 28 17:18:44.171041 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:44.171017    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh"]
Jul 28 17:18:44.179464 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:44.179442    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-xx2mh"]
Jul 28 17:18:45.075185 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:45.075149    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5bbb01e0-2001-45ac-af47-24854d7079c4" path="/var/lib/kubelet/pods/5bbb01e0-2001-45ac-af47-24854d7079c4/volumes"
Jul 28 17:18:45.075744 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:45.075731    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d99e0862-2175-4c2f-8198-5b782ced8450" path="/var/lib/kubelet/pods/d99e0862-2175-4c2f-8198-5b782ced8450/volumes"
Jul 28 17:18:56.196847 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:56.196810    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:18:56.329824 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:18:56.329789    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:19:02.501705 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:02.501669    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:19:02.572411 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:02.572380    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:19:02.952923 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:02.952848    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6pvrr/must-gather-bjwqt"]
Jul 28 17:19:02.953236 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:02.953219    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bbb01e0-2001-45ac-af47-24854d7079c4" containerName="registry"
Jul 28 17:19:02.953287 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:02.953249    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bbb01e0-2001-45ac-af47-24854d7079c4" containerName="registry"
Jul 28 17:19:02.953287 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:02.953260    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d99e0862-2175-4c2f-8198-5b782ced8450" containerName="feast-init"
Jul 28 17:19:02.953287 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:02.953268    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d99e0862-2175-4c2f-8198-5b782ced8450" containerName="feast-init"
Jul 28 17:19:02.953388 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:02.953295    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d99e0862-2175-4c2f-8198-5b782ced8450" containerName="offline"
Jul 28 17:19:02.953388 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:02.953303    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d99e0862-2175-4c2f-8198-5b782ced8450" containerName="offline"
Jul 28 17:19:02.953388 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:02.953311    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bbb01e0-2001-45ac-af47-24854d7079c4" containerName="feast-init"
Jul 28 17:19:02.953388 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:02.953318    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bbb01e0-2001-45ac-af47-24854d7079c4" containerName="feast-init"
Jul 28 17:19:02.953388 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:02.953325    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bbb01e0-2001-45ac-af47-24854d7079c4" containerName="offline"
Jul 28 17:19:02.953388 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:02.953332    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bbb01e0-2001-45ac-af47-24854d7079c4" containerName="offline"
Jul 28 17:19:02.953388 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:02.953341    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d99e0862-2175-4c2f-8198-5b782ced8450" containerName="online"
Jul 28 17:19:02.953388 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:02.953349    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d99e0862-2175-4c2f-8198-5b782ced8450" containerName="online"
Jul 28 17:19:02.953388 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:02.953358    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bbb01e0-2001-45ac-af47-24854d7079c4" containerName="ui"
Jul 28 17:19:02.953388 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:02.953365    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bbb01e0-2001-45ac-af47-24854d7079c4" containerName="ui"
Jul 28 17:19:02.953388 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:02.953374    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bbb01e0-2001-45ac-af47-24854d7079c4" containerName="feast-apply"
Jul 28 17:19:02.953388 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:02.953383    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bbb01e0-2001-45ac-af47-24854d7079c4" containerName="feast-apply"
Jul 28 17:19:02.953890 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:02.953398    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d99e0862-2175-4c2f-8198-5b782ced8450" containerName="ui"
Jul 28 17:19:02.953890 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:02.953406    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d99e0862-2175-4c2f-8198-5b782ced8450" containerName="ui"
Jul 28 17:19:02.953890 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:02.953417    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bbb01e0-2001-45ac-af47-24854d7079c4" containerName="online"
Jul 28 17:19:02.953890 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:02.953425    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bbb01e0-2001-45ac-af47-24854d7079c4" containerName="online"
Jul 28 17:19:02.953890 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:02.953436    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d99e0862-2175-4c2f-8198-5b782ced8450" containerName="feast-apply"
Jul 28 17:19:02.953890 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:02.953444    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d99e0862-2175-4c2f-8198-5b782ced8450" containerName="feast-apply"
Jul 28 17:19:02.953890 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:02.953512    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bbb01e0-2001-45ac-af47-24854d7079c4" containerName="offline"
Jul 28 17:19:02.953890 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:02.953525    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bbb01e0-2001-45ac-af47-24854d7079c4" containerName="registry"
Jul 28 17:19:02.953890 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:02.953534    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d99e0862-2175-4c2f-8198-5b782ced8450" containerName="ui"
Jul 28 17:19:02.953890 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:02.953540    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bbb01e0-2001-45ac-af47-24854d7079c4" containerName="ui"
Jul 28 17:19:02.953890 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:02.953547    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bbb01e0-2001-45ac-af47-24854d7079c4" containerName="online"
Jul 28 17:19:02.953890 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:02.953552    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d99e0862-2175-4c2f-8198-5b782ced8450" containerName="online"
Jul 28 17:19:02.953890 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:02.953559    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d99e0862-2175-4c2f-8198-5b782ced8450" containerName="offline"
Jul 28 17:19:02.954504 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:02.954463    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:19:02.958668 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:02.958650    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6pvrr/must-gather-bjwqt"
Jul 28 17:19:02.962509 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:02.962490    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6pvrr\"/\"default-dockercfg-4trbt\""
Jul 28 17:19:02.962654 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:02.962638    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6pvrr\"/\"openshift-service-ca.crt\""
Jul 28 17:19:02.963696 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:02.963678    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6pvrr\"/\"kube-root-ca.crt\""
Jul 28 17:19:02.966436 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:02.966417    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6pvrr/must-gather-bjwqt"]
Jul 28 17:19:03.049423 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:03.049396    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7xj6l\" (UniqueName: \"kubernetes.io/projected/6603c238-6ab0-4525-9a05-8c6a5a1883f9-kube-api-access-7xj6l\") pod \"must-gather-bjwqt\" (UID: \"6603c238-6ab0-4525-9a05-8c6a5a1883f9\") " pod="openshift-must-gather-6pvrr/must-gather-bjwqt"
Jul 28 17:19:03.049575 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:03.049440    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6603c238-6ab0-4525-9a05-8c6a5a1883f9-must-gather-output\") pod \"must-gather-bjwqt\" (UID: \"6603c238-6ab0-4525-9a05-8c6a5a1883f9\") " pod="openshift-must-gather-6pvrr/must-gather-bjwqt"
Jul 28 17:19:03.054111 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:03.054075    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:19:03.150809 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:03.150781    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7xj6l\" (UniqueName: \"kubernetes.io/projected/6603c238-6ab0-4525-9a05-8c6a5a1883f9-kube-api-access-7xj6l\") pod \"must-gather-bjwqt\" (UID: \"6603c238-6ab0-4525-9a05-8c6a5a1883f9\") " pod="openshift-must-gather-6pvrr/must-gather-bjwqt"
Jul 28 17:19:03.151005 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:03.150827    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6603c238-6ab0-4525-9a05-8c6a5a1883f9-must-gather-output\") pod \"must-gather-bjwqt\" (UID: \"6603c238-6ab0-4525-9a05-8c6a5a1883f9\") " pod="openshift-must-gather-6pvrr/must-gather-bjwqt"
Jul 28 17:19:03.151143 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:03.151119    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6603c238-6ab0-4525-9a05-8c6a5a1883f9-must-gather-output\") pod \"must-gather-bjwqt\" (UID: \"6603c238-6ab0-4525-9a05-8c6a5a1883f9\") " pod="openshift-must-gather-6pvrr/must-gather-bjwqt"
Jul 28 17:19:03.161364 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:03.161341    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7xj6l\" (UniqueName: \"kubernetes.io/projected/6603c238-6ab0-4525-9a05-8c6a5a1883f9-kube-api-access-7xj6l\") pod \"must-gather-bjwqt\" (UID: \"6603c238-6ab0-4525-9a05-8c6a5a1883f9\") " pod="openshift-must-gather-6pvrr/must-gather-bjwqt"
Jul 28 17:19:03.279416 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:03.279390    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6pvrr/must-gather-bjwqt"
Jul 28 17:19:03.402332 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:03.402310    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6pvrr/must-gather-bjwqt"]
Jul 28 17:19:03.404716 ip-10-0-128-92 kubenswrapper[2561]: W0728 17:19:03.404693    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6603c238_6ab0_4525_9a05_8c6a5a1883f9.slice/crio-a1f92c9c19d3faaad94c36c74ac3d4b9837a4df4acf0f59245d733d012b27c5b WatchSource:0}: Error finding container a1f92c9c19d3faaad94c36c74ac3d4b9837a4df4acf0f59245d733d012b27c5b: Status 404 returned error can't find the container with id a1f92c9c19d3faaad94c36c74ac3d4b9837a4df4acf0f59245d733d012b27c5b
Jul 28 17:19:03.406441 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:03.406425    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 17:19:04.207166 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:04.207097    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6pvrr/must-gather-bjwqt" event={"ID":"6603c238-6ab0-4525-9a05-8c6a5a1883f9","Type":"ContainerStarted","Data":"a1f92c9c19d3faaad94c36c74ac3d4b9837a4df4acf0f59245d733d012b27c5b"}
Jul 28 17:19:10.237467 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:10.237422    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6pvrr/must-gather-bjwqt" event={"ID":"6603c238-6ab0-4525-9a05-8c6a5a1883f9","Type":"ContainerStarted","Data":"91082093df2cd7df15914cfb95814a4b5cbff7619cc81fa63b12a92f58f86329"}
Jul 28 17:19:10.237961 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:10.237483    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6pvrr/must-gather-bjwqt" event={"ID":"6603c238-6ab0-4525-9a05-8c6a5a1883f9","Type":"ContainerStarted","Data":"eaf1fe91cfa27b0e0bc6fda90dc4123e0a9a6d2ce711e419bf81c540b6fd7aa7"}
Jul 28 17:19:10.264075 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:10.264030    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6pvrr/must-gather-bjwqt" podStartSLOduration=2.172325652 podStartE2EDuration="8.264014561s" totalImagesPullingTime="6.091688909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:19:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:19:10.263664249 +0000 UTC m=+1739.735077911" watchObservedRunningTime="2026-07-28 17:19:10.264014561 +0000 UTC m=+1739.735428220"
Jul 28 17:19:19.278257 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:19.278217    2561 generic.go:356] "Generic (PLEG): container finished" podID="6603c238-6ab0-4525-9a05-8c6a5a1883f9" containerID="eaf1fe91cfa27b0e0bc6fda90dc4123e0a9a6d2ce711e419bf81c540b6fd7aa7" exitCode=0
Jul 28 17:19:19.278649 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:19.278273    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6pvrr/must-gather-bjwqt" event={"ID":"6603c238-6ab0-4525-9a05-8c6a5a1883f9","Type":"ContainerDied","Data":"eaf1fe91cfa27b0e0bc6fda90dc4123e0a9a6d2ce711e419bf81c540b6fd7aa7"}
Jul 28 17:19:19.278649 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:19.278540    2561 scope.go:117] "RemoveContainer" containerID="eaf1fe91cfa27b0e0bc6fda90dc4123e0a9a6d2ce711e419bf81c540b6fd7aa7"
Jul 28 17:19:20.090271 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:20.090237    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-6pvrr_must-gather-bjwqt_6603c238-6ab0-4525-9a05-8c6a5a1883f9/gather/0.log"
Jul 28 17:19:20.526541 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:20.526513    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:19:20.682285 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:20.682257    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-v42vz/must-gather-kf6kn"]
Jul 28 17:19:20.684514 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:20.684500    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-v42vz/must-gather-kf6kn"
Jul 28 17:19:20.687144 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:20.687123    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-v42vz\"/\"openshift-service-ca.crt\""
Jul 28 17:19:20.687456 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:20.687442    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-v42vz\"/\"default-dockercfg-xmnsf\""
Jul 28 17:19:20.687511 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:20.687445    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-v42vz\"/\"kube-root-ca.crt\""
Jul 28 17:19:20.696721 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:20.696699    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:19:20.701628 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:20.701607    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-v42vz/must-gather-kf6kn"]
Jul 28 17:19:20.796051 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:20.795990    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5fed93fe-cd26-4a21-9383-f0f26e666cf5-must-gather-output\") pod \"must-gather-kf6kn\" (UID: \"5fed93fe-cd26-4a21-9383-f0f26e666cf5\") " pod="openshift-must-gather-v42vz/must-gather-kf6kn"
Jul 28 17:19:20.796051 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:20.796028    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hn6r\" (UniqueName: \"kubernetes.io/projected/5fed93fe-cd26-4a21-9383-f0f26e666cf5-kube-api-access-8hn6r\") pod \"must-gather-kf6kn\" (UID: \"5fed93fe-cd26-4a21-9383-f0f26e666cf5\") " pod="openshift-must-gather-v42vz/must-gather-kf6kn"
Jul 28 17:19:20.799161 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:20.799135    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:19:20.896772 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:20.896752    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5fed93fe-cd26-4a21-9383-f0f26e666cf5-must-gather-output\") pod \"must-gather-kf6kn\" (UID: \"5fed93fe-cd26-4a21-9383-f0f26e666cf5\") " pod="openshift-must-gather-v42vz/must-gather-kf6kn"
Jul 28 17:19:20.896875 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:20.896793    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hn6r\" (UniqueName: \"kubernetes.io/projected/5fed93fe-cd26-4a21-9383-f0f26e666cf5-kube-api-access-8hn6r\") pod \"must-gather-kf6kn\" (UID: \"5fed93fe-cd26-4a21-9383-f0f26e666cf5\") " pod="openshift-must-gather-v42vz/must-gather-kf6kn"
Jul 28 17:19:20.897174 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:20.897156    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/5fed93fe-cd26-4a21-9383-f0f26e666cf5-must-gather-output\") pod \"must-gather-kf6kn\" (UID: \"5fed93fe-cd26-4a21-9383-f0f26e666cf5\") " pod="openshift-must-gather-v42vz/must-gather-kf6kn"
Jul 28 17:19:20.907491 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:20.907476    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hn6r\" (UniqueName: \"kubernetes.io/projected/5fed93fe-cd26-4a21-9383-f0f26e666cf5-kube-api-access-8hn6r\") pod \"must-gather-kf6kn\" (UID: \"5fed93fe-cd26-4a21-9383-f0f26e666cf5\") " pod="openshift-must-gather-v42vz/must-gather-kf6kn"
Jul 28 17:19:20.992859 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:20.992834    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-v42vz/must-gather-kf6kn"
Jul 28 17:19:21.122352 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:21.122328    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-v42vz/must-gather-kf6kn"]
Jul 28 17:19:21.124702 ip-10-0-128-92 kubenswrapper[2561]: W0728 17:19:21.124683    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5fed93fe_cd26_4a21_9383_f0f26e666cf5.slice/crio-2fcc3f7ea613fad6696c7ef41de874315f3fe88f0e3c6d78b7efa808176a4328 WatchSource:0}: Error finding container 2fcc3f7ea613fad6696c7ef41de874315f3fe88f0e3c6d78b7efa808176a4328: Status 404 returned error can't find the container with id 2fcc3f7ea613fad6696c7ef41de874315f3fe88f0e3c6d78b7efa808176a4328
Jul 28 17:19:21.286093 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:21.286046    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v42vz/must-gather-kf6kn" event={"ID":"5fed93fe-cd26-4a21-9383-f0f26e666cf5","Type":"ContainerStarted","Data":"2fcc3f7ea613fad6696c7ef41de874315f3fe88f0e3c6d78b7efa808176a4328"}
Jul 28 17:19:22.294125 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:22.294089    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v42vz/must-gather-kf6kn" event={"ID":"5fed93fe-cd26-4a21-9383-f0f26e666cf5","Type":"ContainerStarted","Data":"5e036fb9094c5439c71f682caf4786aba85e0cecefbfe935061b9cfb7c0c4bd0"}
Jul 28 17:19:22.294532 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:22.294134    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v42vz/must-gather-kf6kn" event={"ID":"5fed93fe-cd26-4a21-9383-f0f26e666cf5","Type":"ContainerStarted","Data":"43cf4075aa65647e7120dc2eaf11198dac236545ca2149494cc4f86d457f3e4d"}
Jul 28 17:19:22.313847 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:22.313788    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-v42vz/must-gather-kf6kn" podStartSLOduration=1.747298655 podStartE2EDuration="2.31376685s" totalImagesPullingTime="566.468195ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 17:19:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:19:22.312436209 +0000 UTC m=+1751.783849870" watchObservedRunningTime="2026-07-28 17:19:22.31376685 +0000 UTC m=+1751.785180512"
Jul 28 17:19:23.121301 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:23.121267    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fvtsl_9a7043cc-b151-4888-90cc-f3dae8a2a91d/global-pull-secret-syncer/0.log"
Jul 28 17:19:23.341457 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:23.341429    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log"
Jul 28 17:19:23.451409 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:23.451332    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-92.ec2.internal_70f89e41a82f3ee988cac00f2f5c30a0/haproxy/0.log"
Jul 28 17:19:25.544845 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:25.544802    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-6pvrr/must-gather-bjwqt"]
Jul 28 17:19:25.545540 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:25.545051    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-6pvrr/must-gather-bjwqt" podUID="6603c238-6ab0-4525-9a05-8c6a5a1883f9" containerName="copy" containerID="cri-o://91082093df2cd7df15914cfb95814a4b5cbff7619cc81fa63b12a92f58f86329" gracePeriod=2
Jul 28 17:19:25.550826 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:25.550790    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-6pvrr/must-gather-bjwqt"]
Jul 28 17:19:25.921912 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:25.921872    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-6pvrr_must-gather-bjwqt_6603c238-6ab0-4525-9a05-8c6a5a1883f9/copy/0.log"
Jul 28 17:19:25.930755 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:25.930710    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6pvrr/must-gather-bjwqt"
Jul 28 17:19:25.937233 ip-10-0-128-92 kubenswrapper[2561]: E0728 17:19:25.937183    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-bjwqt\" is forbidden: User \"system:node:ip-10-0-128-92.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-6pvrr\": no relationship found between node 'ip-10-0-128-92.ec2.internal' and this object" podUID="6603c238-6ab0-4525-9a05-8c6a5a1883f9" pod="openshift-must-gather-6pvrr/must-gather-bjwqt"
Jul 28 17:19:26.043035 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:26.042981    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6603c238-6ab0-4525-9a05-8c6a5a1883f9-must-gather-output\") pod \"6603c238-6ab0-4525-9a05-8c6a5a1883f9\" (UID: \"6603c238-6ab0-4525-9a05-8c6a5a1883f9\") "
Jul 28 17:19:26.043410 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:26.043358    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7xj6l\" (UniqueName: \"kubernetes.io/projected/6603c238-6ab0-4525-9a05-8c6a5a1883f9-kube-api-access-7xj6l\") pod \"6603c238-6ab0-4525-9a05-8c6a5a1883f9\" (UID: \"6603c238-6ab0-4525-9a05-8c6a5a1883f9\") "
Jul 28 17:19:26.044640 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:26.044618    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6603c238-6ab0-4525-9a05-8c6a5a1883f9-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "6603c238-6ab0-4525-9a05-8c6a5a1883f9" (UID: "6603c238-6ab0-4525-9a05-8c6a5a1883f9"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 17:19:26.046708 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:26.046673    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6603c238-6ab0-4525-9a05-8c6a5a1883f9-kube-api-access-7xj6l" (OuterVolumeSpecName: "kube-api-access-7xj6l") pod "6603c238-6ab0-4525-9a05-8c6a5a1883f9" (UID: "6603c238-6ab0-4525-9a05-8c6a5a1883f9"). InnerVolumeSpecName "kube-api-access-7xj6l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 17:19:26.144448 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:26.144338    2561 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6603c238-6ab0-4525-9a05-8c6a5a1883f9-must-gather-output\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:19:26.144448 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:26.144373    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7xj6l\" (UniqueName: \"kubernetes.io/projected/6603c238-6ab0-4525-9a05-8c6a5a1883f9-kube-api-access-7xj6l\") on node \"ip-10-0-128-92.ec2.internal\" DevicePath \"\""
Jul 28 17:19:26.316886 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:26.316861    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-6pvrr_must-gather-bjwqt_6603c238-6ab0-4525-9a05-8c6a5a1883f9/copy/0.log"
Jul 28 17:19:26.317649 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:26.317624    2561 generic.go:356] "Generic (PLEG): container finished" podID="6603c238-6ab0-4525-9a05-8c6a5a1883f9" containerID="91082093df2cd7df15914cfb95814a4b5cbff7619cc81fa63b12a92f58f86329" exitCode=143
Jul 28 17:19:26.317862 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:26.317852    2561 scope.go:117] "RemoveContainer" containerID="91082093df2cd7df15914cfb95814a4b5cbff7619cc81fa63b12a92f58f86329"
Jul 28 17:19:26.318110 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:26.318097    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6pvrr/must-gather-bjwqt"
Jul 28 17:19:26.332717 ip-10-0-128-92 kubenswrapper[2561]: E0728 17:19:26.332685    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-bjwqt\" is forbidden: User \"system:node:ip-10-0-128-92.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-6pvrr\": no relationship found between node 'ip-10-0-128-92.ec2.internal' and this object" podUID="6603c238-6ab0-4525-9a05-8c6a5a1883f9" pod="openshift-must-gather-6pvrr/must-gather-bjwqt"
Jul 28 17:19:26.338014 ip-10-0-128-92 kubenswrapper[2561]: E0728 17:19:26.337988    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-bjwqt\" is forbidden: User \"system:node:ip-10-0-128-92.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-6pvrr\": no relationship found between node 'ip-10-0-128-92.ec2.internal' and this object" podUID="6603c238-6ab0-4525-9a05-8c6a5a1883f9" pod="openshift-must-gather-6pvrr/must-gather-bjwqt"
Jul 28 17:19:26.347129 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:26.347111    2561 scope.go:117] "RemoveContainer" containerID="eaf1fe91cfa27b0e0bc6fda90dc4123e0a9a6d2ce711e419bf81c540b6fd7aa7"
Jul 28 17:19:26.369072 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:26.368812    2561 scope.go:117] "RemoveContainer" containerID="91082093df2cd7df15914cfb95814a4b5cbff7619cc81fa63b12a92f58f86329"
Jul 28 17:19:26.369565 ip-10-0-128-92 kubenswrapper[2561]: E0728 17:19:26.369333    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91082093df2cd7df15914cfb95814a4b5cbff7619cc81fa63b12a92f58f86329\": container with ID starting with 91082093df2cd7df15914cfb95814a4b5cbff7619cc81fa63b12a92f58f86329 not found: ID does not exist" containerID="91082093df2cd7df15914cfb95814a4b5cbff7619cc81fa63b12a92f58f86329"
Jul 28 17:19:26.369565 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:26.369367    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91082093df2cd7df15914cfb95814a4b5cbff7619cc81fa63b12a92f58f86329"} err="failed to get container status \"91082093df2cd7df15914cfb95814a4b5cbff7619cc81fa63b12a92f58f86329\": rpc error: code = NotFound desc = could not find container \"91082093df2cd7df15914cfb95814a4b5cbff7619cc81fa63b12a92f58f86329\": container with ID starting with 91082093df2cd7df15914cfb95814a4b5cbff7619cc81fa63b12a92f58f86329 not found: ID does not exist"
Jul 28 17:19:26.369565 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:26.369392    2561 scope.go:117] "RemoveContainer" containerID="eaf1fe91cfa27b0e0bc6fda90dc4123e0a9a6d2ce711e419bf81c540b6fd7aa7"
Jul 28 17:19:26.370124 ip-10-0-128-92 kubenswrapper[2561]: E0728 17:19:26.369870    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eaf1fe91cfa27b0e0bc6fda90dc4123e0a9a6d2ce711e419bf81c540b6fd7aa7\": container with ID starting with eaf1fe91cfa27b0e0bc6fda90dc4123e0a9a6d2ce711e419bf81c540b6fd7aa7 not found: ID does not exist" containerID="eaf1fe91cfa27b0e0bc6fda90dc4123e0a9a6d2ce711e419bf81c540b6fd7aa7"
Jul 28 17:19:26.370124 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:26.369898    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eaf1fe91cfa27b0e0bc6fda90dc4123e0a9a6d2ce711e419bf81c540b6fd7aa7"} err="failed to get container status \"eaf1fe91cfa27b0e0bc6fda90dc4123e0a9a6d2ce711e419bf81c540b6fd7aa7\": rpc error: code = NotFound desc = could not find container \"eaf1fe91cfa27b0e0bc6fda90dc4123e0a9a6d2ce711e419bf81c540b6fd7aa7\": container with ID starting with eaf1fe91cfa27b0e0bc6fda90dc4123e0a9a6d2ce711e419bf81c540b6fd7aa7 not found: ID does not exist"
Jul 28 17:19:26.816506 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:26.816469    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:19:26.914675 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:26.914645    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-gspwj_43c3a34e-2451-4eb9-878c-8100a5d2ac48/konnectivity-agent/0.log" limit=1024
Jul 28 17:19:27.077492 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:27.077412    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6603c238-6ab0-4525-9a05-8c6a5a1883f9" path="/var/lib/kubelet/pods/6603c238-6ab0-4525-9a05-8c6a5a1883f9/volumes"
Jul 28 17:19:27.450218 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:27.450143    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-mj2cg_113011e3-c1ad-40f8-b250-0ffb6826e4f9/kube-state-metrics/0.log"
Jul 28 17:19:27.498476 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:27.498446    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-mj2cg_113011e3-c1ad-40f8-b250-0ffb6826e4f9/kube-rbac-proxy-main/0.log"
Jul 28 17:19:27.526534 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:27.526499    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-mj2cg_113011e3-c1ad-40f8-b250-0ffb6826e4f9/kube-rbac-proxy-self/0.log"
Jul 28 17:19:27.564134 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:27.564102    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-66b69b8c57-lnc6c_97f86307-d00a-4808-ab85-141adf1e5411/metrics-server/0.log"
Jul 28 17:19:27.599326 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:27.599296    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-4xqvc_1d3b71ec-3a67-4a76-b679-f8ac52b8e605/monitoring-plugin/0.log"
Jul 28 17:19:27.910621 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:27.910591    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fkj9s_6cd2b8dd-9699-463c-94f4-1ac4a58f480c/node-exporter/0.log"
Jul 28 17:19:27.940200 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:27.940171    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fkj9s_6cd2b8dd-9699-463c-94f4-1ac4a58f480c/kube-rbac-proxy/0.log"
Jul 28 17:19:27.972060 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:27.972031    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fkj9s_6cd2b8dd-9699-463c-94f4-1ac4a58f480c/init-textfile/0.log"
Jul 28 17:19:28.015140 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:28.015107    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-nwwnm_f00acafc-07e7-44e5-adf0-e27090651d24/kube-rbac-proxy-main/0.log"
Jul 28 17:19:28.052176 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:28.052150    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-nwwnm_f00acafc-07e7-44e5-adf0-e27090651d24/kube-rbac-proxy-self/0.log"
Jul 28 17:19:28.088804 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:28.088771    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-nwwnm_f00acafc-07e7-44e5-adf0-e27090651d24/openshift-state-metrics/0.log"
Jul 28 17:19:28.577611 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:28.577534    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-c8zl6_e177b6cf-d22b-410c-a17e-525d7484a097/prometheus-operator-admission-webhook/0.log"
Jul 28 17:19:28.644923 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:28.644896    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5776dd99b4-d8tzt_13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7/telemeter-client/0.log"
Jul 28 17:19:28.680787 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:28.680750    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5776dd99b4-d8tzt_13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7/reload/0.log"
Jul 28 17:19:28.713431 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:28.713408    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5776dd99b4-d8tzt_13c3fd52-0ffd-4126-a1f5-ad1e03ae28b7/kube-rbac-proxy/0.log"
Jul 28 17:19:28.759503 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:28.759470    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d8df69445-swr4n_ec22f019-b5ce-4072-92f0-c2ddde44342d/thanos-query/0.log"
Jul 28 17:19:28.800770 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:28.800684    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d8df69445-swr4n_ec22f019-b5ce-4072-92f0-c2ddde44342d/kube-rbac-proxy-web/0.log"
Jul 28 17:19:28.850176 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:28.850092    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d8df69445-swr4n_ec22f019-b5ce-4072-92f0-c2ddde44342d/kube-rbac-proxy/0.log"
Jul 28 17:19:28.902726 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:28.902694    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d8df69445-swr4n_ec22f019-b5ce-4072-92f0-c2ddde44342d/prom-label-proxy/0.log"
Jul 28 17:19:28.970352 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:28.970318    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d8df69445-swr4n_ec22f019-b5ce-4072-92f0-c2ddde44342d/kube-rbac-proxy-rules/0.log"
Jul 28 17:19:29.039516 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:29.039478    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6d8df69445-swr4n_ec22f019-b5ce-4072-92f0-c2ddde44342d/kube-rbac-proxy-metrics/0.log"
Jul 28 17:19:30.033377 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:30.033335    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-v42vz/perf-node-gather-daemonset-gsrlk"]
Jul 28 17:19:30.033983 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:30.033765    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6603c238-6ab0-4525-9a05-8c6a5a1883f9" containerName="gather"
Jul 28 17:19:30.033983 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:30.033781    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6603c238-6ab0-4525-9a05-8c6a5a1883f9" containerName="gather"
Jul 28 17:19:30.033983 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:30.033804    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6603c238-6ab0-4525-9a05-8c6a5a1883f9" containerName="copy"
Jul 28 17:19:30.033983 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:30.033812    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="6603c238-6ab0-4525-9a05-8c6a5a1883f9" containerName="copy"
Jul 28 17:19:30.033983 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:30.033887    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6603c238-6ab0-4525-9a05-8c6a5a1883f9" containerName="gather"
Jul 28 17:19:30.033983 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:30.033898    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="6603c238-6ab0-4525-9a05-8c6a5a1883f9" containerName="copy"
Jul 28 17:19:30.037529 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:30.037504    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-v42vz/perf-node-gather-daemonset-gsrlk"
Jul 28 17:19:30.048690 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:30.048666    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-v42vz/perf-node-gather-daemonset-gsrlk"]
Jul 28 17:19:30.081721 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:30.081694    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fb56cb8c-00ff-4649-be64-c95054f3f83a-lib-modules\") pod \"perf-node-gather-daemonset-gsrlk\" (UID: \"fb56cb8c-00ff-4649-be64-c95054f3f83a\") " pod="openshift-must-gather-v42vz/perf-node-gather-daemonset-gsrlk"
Jul 28 17:19:30.081907 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:30.081728    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fb56cb8c-00ff-4649-be64-c95054f3f83a-proc\") pod \"perf-node-gather-daemonset-gsrlk\" (UID: \"fb56cb8c-00ff-4649-be64-c95054f3f83a\") " pod="openshift-must-gather-v42vz/perf-node-gather-daemonset-gsrlk"
Jul 28 17:19:30.081907 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:30.081771    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmghl\" (UniqueName: \"kubernetes.io/projected/fb56cb8c-00ff-4649-be64-c95054f3f83a-kube-api-access-wmghl\") pod \"perf-node-gather-daemonset-gsrlk\" (UID: \"fb56cb8c-00ff-4649-be64-c95054f3f83a\") " pod="openshift-must-gather-v42vz/perf-node-gather-daemonset-gsrlk"
Jul 28 17:19:30.081907 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:30.081851    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fb56cb8c-00ff-4649-be64-c95054f3f83a-podres\") pod \"perf-node-gather-daemonset-gsrlk\" (UID: \"fb56cb8c-00ff-4649-be64-c95054f3f83a\") " pod="openshift-must-gather-v42vz/perf-node-gather-daemonset-gsrlk"
Jul 28 17:19:30.082060 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:30.081911    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fb56cb8c-00ff-4649-be64-c95054f3f83a-sys\") pod \"perf-node-gather-daemonset-gsrlk\" (UID: \"fb56cb8c-00ff-4649-be64-c95054f3f83a\") " pod="openshift-must-gather-v42vz/perf-node-gather-daemonset-gsrlk"
Jul 28 17:19:30.182970 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:30.182919    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmghl\" (UniqueName: \"kubernetes.io/projected/fb56cb8c-00ff-4649-be64-c95054f3f83a-kube-api-access-wmghl\") pod \"perf-node-gather-daemonset-gsrlk\" (UID: \"fb56cb8c-00ff-4649-be64-c95054f3f83a\") " pod="openshift-must-gather-v42vz/perf-node-gather-daemonset-gsrlk"
Jul 28 17:19:30.183153 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:30.182987    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fb56cb8c-00ff-4649-be64-c95054f3f83a-podres\") pod \"perf-node-gather-daemonset-gsrlk\" (UID: \"fb56cb8c-00ff-4649-be64-c95054f3f83a\") " pod="openshift-must-gather-v42vz/perf-node-gather-daemonset-gsrlk"
Jul 28 17:19:30.183153 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:30.183020    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fb56cb8c-00ff-4649-be64-c95054f3f83a-sys\") pod \"perf-node-gather-daemonset-gsrlk\" (UID: \"fb56cb8c-00ff-4649-be64-c95054f3f83a\") " pod="openshift-must-gather-v42vz/perf-node-gather-daemonset-gsrlk"
Jul 28 17:19:30.183153 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:30.183042    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fb56cb8c-00ff-4649-be64-c95054f3f83a-lib-modules\") pod \"perf-node-gather-daemonset-gsrlk\" (UID: \"fb56cb8c-00ff-4649-be64-c95054f3f83a\") " pod="openshift-must-gather-v42vz/perf-node-gather-daemonset-gsrlk"
Jul 28 17:19:30.183153 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:30.183124    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fb56cb8c-00ff-4649-be64-c95054f3f83a-sys\") pod \"perf-node-gather-daemonset-gsrlk\" (UID: \"fb56cb8c-00ff-4649-be64-c95054f3f83a\") " pod="openshift-must-gather-v42vz/perf-node-gather-daemonset-gsrlk"
Jul 28 17:19:30.183411 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:30.183379    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fb56cb8c-00ff-4649-be64-c95054f3f83a-podres\") pod \"perf-node-gather-daemonset-gsrlk\" (UID: \"fb56cb8c-00ff-4649-be64-c95054f3f83a\") " pod="openshift-must-gather-v42vz/perf-node-gather-daemonset-gsrlk"
Jul 28 17:19:30.188365 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:30.183565    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fb56cb8c-00ff-4649-be64-c95054f3f83a-proc\") pod \"perf-node-gather-daemonset-gsrlk\" (UID: \"fb56cb8c-00ff-4649-be64-c95054f3f83a\") " pod="openshift-must-gather-v42vz/perf-node-gather-daemonset-gsrlk"
Jul 28 17:19:30.188365 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:30.183406    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fb56cb8c-00ff-4649-be64-c95054f3f83a-lib-modules\") pod \"perf-node-gather-daemonset-gsrlk\" (UID: \"fb56cb8c-00ff-4649-be64-c95054f3f83a\") " pod="openshift-must-gather-v42vz/perf-node-gather-daemonset-gsrlk"
Jul 28 17:19:30.188365 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:30.183667    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fb56cb8c-00ff-4649-be64-c95054f3f83a-proc\") pod \"perf-node-gather-daemonset-gsrlk\" (UID: \"fb56cb8c-00ff-4649-be64-c95054f3f83a\") " pod="openshift-must-gather-v42vz/perf-node-gather-daemonset-gsrlk"
Jul 28 17:19:30.193901 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:30.193879    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmghl\" (UniqueName: \"kubernetes.io/projected/fb56cb8c-00ff-4649-be64-c95054f3f83a-kube-api-access-wmghl\") pod \"perf-node-gather-daemonset-gsrlk\" (UID: \"fb56cb8c-00ff-4649-be64-c95054f3f83a\") " pod="openshift-must-gather-v42vz/perf-node-gather-daemonset-gsrlk"
Jul 28 17:19:30.351655 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:30.351514    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-v42vz/perf-node-gather-daemonset-gsrlk"
Jul 28 17:19:30.533326 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:30.533295    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-v42vz/perf-node-gather-daemonset-gsrlk"]
Jul 28 17:19:30.535096 ip-10-0-128-92 kubenswrapper[2561]: W0728 17:19:30.535069    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfb56cb8c_00ff_4649_be64_c95054f3f83a.slice/crio-848465c450fb22e3380c1a1e5c6b1abebbe067377e8928118d6856870036c490 WatchSource:0}: Error finding container 848465c450fb22e3380c1a1e5c6b1abebbe067377e8928118d6856870036c490: Status 404 returned error can't find the container with id 848465c450fb22e3380c1a1e5c6b1abebbe067377e8928118d6856870036c490
Jul 28 17:19:31.344195 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:31.344154    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v42vz/perf-node-gather-daemonset-gsrlk" event={"ID":"fb56cb8c-00ff-4649-be64-c95054f3f83a","Type":"ContainerStarted","Data":"47f764d88fda8cd3ab74e9d75ef34cfca74abe5f7c70ea7bfced63a429e70302"}
Jul 28 17:19:31.344623 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:31.344209    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v42vz/perf-node-gather-daemonset-gsrlk" event={"ID":"fb56cb8c-00ff-4649-be64-c95054f3f83a","Type":"ContainerStarted","Data":"848465c450fb22e3380c1a1e5c6b1abebbe067377e8928118d6856870036c490"}
Jul 28 17:19:31.344623 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:31.344298    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-v42vz/perf-node-gather-daemonset-gsrlk"
Jul 28 17:19:31.364636 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:31.364586    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-v42vz/perf-node-gather-daemonset-gsrlk" podStartSLOduration=1.364569132 podStartE2EDuration="1.364569132s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 17:19:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 17:19:31.364186621 +0000 UTC m=+1760.835600281" watchObservedRunningTime="2026-07-28 17:19:31.364569132 +0000 UTC m=+1760.835982792"
Jul 28 17:19:32.605085 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:32.605061    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lprvh_1fb47334-76af-492b-8706-2e51e6da5fcc/dns/0.log"
Jul 28 17:19:32.633041 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:32.633017    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-lprvh_1fb47334-76af-492b-8706-2e51e6da5fcc/kube-rbac-proxy/0.log"
Jul 28 17:19:32.722421 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:32.722403    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-495dh_c78f3240-32b5-4e57-bc03-c1f9e08c28e5/dns-node-resolver/0.log"
Jul 28 17:19:33.429974 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:33.429923    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qrhwd_5c2c260e-d050-44eb-90d3-da4d25ade88a/node-ca/0.log"
Jul 28 17:19:34.690381 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:34.690352    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-zzdwf_298a9936-16c8-4817-b4dd-3c5a46b45cb3/serve-healthcheck-canary/0.log"
Jul 28 17:19:35.207738 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:35.207701    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d9pjq_1f76d1cf-0908-4c40-9d33-50e1b6c85200/kube-rbac-proxy/0.log"
Jul 28 17:19:35.232322 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:35.232299    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d9pjq_1f76d1cf-0908-4c40-9d33-50e1b6c85200/exporter/0.log"
Jul 28 17:19:35.258534 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:35.258512    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-d9pjq_1f76d1cf-0908-4c40-9d33-50e1b6c85200/extractor/0.log"
Jul 28 17:19:37.359493 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:37.359465    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-v42vz/perf-node-gather-daemonset-gsrlk"
Jul 28 17:19:41.943119 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:41.943094    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-txmf4_8537db2a-96d8-4755-ae0b-40e2462c90c2/kube-multus-additional-cni-plugins/0.log"
Jul 28 17:19:41.973955 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:41.973894    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-txmf4_8537db2a-96d8-4755-ae0b-40e2462c90c2/egress-router-binary-copy/0.log"
Jul 28 17:19:42.005224 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:42.005197    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-txmf4_8537db2a-96d8-4755-ae0b-40e2462c90c2/cni-plugins/0.log"
Jul 28 17:19:42.030535 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:42.030514    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-txmf4_8537db2a-96d8-4755-ae0b-40e2462c90c2/bond-cni-plugin/0.log"
Jul 28 17:19:42.055746 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:42.055702    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-txmf4_8537db2a-96d8-4755-ae0b-40e2462c90c2/routeoverride-cni/0.log"
Jul 28 17:19:42.082492 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:42.082475    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-txmf4_8537db2a-96d8-4755-ae0b-40e2462c90c2/whereabouts-cni-bincopy/0.log"
Jul 28 17:19:42.106216 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:42.106188    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-txmf4_8537db2a-96d8-4755-ae0b-40e2462c90c2/whereabouts-cni/0.log"
Jul 28 17:19:42.195423 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:42.195358    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-q77xn_5eef3908-3a57-4ba9-be8c-8c78354aaf2a/kube-multus/0.log"
Jul 28 17:19:42.361245 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:42.361212    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vn69s_ab2695e6-884f-4726-ba45-fe2772ee69a8/network-metrics-daemon/0.log"
Jul 28 17:19:42.395066 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:42.395044    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-vn69s_ab2695e6-884f-4726-ba45-fe2772ee69a8/kube-rbac-proxy/0.log"
Jul 28 17:19:43.164164 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:43.164133    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7st4p_5286ccd9-f5ee-4c9c-963d-93d2530a5fc4/ovn-controller/0.log"
Jul 28 17:19:43.189661 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:43.189640    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7st4p_5286ccd9-f5ee-4c9c-963d-93d2530a5fc4/ovn-acl-logging/0.log"
Jul 28 17:19:43.216726 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:43.216704    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7st4p_5286ccd9-f5ee-4c9c-963d-93d2530a5fc4/kube-rbac-proxy-node/0.log"
Jul 28 17:19:43.244369 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:43.244340    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7st4p_5286ccd9-f5ee-4c9c-963d-93d2530a5fc4/kube-rbac-proxy-ovn-metrics/0.log"
Jul 28 17:19:43.274762 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:43.274735    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7st4p_5286ccd9-f5ee-4c9c-963d-93d2530a5fc4/northd/0.log"
Jul 28 17:19:43.301550 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:43.301527    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7st4p_5286ccd9-f5ee-4c9c-963d-93d2530a5fc4/nbdb/0.log"
Jul 28 17:19:43.330397 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:43.330379    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7st4p_5286ccd9-f5ee-4c9c-963d-93d2530a5fc4/sbdb/0.log"
Jul 28 17:19:43.399094 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:43.399068    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-7st4p_5286ccd9-f5ee-4c9c-963d-93d2530a5fc4/ovnkube-controller/0.log"
Jul 28 17:19:44.965002 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:44.964971    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-hbfct_7d6d1fea-9980-41ab-a88b-eb0b04e4d8ee/network-check-target-container/0.log"
Jul 28 17:19:45.933969 ip-10-0-128-92 kubenswrapper[2561]: I0728 17:19:45.933923    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-5x69v_1540ebde-12ed-4345-98c4-ed0dd754c994/iptables-alerter/0.log"