Jul 28 15:12:01.417415 ip-10-0-143-125 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 28 15:12:01.417427 ip-10-0-143-125 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 28 15:12:01.417434 ip-10-0-143-125 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 28 15:12:01.417766 ip-10-0-143-125 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 28 15:12:10.818820 ip-10-0-143-125 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found.
Jul 28 15:12:10.818835 ip-10-0-143-125 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 44dff721af7f49a7b59e47dec5171fe7 --
Jul 28 15:13:58.849187 ip-10-0-143-125 systemd[1]: Starting Kubernetes Kubelet...
Jul 28 15:13:59.180799 ip-10-0-143-125 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 15:13:59.180799 ip-10-0-143-125 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 28 15:13:59.180799 ip-10-0-143-125 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 15:13:59.180799 ip-10-0-143-125 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 28 15:13:59.180799 ip-10-0-143-125 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 28 15:13:59.182924 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.182797    2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 28 15:13:59.187663 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187645    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 15:13:59.187663 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187663    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 15:13:59.187726 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187669    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 15:13:59.187726 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187672    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 15:13:59.187726 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187675    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 15:13:59.187726 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187679    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 15:13:59.187726 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187681    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 15:13:59.187726 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187684    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 15:13:59.187726 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187687    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 15:13:59.187726 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187690    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 15:13:59.187726 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187692    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 15:13:59.187726 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187695    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 15:13:59.187726 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187700    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 15:13:59.187726 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187703    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 15:13:59.187726 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187706    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 15:13:59.187726 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187709    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 15:13:59.187726 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187712    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 15:13:59.187726 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187715    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 15:13:59.187726 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187718    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 15:13:59.187726 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187720    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 15:13:59.187726 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187728    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 15:13:59.188194 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187732    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 15:13:59.188194 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187735    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 15:13:59.188194 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187738    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 15:13:59.188194 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187741    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 15:13:59.188194 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187744    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 15:13:59.188194 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187747    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 15:13:59.188194 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187749    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 15:13:59.188194 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187752    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 15:13:59.188194 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187754    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 15:13:59.188194 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187757    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 15:13:59.188194 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187760    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 15:13:59.188194 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187764    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 15:13:59.188194 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187767    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 15:13:59.188194 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187770    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 15:13:59.188194 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187773    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 15:13:59.188194 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187776    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 15:13:59.188194 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187778    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 15:13:59.188194 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187781    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 15:13:59.188194 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187783    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 15:13:59.188663 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187786    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 15:13:59.188663 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187788    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 15:13:59.188663 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187791    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 15:13:59.188663 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187793    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 15:13:59.188663 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187796    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 15:13:59.188663 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187798    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 15:13:59.188663 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187800    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 15:13:59.188663 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187803    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 15:13:59.188663 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187805    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 15:13:59.188663 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187808    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 15:13:59.188663 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187810    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 15:13:59.188663 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187813    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 15:13:59.188663 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187815    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 15:13:59.188663 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187818    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 15:13:59.188663 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187836    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 15:13:59.188663 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187839    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 15:13:59.188663 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187842    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 15:13:59.188663 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187845    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 15:13:59.188663 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187848    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 15:13:59.188663 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187851    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 15:13:59.189200 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187854    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 15:13:59.189200 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187856    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 15:13:59.189200 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187859    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 15:13:59.189200 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187861    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 15:13:59.189200 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187864    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 15:13:59.189200 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187866    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 15:13:59.189200 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187870    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 15:13:59.189200 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187874    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 15:13:59.189200 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187877    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 15:13:59.189200 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187880    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 15:13:59.189200 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187882    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 15:13:59.189200 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187885    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 15:13:59.189200 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187887    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 15:13:59.189200 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187890    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 15:13:59.189200 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187894    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 15:13:59.189200 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187896    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 15:13:59.189200 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187899    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 15:13:59.189200 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187901    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 15:13:59.189200 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187904    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 15:13:59.189200 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187907    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 15:13:59.190038 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187909    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 15:13:59.190038 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187912    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 15:13:59.190038 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187915    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 15:13:59.190038 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187917    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 15:13:59.190038 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187919    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 15:13:59.190038 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187922    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 15:13:59.190038 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187927    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 15:13:59.190038 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187929    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 15:13:59.190038 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187932    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 15:13:59.190038 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187934    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 15:13:59.190038 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187937    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 15:13:59.190038 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187940    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 15:13:59.190038 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187942    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 15:13:59.190038 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187945    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 15:13:59.190038 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187947    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 15:13:59.190038 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187950    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 15:13:59.190038 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187953    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 15:13:59.190038 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187955    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 15:13:59.190038 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.187957    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 15:13:59.190038 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188655    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 15:13:59.190529 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188663    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 15:13:59.190529 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188666    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 15:13:59.190529 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188669    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 15:13:59.190529 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188672    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 15:13:59.190529 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188675    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 15:13:59.190529 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188677    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 15:13:59.190529 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188680    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 15:13:59.190529 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188683    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 15:13:59.190529 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188686    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 15:13:59.190529 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188688    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 15:13:59.190529 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188691    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 15:13:59.190529 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188694    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 15:13:59.190529 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188698    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 15:13:59.190529 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188703    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 15:13:59.190529 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188706    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 15:13:59.190529 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188709    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 15:13:59.190529 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188712    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 15:13:59.190529 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188714    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 15:13:59.190529 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188718    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 15:13:59.191022 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188721    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 15:13:59.191022 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188724    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 15:13:59.191022 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188726    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 15:13:59.191022 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188729    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 15:13:59.191022 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188732    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 15:13:59.191022 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188734    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 15:13:59.191022 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188737    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 15:13:59.191022 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188739    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 15:13:59.191022 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188742    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 15:13:59.191022 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188745    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 15:13:59.191022 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188747    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 15:13:59.191022 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188750    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 15:13:59.191022 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188752    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 15:13:59.191022 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188755    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 15:13:59.191022 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188757    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 15:13:59.191022 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188759    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 15:13:59.191022 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188762    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 15:13:59.191022 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188764    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 15:13:59.191022 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188767    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 15:13:59.191022 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188769    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 15:13:59.191508 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188772    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 15:13:59.191508 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188775    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 15:13:59.191508 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188777    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 15:13:59.191508 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188780    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 15:13:59.191508 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188783    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 15:13:59.191508 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188786    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 15:13:59.191508 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188791    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 15:13:59.191508 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188794    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 15:13:59.191508 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188797    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 15:13:59.191508 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188800    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 15:13:59.191508 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188803    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 15:13:59.191508 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188806    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 15:13:59.191508 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188809    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 15:13:59.191508 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188813    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 15:13:59.191508 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188815    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 15:13:59.191508 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188818    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 15:13:59.191508 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188834    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 15:13:59.191508 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188837    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 15:13:59.191508 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188840    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 15:13:59.191508 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188842    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 15:13:59.192021 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188845    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 15:13:59.192021 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188847    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 15:13:59.192021 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188850    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 15:13:59.192021 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188853    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 15:13:59.192021 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188856    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 15:13:59.192021 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188858    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 15:13:59.192021 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188860    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 15:13:59.192021 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188863    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 15:13:59.192021 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188866    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 15:13:59.192021 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188869    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 15:13:59.192021 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188872    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 15:13:59.192021 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188875    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 15:13:59.192021 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188878    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 15:13:59.192021 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188881    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 15:13:59.192021 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188885    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 15:13:59.192021 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188887    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 15:13:59.192021 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188890    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 15:13:59.192021 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188892    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 15:13:59.192021 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188895    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 15:13:59.192543 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188898    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 15:13:59.192543 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188900    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 15:13:59.192543 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188903    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 15:13:59.192543 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188905    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 15:13:59.192543 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188908    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 15:13:59.192543 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188911    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 15:13:59.192543 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188913    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 15:13:59.192543 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188917    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 15:13:59.192543 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188919    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 15:13:59.192543 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188922    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 15:13:59.192543 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188925    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 15:13:59.192543 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188928    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 15:13:59.192543 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188930    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 15:13:59.192543 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188932    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 15:13:59.192543 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188935    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 15:13:59.192543 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188938    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 15:13:59.192543 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188940    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 15:13:59.192543 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188942    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 15:13:59.192543 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188945    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 15:13:59.192543 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.188947    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 15:13:59.193081 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191002    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 15:13:59.193081 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191014    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 15:13:59.193081 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191017    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 15:13:59.193081 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191020    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 15:13:59.193081 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191023    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 15:13:59.193081 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191026    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 15:13:59.193081 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191029    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 15:13:59.193081 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191032    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 15:13:59.193081 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191035    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 15:13:59.193081 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191038    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 15:13:59.193081 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191041    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 15:13:59.193081 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191044    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 15:13:59.193081 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191046    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 15:13:59.193081 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191049    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 15:13:59.193081 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191052    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 15:13:59.193081 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191056    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 15:13:59.193081 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191060    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 15:13:59.193081 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191063    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 15:13:59.193081 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191066    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 15:13:59.193081 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191068    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 15:13:59.193577 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191071    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 15:13:59.193577 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191075    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 15:13:59.193577 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191083    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 15:13:59.193577 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191086    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 15:13:59.193577 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191089    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 15:13:59.193577 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191092    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 15:13:59.193577 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191095    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 15:13:59.193577 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191098    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 15:13:59.193577 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191101    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 15:13:59.193577 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191104    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 15:13:59.193577 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191106    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 15:13:59.193577 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191109    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 15:13:59.193577 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191111    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 15:13:59.193577 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191115    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 15:13:59.193577 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191118    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 15:13:59.193577 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191120    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 15:13:59.193577 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191123    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 15:13:59.193577 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191126    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 15:13:59.193577 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191129    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 15:13:59.194048 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191131    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 15:13:59.194048 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191134    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 15:13:59.194048 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191136    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 15:13:59.194048 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191140    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 15:13:59.194048 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191143    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 15:13:59.194048 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191146    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 15:13:59.194048 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191149    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 15:13:59.194048 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191152    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 15:13:59.194048 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191155    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 15:13:59.194048 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191158    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 15:13:59.194048 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191160    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 15:13:59.194048 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191163    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 15:13:59.194048 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191165    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 15:13:59.194048 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191168    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 15:13:59.194048 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191171    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 15:13:59.194048 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191173    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 15:13:59.194048 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191176    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 15:13:59.194048 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191178    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 15:13:59.194048 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191181    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 15:13:59.194048 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191184    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 15:13:59.194533 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191186    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 15:13:59.194533 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191189    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 15:13:59.194533 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191193    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 15:13:59.194533 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191195    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 15:13:59.194533 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191198    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 15:13:59.194533 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191200    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 15:13:59.194533 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191206    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 15:13:59.194533 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191209    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 15:13:59.194533 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191211    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 15:13:59.194533 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191214    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 15:13:59.194533 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191216    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 15:13:59.194533 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191219    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 15:13:59.194533 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191222    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 15:13:59.194533 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191224    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 15:13:59.194533 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191227    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 15:13:59.194533 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191229    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 15:13:59.194533 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191232    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 15:13:59.194533 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191234    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 15:13:59.194533 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191237    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 15:13:59.194533 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191239    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 15:13:59.195059 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191242    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 15:13:59.195059 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191244    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 15:13:59.195059 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191247    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 15:13:59.195059 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191250    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 15:13:59.195059 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191254    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 15:13:59.195059 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191256    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 15:13:59.195059 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191259    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 15:13:59.195059 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191261    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 15:13:59.195059 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191264    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 15:13:59.195059 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191266    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 15:13:59.195059 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191269    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 15:13:59.195059 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191272    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 15:13:59.195059 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191274    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 15:13:59.195059 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191277    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 15:13:59.195059 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191279    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 15:13:59.195059 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191282    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 15:13:59.195059 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191284    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 15:13:59.195059 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191287    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 15:13:59.195059 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191291    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 15:13:59.195059 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191294    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 15:13:59.195536 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191362    2561 flags.go:64] FLAG: --address="0.0.0.0"
Jul 28 15:13:59.195536 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191369    2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 28 15:13:59.195536 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191376    2561 flags.go:64] FLAG: --anonymous-auth="true"
Jul 28 15:13:59.195536 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191381    2561 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 28 15:13:59.195536 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191385    2561 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 28 15:13:59.195536 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191388    2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 28 15:13:59.195536 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191392    2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 28 15:13:59.195536 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191396    2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 28 15:13:59.195536 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191399    2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 28 15:13:59.195536 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191402    2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 28 15:13:59.195536 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191406    2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 28 15:13:59.195536 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191409    2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 28 15:13:59.195536 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191412    2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 28 15:13:59.195536 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191416    2561 flags.go:64] FLAG: --cgroup-root=""
Jul 28 15:13:59.195536 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191418    2561 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 28 15:13:59.195536 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191422    2561 flags.go:64] FLAG: --client-ca-file=""
Jul 28 15:13:59.195536 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191424    2561 flags.go:64] FLAG: --cloud-provider="external"
Jul 28 15:13:59.195536 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191428    2561 flags.go:64] FLAG: --cluster-dns="[]"
Jul 28 15:13:59.195536 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191432    2561 flags.go:64] FLAG: --cluster-domain=""
Jul 28 15:13:59.195536 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191435    2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 28 15:13:59.195536 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191438    2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 28 15:13:59.195536 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191441    2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 28 15:13:59.195536 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191445    2561 flags.go:64] FLAG: --container-log-max-files="5"
Jul 28 15:13:59.195536 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191448    2561 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 28 15:13:59.196124 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191451    2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 28 15:13:59.196124 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191454    2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 28 15:13:59.196124 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191458    2561 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 28 15:13:59.196124 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191461    2561 flags.go:64] FLAG: --contention-profiling="false"
Jul 28 15:13:59.196124 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191464    2561 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 28 15:13:59.196124 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191467    2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 28 15:13:59.196124 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191472    2561 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 28 15:13:59.196124 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191475    2561 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 28 15:13:59.196124 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191479    2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 28 15:13:59.196124 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191482    2561 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 28 15:13:59.196124 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191485    2561 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 28 15:13:59.196124 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191488    2561 flags.go:64] FLAG: --enable-load-reader="false"
Jul 28 15:13:59.196124 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191491    2561 flags.go:64] FLAG: --enable-server="true"
Jul 28 15:13:59.196124 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191493    2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 28 15:13:59.196124 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191498    2561 flags.go:64] FLAG: --event-burst="100"
Jul 28 15:13:59.196124 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191501    2561 flags.go:64] FLAG: --event-qps="50"
Jul 28 15:13:59.196124 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191504    2561 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 28 15:13:59.196124 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191507    2561 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 28 15:13:59.196124 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191511    2561 flags.go:64] FLAG: --eviction-hard=""
Jul 28 15:13:59.196124 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191515    2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 28 15:13:59.196124 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191518    2561 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 28 15:13:59.196124 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191521    2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 28 15:13:59.196124 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191524    2561 flags.go:64] FLAG: --eviction-soft=""
Jul 28 15:13:59.196124 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191527    2561 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 28 15:13:59.196124 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191530    2561 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 28 15:13:59.196741 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191532    2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 28 15:13:59.196741 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191536    2561 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 28 15:13:59.196741 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191539    2561 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 28 15:13:59.196741 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191542    2561 flags.go:64] FLAG: --fail-swap-on="true"
Jul 28 15:13:59.196741 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191545    2561 flags.go:64] FLAG: --feature-gates=""
Jul 28 15:13:59.196741 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191549    2561 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 28 15:13:59.196741 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191552    2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 28 15:13:59.196741 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191555    2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 28 15:13:59.196741 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191558    2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 28 15:13:59.196741 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191561    2561 flags.go:64] FLAG: --healthz-port="10248"
Jul 28 15:13:59.196741 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191564    2561 flags.go:64] FLAG: --help="false"
Jul 28 15:13:59.196741 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191567    2561 flags.go:64] FLAG: --hostname-override="ip-10-0-143-125.ec2.internal"
Jul 28 15:13:59.196741 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191570    2561 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 28 15:13:59.196741 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191574    2561 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 28 15:13:59.196741 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191577    2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 28 15:13:59.196741 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191580    2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 28 15:13:59.196741 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191583    2561 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 28 15:13:59.196741 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191586    2561 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 28 15:13:59.196741 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191589    2561 flags.go:64] FLAG: --image-service-endpoint=""
Jul 28 15:13:59.196741 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191592    2561 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 28 15:13:59.196741 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191595    2561 flags.go:64] FLAG: --kube-api-burst="100"
Jul 28 15:13:59.196741 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191598    2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 28 15:13:59.196741 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191601    2561 flags.go:64] FLAG: --kube-api-qps="50"
Jul 28 15:13:59.196741 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191604    2561 flags.go:64] FLAG: --kube-reserved=""
Jul 28 15:13:59.197363 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191607    2561 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 28 15:13:59.197363 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191610    2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 28 15:13:59.197363 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191613    2561 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 28 15:13:59.197363 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191616    2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 28 15:13:59.197363 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191619    2561 flags.go:64] FLAG: --lock-file=""
Jul 28 15:13:59.197363 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191621    2561 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 28 15:13:59.197363 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191624    2561 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 28 15:13:59.197363 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191627    2561 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 28 15:13:59.197363 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191632    2561 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 28 15:13:59.197363 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191635    2561 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 28 15:13:59.197363 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191639    2561 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 28 15:13:59.197363 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191642    2561 flags.go:64] FLAG: --logging-format="text"
Jul 28 15:13:59.197363 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191645    2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 28 15:13:59.197363 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191648    2561 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 28 15:13:59.197363 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191651    2561 flags.go:64] FLAG: --manifest-url=""
Jul 28 15:13:59.197363 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191654    2561 flags.go:64] FLAG: --manifest-url-header=""
Jul 28 15:13:59.197363 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191658    2561 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 28 15:13:59.197363 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191661    2561 flags.go:64] FLAG: --max-open-files="1000000"
Jul 28 15:13:59.197363 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191668    2561 flags.go:64] FLAG: --max-pods="110"
Jul 28 15:13:59.197363 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191671    2561 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 28 15:13:59.197363 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191674    2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 28 15:13:59.197363 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191677    2561 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 28 15:13:59.197363 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191680    2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 28 15:13:59.197363 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191683    2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 28 15:13:59.197363 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191686    2561 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 28 15:13:59.197987 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191688    2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 28 15:13:59.197987 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191695    2561 flags.go:64] FLAG: --node-status-max-images="50"
Jul 28 15:13:59.197987 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191698    2561 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 28 15:13:59.197987 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191701    2561 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 28 15:13:59.197987 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191703    2561 flags.go:64] FLAG: --pod-cidr=""
Jul 28 15:13:59.197987 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191706    2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 28 15:13:59.197987 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191712    2561 flags.go:64] FLAG: --pod-manifest-path=""
Jul 28 15:13:59.197987 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191715    2561 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 28 15:13:59.197987 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191718    2561 flags.go:64] FLAG: --pods-per-core="0"
Jul 28 15:13:59.197987 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191722    2561 flags.go:64] FLAG: --port="10250"
Jul 28 15:13:59.197987 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191725    2561 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 28 15:13:59.197987 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191728    2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00f3ab2ad611e83dc"
Jul 28 15:13:59.197987 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191731    2561 flags.go:64] FLAG: --qos-reserved=""
Jul 28 15:13:59.197987 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191734    2561 flags.go:64] FLAG: --read-only-port="10255"
Jul 28 15:13:59.197987 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191737    2561 flags.go:64] FLAG: --register-node="true"
Jul 28 15:13:59.197987 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191739    2561 flags.go:64] FLAG: --register-with-taints=""
Jul 28 15:13:59.197987 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191743    2561 flags.go:64] FLAG: --registry-burst="10"
Jul 28 15:13:59.197987 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191746    2561 flags.go:64] FLAG: --registry-qps="5"
Jul 28 15:13:59.197987 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191749    2561 flags.go:64] FLAG: --reserved-cpus=""
Jul 28 15:13:59.197987 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191752    2561 flags.go:64] FLAG: --reserved-memory=""
Jul 28 15:13:59.197987 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191756    2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 28 15:13:59.197987 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191759    2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 28 15:13:59.197987 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191762    2561 flags.go:64] FLAG: --rotate-certificates="false"
Jul 28 15:13:59.197987 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191764    2561 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 28 15:13:59.197987 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191767    2561 flags.go:64] FLAG: --runonce="false"
Jul 28 15:13:59.198634 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191770    2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 28 15:13:59.198634 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191773    2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 28 15:13:59.198634 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191775    2561 flags.go:64] FLAG: --seccomp-default="false"
Jul 28 15:13:59.198634 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191778    2561 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 28 15:13:59.198634 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191781    2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 28 15:13:59.198634 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191784    2561 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 28 15:13:59.198634 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191787    2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 28 15:13:59.198634 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191790    2561 flags.go:64] FLAG: --storage-driver-password="root"
Jul 28 15:13:59.198634 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191793    2561 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 28 15:13:59.198634 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191796    2561 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 28 15:13:59.198634 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191799    2561 flags.go:64] FLAG: --storage-driver-user="root"
Jul 28 15:13:59.198634 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191802    2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 28 15:13:59.198634 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191805    2561 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 28 15:13:59.198634 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191807    2561 flags.go:64] FLAG: --system-cgroups=""
Jul 28 15:13:59.198634 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191810    2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 28 15:13:59.198634 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191816    2561 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 28 15:13:59.198634 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191821    2561 flags.go:64] FLAG: --tls-cert-file=""
Jul 28 15:13:59.198634 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191840    2561 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 28 15:13:59.198634 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191844    2561 flags.go:64] FLAG: --tls-min-version=""
Jul 28 15:13:59.198634 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191847    2561 flags.go:64] FLAG: --tls-private-key-file=""
Jul 28 15:13:59.198634 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191850    2561 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 28 15:13:59.198634 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191853    2561 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 28 15:13:59.198634 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191856    2561 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 28 15:13:59.198634 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191858    2561 flags.go:64] FLAG: --v="2"
Jul 28 15:13:59.198634 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191863    2561 flags.go:64] FLAG: --version="false"
Jul 28 15:13:59.199255 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191868    2561 flags.go:64] FLAG: --vmodule=""
Jul 28 15:13:59.199255 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191872    2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 28 15:13:59.199255 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.191876    2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 28 15:13:59.199255 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191985    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 15:13:59.199255 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191988    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 15:13:59.199255 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191992    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 15:13:59.199255 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191995    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 15:13:59.199255 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.191998    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 15:13:59.199255 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192001    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 15:13:59.199255 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192003    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 15:13:59.199255 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192006    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 15:13:59.199255 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192009    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 15:13:59.199255 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192012    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 15:13:59.199255 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192014    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 15:13:59.199255 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192018    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 15:13:59.199255 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192022    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 15:13:59.199255 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192025    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 15:13:59.199255 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192028    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 15:13:59.199255 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192030    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 15:13:59.199711 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192034    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 15:13:59.199711 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192036    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 15:13:59.199711 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192039    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 15:13:59.199711 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192042    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 15:13:59.199711 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192046    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 15:13:59.199711 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192049    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 15:13:59.199711 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192051    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 15:13:59.199711 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192054    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 15:13:59.199711 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192057    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 15:13:59.199711 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192059    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 15:13:59.199711 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192062    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 15:13:59.199711 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192065    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 15:13:59.199711 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192067    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 15:13:59.199711 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192070    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 15:13:59.199711 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192073    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 15:13:59.199711 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192079    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 15:13:59.199711 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192081    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 15:13:59.199711 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192084    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 15:13:59.199711 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192088    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 15:13:59.199711 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192091    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 15:13:59.200218 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192094    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 15:13:59.200218 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192097    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 15:13:59.200218 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192099    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 15:13:59.200218 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192102    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 15:13:59.200218 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192104    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 15:13:59.200218 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192108    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 15:13:59.200218 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192110    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 15:13:59.200218 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192113    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 15:13:59.200218 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192115    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 15:13:59.200218 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192118    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 15:13:59.200218 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192120    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 15:13:59.200218 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192123    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 15:13:59.200218 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192125    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 15:13:59.200218 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192128    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 15:13:59.200218 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192131    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 15:13:59.200218 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192133    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 15:13:59.200218 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192138    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 15:13:59.200218 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192140    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 15:13:59.200218 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192143    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 15:13:59.200218 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192146    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 15:13:59.200708 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192149    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 15:13:59.200708 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192151    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 15:13:59.200708 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192154    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 15:13:59.200708 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192157    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 15:13:59.200708 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192160    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 15:13:59.200708 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192164    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 15:13:59.200708 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192167    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 15:13:59.200708 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192170    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 15:13:59.200708 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192173    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 15:13:59.200708 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192176    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 15:13:59.200708 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192180    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 15:13:59.200708 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192183    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 15:13:59.200708 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192185    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 15:13:59.200708 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192188    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 15:13:59.200708 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192191    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 15:13:59.200708 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192193    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 15:13:59.200708 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192196    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 15:13:59.200708 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192198    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 15:13:59.200708 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192201    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 15:13:59.200708 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192203    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 15:13:59.201219 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192206    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 15:13:59.201219 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192208    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 15:13:59.201219 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192210    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 15:13:59.201219 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192214    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 15:13:59.201219 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192218    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 15:13:59.201219 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192221    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 15:13:59.201219 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192224    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 15:13:59.201219 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192227    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 15:13:59.201219 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192231    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 15:13:59.201219 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192234    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 15:13:59.201219 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192237    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 15:13:59.201219 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192240    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 15:13:59.201219 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192243    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 15:13:59.201219 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192245    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 15:13:59.201219 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192248    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 15:13:59.201219 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192251    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 15:13:59.201219 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192254    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 15:13:59.201219 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192256    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 15:13:59.201219 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192259    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 15:13:59.201219 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192261    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 15:13:59.201706 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192264    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 15:13:59.201706 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192268    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 15:13:59.201706 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.192272    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 15:13:59.201706 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.192796    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 15:13:59.201706 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.199639    2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 28 15:13:59.201706 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.199655    2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 28 15:13:59.201706 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.199675    2561 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 28 15:13:59.201706 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.199681    2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 28 15:13:59.201706 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199738    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 15:13:59.201706 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199743    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 15:13:59.201706 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199747    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 15:13:59.201706 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199750    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 15:13:59.201706 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199754    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 15:13:59.201706 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199757    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 15:13:59.201706 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199759    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 15:13:59.202095 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199762    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 15:13:59.202095 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199765    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 15:13:59.202095 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199769    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 15:13:59.202095 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199772    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 15:13:59.202095 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199775    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 15:13:59.202095 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199779    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 15:13:59.202095 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199782    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 15:13:59.202095 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199785    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 15:13:59.202095 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199787    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 15:13:59.202095 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199790    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 15:13:59.202095 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199792    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 15:13:59.202095 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199795    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 15:13:59.202095 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199797    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 15:13:59.202095 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199800    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 15:13:59.202095 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199802    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 15:13:59.202095 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199805    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 15:13:59.202095 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199807    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 15:13:59.202095 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199810    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 15:13:59.202095 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199813    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 15:13:59.202549 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199816    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 15:13:59.202549 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199818    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 15:13:59.202549 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199837    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 15:13:59.202549 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199842    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 15:13:59.202549 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199846    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 15:13:59.202549 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199848    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 15:13:59.202549 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199851    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 15:13:59.202549 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199854    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 15:13:59.202549 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199856    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 15:13:59.202549 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199859    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 15:13:59.202549 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199862    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 15:13:59.202549 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199864    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 15:13:59.202549 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199867    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 15:13:59.202549 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199869    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 15:13:59.202549 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199872    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 15:13:59.202549 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199874    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 15:13:59.202549 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199877    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 15:13:59.202549 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199879    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 15:13:59.202549 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199882    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 15:13:59.202549 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199885    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 15:13:59.203046 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199887    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 15:13:59.203046 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199891    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 15:13:59.203046 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199895    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 15:13:59.203046 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199898    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 15:13:59.203046 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199900    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 15:13:59.203046 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199903    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 15:13:59.203046 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199905    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 15:13:59.203046 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199908    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 15:13:59.203046 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199911    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 15:13:59.203046 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199913    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 15:13:59.203046 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199916    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 15:13:59.203046 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199919    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 15:13:59.203046 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199921    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 15:13:59.203046 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199924    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 15:13:59.203046 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199927    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 15:13:59.203046 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199930    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 15:13:59.203046 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199934    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 15:13:59.203046 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199937    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 15:13:59.203046 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199939    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 15:13:59.203046 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199942    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 15:13:59.203536 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199944    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 15:13:59.203536 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199947    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 15:13:59.203536 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199949    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 15:13:59.203536 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199951    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 15:13:59.203536 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199954    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 15:13:59.203536 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199957    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 15:13:59.203536 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199959    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 15:13:59.203536 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199962    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 15:13:59.203536 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199964    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 15:13:59.203536 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199967    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 15:13:59.203536 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199969    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 15:13:59.203536 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199972    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 15:13:59.203536 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199974    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 15:13:59.203536 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199977    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 15:13:59.203536 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199980    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 15:13:59.203536 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199982    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 15:13:59.203536 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199984    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 15:13:59.203536 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199987    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 15:13:59.203536 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199990    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 15:13:59.203536 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199993    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 15:13:59.204048 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199995    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 15:13:59.204048 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.199998    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 15:13:59.204048 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200000    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 15:13:59.204048 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200003    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 15:13:59.204048 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200005    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 15:13:59.204048 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200008    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 15:13:59.204048 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200011    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 15:13:59.204048 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200015    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 15:13:59.204048 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200018    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 15:13:59.204048 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200021    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 15:13:59.204048 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200024    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 15:13:59.204048 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200028    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 15:13:59.204048 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200030    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 15:13:59.204048 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.200036    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 15:13:59.204048 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200149    2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 28 15:13:59.204416 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200154    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 28 15:13:59.204416 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200157    2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 28 15:13:59.204416 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200159    2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 28 15:13:59.204416 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200162    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 28 15:13:59.204416 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200165    2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 28 15:13:59.204416 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200168    2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 28 15:13:59.204416 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200170    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 28 15:13:59.204416 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200174    2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 28 15:13:59.204416 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200176    2561 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 28 15:13:59.204416 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200179    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 28 15:13:59.204416 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200182    2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 28 15:13:59.204416 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200185    2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 28 15:13:59.204416 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200187    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 28 15:13:59.204416 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200190    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 28 15:13:59.204416 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200192    2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 28 15:13:59.204416 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200196    2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 28 15:13:59.204416 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200198    2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 28 15:13:59.204416 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200201    2561 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 28 15:13:59.204416 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200203    2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 28 15:13:59.204416 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200206    2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 28 15:13:59.204916 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200208    2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 28 15:13:59.204916 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200211    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 28 15:13:59.204916 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200214    2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 28 15:13:59.204916 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200217    2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 28 15:13:59.204916 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200219    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 28 15:13:59.204916 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200222    2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 28 15:13:59.204916 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200226    2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 28 15:13:59.204916 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200231    2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 28 15:13:59.204916 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200234    2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 28 15:13:59.204916 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200237    2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 28 15:13:59.204916 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200239    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 28 15:13:59.204916 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200242    2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 28 15:13:59.204916 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200245    2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 28 15:13:59.204916 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200247    2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 28 15:13:59.204916 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200250    2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 28 15:13:59.204916 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200252    2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 28 15:13:59.204916 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200254    2561 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 28 15:13:59.204916 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200257    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 28 15:13:59.204916 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200259    2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 28 15:13:59.205372 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200262    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 28 15:13:59.205372 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200265    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 28 15:13:59.205372 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200267    2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 28 15:13:59.205372 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200270    2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 28 15:13:59.205372 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200272    2561 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 28 15:13:59.205372 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200275    2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 28 15:13:59.205372 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200277    2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 28 15:13:59.205372 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200281    2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 28 15:13:59.205372 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200284    2561 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 28 15:13:59.205372 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200287    2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 28 15:13:59.205372 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200290    2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 28 15:13:59.205372 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200292    2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 28 15:13:59.205372 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200295    2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 28 15:13:59.205372 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200298    2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 28 15:13:59.205372 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200301    2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 28 15:13:59.205372 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200303    2561 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 28 15:13:59.205372 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200306    2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 28 15:13:59.205372 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200308    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 28 15:13:59.205372 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200311    2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 28 15:13:59.205372 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200314    2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 28 15:13:59.205883 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200316    2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 28 15:13:59.205883 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200323    2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 28 15:13:59.205883 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200325    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 28 15:13:59.205883 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200328    2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 28 15:13:59.205883 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200330    2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 28 15:13:59.205883 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200334    2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 28 15:13:59.205883 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200337    2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 28 15:13:59.205883 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200340    2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 28 15:13:59.205883 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200343    2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 28 15:13:59.205883 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200346    2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 28 15:13:59.205883 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200349    2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 28 15:13:59.205883 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200351    2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 28 15:13:59.205883 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200353    2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 28 15:13:59.205883 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200356    2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 28 15:13:59.205883 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200359    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 28 15:13:59.205883 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200361    2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 28 15:13:59.205883 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200364    2561 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 28 15:13:59.205883 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200366    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 28 15:13:59.205883 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200369    2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 28 15:13:59.206343 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200371    2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 28 15:13:59.206343 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200374    2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 28 15:13:59.206343 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200376    2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 28 15:13:59.206343 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200379    2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 28 15:13:59.206343 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200381    2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 28 15:13:59.206343 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200384    2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 28 15:13:59.206343 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200387    2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 28 15:13:59.206343 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200406    2561 feature_gate.go:328] unrecognized feature gate: Example
Jul 28 15:13:59.206343 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200409    2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 28 15:13:59.206343 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200413    2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 28 15:13:59.206343 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200417    2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 28 15:13:59.206343 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200420    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 28 15:13:59.206343 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200423    2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 28 15:13:59.206343 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200426    2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 28 15:13:59.206343 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200428    2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 28 15:13:59.206343 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200432    2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 28 15:13:59.206343 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200435    2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 28 15:13:59.206343 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200437    2561 feature_gate.go:328] unrecognized feature gate: Example2
Jul 28 15:13:59.206343 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200440    2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 28 15:13:59.206343 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:13:59.200443    2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 28 15:13:59.206840 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.200447    2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 28 15:13:59.206840 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.200557    2561 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 28 15:13:59.206840 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.202565    2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 28 15:13:59.206840 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.203731    2561 server.go:1019] "Starting client certificate rotation"
Jul 28 15:13:59.206840 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.203842    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 15:13:59.206840 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.204518    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 28 15:13:59.206840 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.205974    2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 15:13:59.207910 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.207851    2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 28 15:13:59.218238 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.218213    2561 log.go:25] "Validated CRI v1 runtime API"
Jul 28 15:13:59.220325 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.220308    2561 log.go:25] "Validated CRI v1 image API"
Jul 28 15:13:59.221158 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.221143    2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 28 15:13:59.224387 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.224365    2561 fs.go:135] Filesystem UUIDs: map[48cd8a1c-573d-4c9c-9d4f-5d8f5c14f2cc:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 87e6c020-7d08-4432-8330-9d0ab8129fd2:/dev/nvme0n1p3]
Jul 28 15:13:59.224464 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.224385    2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 28 15:13:59.230029 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.230010    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 15:13:59.230319 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.230211    2561 manager.go:216] Machine: {Timestamp:2026-07-28 15:13:59.228999853 +0000 UTC m=+0.279367949 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3105723 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2cb09988f8f33fa71e3a1de68671f0 SystemUUID:ec2cb099-88f8-f33f-a71e-3a1de68671f0 BootID:44dff721-af7f-49a7-b59e-47dec5171fe7 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:99:8b:70:60:0d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:99:8b:70:60:0d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ea:4d:27:c6:61:06 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 28 15:13:59.230319 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.230314    2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 28 15:13:59.230447 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.230430    2561 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 28 15:13:59.233012 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.232978    2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 28 15:13:59.233208 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.233014    2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-125.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 28 15:13:59.233771 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.233759    2561 topology_manager.go:138] "Creating topology manager with none policy"
Jul 28 15:13:59.233839 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.233775    2561 container_manager_linux.go:309] "Creating device plugin manager"
Jul 28 15:13:59.233839 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.233786    2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 15:13:59.234418 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.234406    2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 28 15:13:59.235325 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.235313    2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 28 15:13:59.238031 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.238017    2561 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 15:13:59.238172 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.238162    2561 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 28 15:13:59.238239 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.238200    2561 kubelet.go:486] "Attempting to sync node with API server"
Jul 28 15:13:59.238239 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.238214    2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 28 15:13:59.238239 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.238234    2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 28 15:13:59.238360 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.238247    2561 kubelet.go:398] "Adding apiserver pod source"
Jul 28 15:13:59.238360 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.238261    2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 28 15:13:59.238649 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.238634    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 15:13:59.238716 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.238656    2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 28 15:13:59.241233 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.241213    2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 28 15:13:59.243073 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.243060    2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 28 15:13:59.243118 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.243089    2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 28 15:13:59.244669 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.244626    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 28 15:13:59.244669 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.244641    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 28 15:13:59.244669 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.244647    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 28 15:13:59.244669 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.244653    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 28 15:13:59.244669 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.244663    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 28 15:13:59.244669 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.244671    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 28 15:13:59.244882 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.244682    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 28 15:13:59.244882 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.244689    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 28 15:13:59.244882 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.244696    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 28 15:13:59.244882 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.244702    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 28 15:13:59.244882 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.244722    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 28 15:13:59.244882 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.244728    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 28 15:13:59.245415 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.245399    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 28 15:13:59.245464 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.245431    2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 28 15:13:59.247310 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.247288    2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-125.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 28 15:13:59.247474 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:13:59.247441    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-125.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 28 15:13:59.247812 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:13:59.247792    2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 28 15:13:59.248897 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.248883    2561 server.go:1268] "Started kubelet"
Jul 28 15:13:59.249001 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.248949    2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 28 15:13:59.249053 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.249029    2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 28 15:13:59.249489 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.249075    2561 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 28 15:13:59.249829 ip-10-0-143-125 systemd[1]: Started Kubernetes Kubelet.
Jul 28 15:13:59.251177 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.251159    2561 server.go:310] "Adding debug handlers to kubelet server"
Jul 28 15:13:59.251268 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.251253    2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 28 15:13:59.253862 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:13:59.253842    2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 28 15:13:59.254719 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:13:59.253782    2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-125.ec2.internal.18c67ce8401c9b50  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-125.ec2.internal,UID:ip-10-0-143-125.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-125.ec2.internal,},FirstTimestamp:2026-07-28 15:13:59.24885384 +0000 UTC m=+0.299221939,LastTimestamp:2026-07-28 15:13:59.24885384 +0000 UTC m=+0.299221939,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-125.ec2.internal,}"
Jul 28 15:13:59.255585 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.255567    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gq564"
Jul 28 15:13:59.258413 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.258397    2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 28 15:13:59.258485 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.258417    2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 28 15:13:59.258540 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:13:59.258494    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-125.ec2.internal\" not found"
Jul 28 15:13:59.259489 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.259150    2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 28 15:13:59.259489 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.259414    2561 factory.go:55] Registering systemd factory
Jul 28 15:13:59.259489 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.259431    2561 factory.go:223] Registration of the systemd container factory successfully
Jul 28 15:13:59.259796 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.259501    2561 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 28 15:13:59.259796 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.259516    2561 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 28 15:13:59.259796 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.259693    2561 reconstruct.go:97] "Volume reconstruction finished"
Jul 28 15:13:59.259796 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.259701    2561 reconciler.go:29] "Reconciler: start to sync state"
Jul 28 15:13:59.259796 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.259731    2561 factory.go:153] Registering CRI-O factory
Jul 28 15:13:59.259796 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.259749    2561 factory.go:223] Registration of the crio container factory successfully
Jul 28 15:13:59.260239 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.259822    2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 28 15:13:59.260239 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.259874    2561 factory.go:103] Registering Raw factory
Jul 28 15:13:59.260239 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.259889    2561 manager.go:1196] Started watching for new ooms in manager
Jul 28 15:13:59.260616 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.260590    2561 manager.go:349] Starting recovery of all containers
Jul 28 15:13:59.266565 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.266541    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gq564"
Jul 28 15:13:59.273464 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.273445    2561 manager.go:354] Recovery completed
Jul 28 15:13:59.275712 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.275695    2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 15:13:59.278330 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.278317    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 15:13:59.279464 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:13:59.279446    2561 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-143-125.ec2.internal\" not found" node="ip-10-0-143-125.ec2.internal"
Jul 28 15:13:59.280231 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.280215    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-125.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 15:13:59.280323 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.280242    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-125.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 15:13:59.280323 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.280253    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-125.ec2.internal" event="NodeHasSufficientPID"
Jul 28 15:13:59.280929 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.280913    2561 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 28 15:13:59.280929 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.280922    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 15:13:59.281083 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.280938    2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 28 15:13:59.281083 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.280959    2561 state_mem.go:36] "Initialized new in-memory state store"
Jul 28 15:13:59.282686 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.281837    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-125.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 15:13:59.282686 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.281873    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-125.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 15:13:59.282686 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.281887    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-125.ec2.internal" event="NodeHasSufficientPID"
Jul 28 15:13:59.283896 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.283878    2561 policy_none.go:49] "None policy: Start"
Jul 28 15:13:59.283981 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.283913    2561 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 28 15:13:59.283981 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.283926    2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 28 15:13:59.286105 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.286093    2561 policy_none.go:47] "Start"
Jul 28 15:13:59.321696 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.321514    2561 manager.go:337] "Starting Device Plugin manager"
Jul 28 15:13:59.321809 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:13:59.321719    2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 28 15:13:59.321809 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.321736    2561 server.go:87] "Starting device plugin registration server"
Jul 28 15:13:59.322010 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.321995    2561 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 28 15:13:59.322057 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.322013    2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 28 15:13:59.322116 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.322100    2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 28 15:13:59.322230 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.322184    2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 28 15:13:59.322230 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.322199    2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 28 15:13:59.322801 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:13:59.322775    2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 28 15:13:59.322897 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:13:59.322827    2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-125.ec2.internal\" not found"
Jul 28 15:13:59.403203 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.403168    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 28 15:13:59.405525 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.404478    2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 28 15:13:59.405525 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.404514    2561 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 28 15:13:59.405525 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.404538    2561 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 28 15:13:59.405525 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:13:59.404579    2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 28 15:13:59.407668 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.407648    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 15:13:59.422486 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.422471    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 15:13:59.423386 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.423370    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-125.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 15:13:59.423457 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.423400    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-125.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 15:13:59.423457 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.423417    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-125.ec2.internal" event="NodeHasSufficientPID"
Jul 28 15:13:59.423457 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.423451    2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-125.ec2.internal"
Jul 28 15:13:59.433888 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.433844    2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-125.ec2.internal"
Jul 28 15:13:59.433888 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:13:59.433866    2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-125.ec2.internal\": node \"ip-10-0-143-125.ec2.internal\" not found"
Jul 28 15:13:59.450493 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:13:59.450472    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-125.ec2.internal\" not found"
Jul 28 15:13:59.507189 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.507155    2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-125.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-125.ec2.internal"]
Jul 28 15:13:59.507313 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.507244    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 15:13:59.508210 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.508192    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-125.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 15:13:59.508290 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.508224    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-125.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 15:13:59.508290 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.508235    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-125.ec2.internal" event="NodeHasSufficientPID"
Jul 28 15:13:59.510771 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.510757    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 15:13:59.510924 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.510908    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-125.ec2.internal"
Jul 28 15:13:59.510970 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.510940    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 15:13:59.511533 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.511516    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-125.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 15:13:59.511603 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.511545    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-125.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 15:13:59.511603 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.511556    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-125.ec2.internal" event="NodeHasSufficientPID"
Jul 28 15:13:59.512103 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.512088    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-125.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 15:13:59.512171 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.512112    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-125.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 15:13:59.512171 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.512127    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-125.ec2.internal" event="NodeHasSufficientPID"
Jul 28 15:13:59.513946 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.513932    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-125.ec2.internal"
Jul 28 15:13:59.513997 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.513957    2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 28 15:13:59.514611 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.514596    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-125.ec2.internal" event="NodeHasSufficientMemory"
Jul 28 15:13:59.514686 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.514626    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-125.ec2.internal" event="NodeHasNoDiskPressure"
Jul 28 15:13:59.514686 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.514637    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-125.ec2.internal" event="NodeHasSufficientPID"
Jul 28 15:13:59.536691 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:13:59.536665    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-125.ec2.internal\" not found" node="ip-10-0-143-125.ec2.internal"
Jul 28 15:13:59.541223 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:13:59.541205    2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-125.ec2.internal\" not found" node="ip-10-0-143-125.ec2.internal"
Jul 28 15:13:59.550592 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:13:59.550574    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-125.ec2.internal\" not found"
Jul 28 15:13:59.560964 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.560944    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/15fb43c0c3be2d4b2fc124f01e5795dd-config\") pod \"kube-apiserver-proxy-ip-10-0-143-125.ec2.internal\" (UID: \"15fb43c0c3be2d4b2fc124f01e5795dd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-125.ec2.internal"
Jul 28 15:13:59.561031 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.560971    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/693b917588309c87173dc513569db3fd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-125.ec2.internal\" (UID: \"693b917588309c87173dc513569db3fd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-125.ec2.internal"
Jul 28 15:13:59.561031 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.560996    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/693b917588309c87173dc513569db3fd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-125.ec2.internal\" (UID: \"693b917588309c87173dc513569db3fd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-125.ec2.internal"
Jul 28 15:13:59.651136 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:13:59.651108    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-125.ec2.internal\" not found"
Jul 28 15:13:59.661219 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.661199    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/693b917588309c87173dc513569db3fd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-125.ec2.internal\" (UID: \"693b917588309c87173dc513569db3fd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-125.ec2.internal"
Jul 28 15:13:59.661288 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.661225    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/693b917588309c87173dc513569db3fd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-125.ec2.internal\" (UID: \"693b917588309c87173dc513569db3fd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-125.ec2.internal"
Jul 28 15:13:59.661288 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.661244    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/15fb43c0c3be2d4b2fc124f01e5795dd-config\") pod \"kube-apiserver-proxy-ip-10-0-143-125.ec2.internal\" (UID: \"15fb43c0c3be2d4b2fc124f01e5795dd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-125.ec2.internal"
Jul 28 15:13:59.661288 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.661278    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/15fb43c0c3be2d4b2fc124f01e5795dd-config\") pod \"kube-apiserver-proxy-ip-10-0-143-125.ec2.internal\" (UID: \"15fb43c0c3be2d4b2fc124f01e5795dd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-125.ec2.internal"
Jul 28 15:13:59.661388 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.661292    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/693b917588309c87173dc513569db3fd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-125.ec2.internal\" (UID: \"693b917588309c87173dc513569db3fd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-125.ec2.internal"
Jul 28 15:13:59.661388 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.661321    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/693b917588309c87173dc513569db3fd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-125.ec2.internal\" (UID: \"693b917588309c87173dc513569db3fd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-125.ec2.internal"
Jul 28 15:13:59.751321 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:13:59.751250    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-125.ec2.internal\" not found"
Jul 28 15:13:59.841196 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.841164    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-125.ec2.internal"
Jul 28 15:13:59.844514 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:13:59.844495    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-125.ec2.internal"
Jul 28 15:13:59.852128 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:13:59.852109    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-125.ec2.internal\" not found"
Jul 28 15:13:59.956343 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:13:59.956306    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-125.ec2.internal\" not found"
Jul 28 15:14:00.062577 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:00.062495    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-125.ec2.internal\" not found"
Jul 28 15:14:00.070944 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:00.070914    2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 15:14:00.163499 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:00.163458    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-125.ec2.internal\" not found"
Jul 28 15:14:00.204391 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:00.204361    2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 28 15:14:00.204857 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:00.204521    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 28 15:14:00.204857 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:00.204560    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 28 15:14:00.204857 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:00.204569    2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 28 15:14:00.264035 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:00.264006    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-125.ec2.internal\" not found"
Jul 28 15:14:00.273462 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:00.273433    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 15:08:59 +0000 UTC" deadline="2028-02-14 05:07:32.924358268 +0000 UTC"
Jul 28 15:14:00.273462 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:00.273458    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13573h53m32.650905027s"
Jul 28 15:14:00.364337 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:00.364271    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-125.ec2.internal\" not found"
Jul 28 15:14:00.464414 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:00.464360    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-125.ec2.internal\" not found"
Jul 28 15:14:00.518587 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:14:00.518547    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15fb43c0c3be2d4b2fc124f01e5795dd.slice/crio-c6f2ddba3e9539f59be505943f2a75c8d956b2816c13554dbb120be3c2d72a8e WatchSource:0}: Error finding container c6f2ddba3e9539f59be505943f2a75c8d956b2816c13554dbb120be3c2d72a8e: Status 404 returned error can't find the container with id c6f2ddba3e9539f59be505943f2a75c8d956b2816c13554dbb120be3c2d72a8e
Jul 28 15:14:00.518880 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:14:00.518848    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod693b917588309c87173dc513569db3fd.slice/crio-c73f5ce40e5e8735ded6315664fd2dd988430ca6c91e325229c948f6f5e07459 WatchSource:0}: Error finding container c73f5ce40e5e8735ded6315664fd2dd988430ca6c91e325229c948f6f5e07459: Status 404 returned error can't find the container with id c73f5ce40e5e8735ded6315664fd2dd988430ca6c91e325229c948f6f5e07459
Jul 28 15:14:00.525248 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:00.525232    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 15:14:00.564898 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:00.564868    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-125.ec2.internal\" not found"
Jul 28 15:14:00.665123 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:00.665051    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-125.ec2.internal\" not found"
Jul 28 15:14:00.765147 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:00.765104    2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-125.ec2.internal\" not found"
Jul 28 15:14:00.811967 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:00.811946    2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 15:14:00.859436 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:00.859397    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-125.ec2.internal"
Jul 28 15:14:00.870882 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:00.870863    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 15:14:00.871711 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:00.871698    2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-125.ec2.internal"
Jul 28 15:14:00.882504 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:00.882480    2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 28 15:14:01.239913 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.239877    2561 apiserver.go:52] "Watching apiserver"
Jul 28 15:14:01.249757 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.249554    2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 28 15:14:01.250084 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.250055    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-hvlq9","openshift-network-operator/iptables-alerter-ncczz","openshift-ovn-kubernetes/ovnkube-node-zrkfd","kube-system/global-pull-secret-syncer-qpvsz","kube-system/konnectivity-agent-drg4d","openshift-cluster-node-tuning-operator/tuned-r6ngg","openshift-dns/node-resolver-lv5xt","openshift-image-registry/node-ca-d85z2","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-125.ec2.internal","openshift-network-diagnostics/network-check-target-mds5d","kube-system/kube-apiserver-proxy-ip-10-0-143-125.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wts9","openshift-multus/multus-additional-cni-plugins-lrwfs","openshift-multus/multus-mh4nm"]
Jul 28 15:14:01.253360 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.253057    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lv5xt"
Jul 28 15:14:01.256248 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.256226    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lrwfs"
Jul 28 15:14:01.257674 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.257243    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-p6p5k\""
Jul 28 15:14:01.257674 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.257478    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 28 15:14:01.257674 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.257539    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 28 15:14:01.258026 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.257847    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.260128 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.259673    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 28 15:14:01.260128 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.259958    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-nl2fs\""
Jul 28 15:14:01.261358 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.260531    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 28 15:14:01.261358 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.260661    2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 28 15:14:01.261358 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.261307    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpvsz"
Jul 28 15:14:01.261564 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:01.261381    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qpvsz" podUID="20741b19-0b49-488f-86cc-c974cd83fe30"
Jul 28 15:14:01.263320 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.262102    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 28 15:14:01.263320 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.262374    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 28 15:14:01.263320 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.262556    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 28 15:14:01.263320 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.262735    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 28 15:14:01.263320 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.262963    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 28 15:14:01.263320 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.263195    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 28 15:14:01.264186 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.264011    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-drg4d"
Jul 28 15:14:01.264561 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.264538    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 28 15:14:01.264952 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.264932    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rjmkc\""
Jul 28 15:14:01.265051 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.265005    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 28 15:14:01.265231 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.265172    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 28 15:14:01.265635 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.265614    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r6ngg"
Jul 28 15:14:01.266942 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.266675    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 28 15:14:01.268927 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.268547    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 28 15:14:01.271044 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.269382    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lh87s\""
Jul 28 15:14:01.271044 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.269926    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.271044 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.270129    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 28 15:14:01.271044 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.270286    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-d6zhh\""
Jul 28 15:14:01.271044 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.270785    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 28 15:14:01.271385 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.271092    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzgs8\" (UniqueName: \"kubernetes.io/projected/8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0-kube-api-access-jzgs8\") pod \"multus-additional-cni-plugins-lrwfs\" (UID: \"8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0\") " pod="openshift-multus/multus-additional-cni-plugins-lrwfs"
Jul 28 15:14:01.271385 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.271133    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2a40e45d-440d-4f88-8dc9-3047798a5239-host-run-netns\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.271385 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.271169    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/43c0a413-1cee-48b4-9c69-e7a5429dcc89-hosts-file\") pod \"node-resolver-lv5xt\" (UID: \"43c0a413-1cee-48b4-9c69-e7a5429dcc89\") " pod="openshift-dns/node-resolver-lv5xt"
Jul 28 15:14:01.271385 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.271195    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lrwfs\" (UID: \"8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0\") " pod="openshift-multus/multus-additional-cni-plugins-lrwfs"
Jul 28 15:14:01.271385 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.271229    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lrwfs\" (UID: \"8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0\") " pod="openshift-multus/multus-additional-cni-plugins-lrwfs"
Jul 28 15:14:01.271385 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.271263    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2a40e45d-440d-4f88-8dc9-3047798a5239-node-log\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.271385 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.271292    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2a40e45d-440d-4f88-8dc9-3047798a5239-env-overrides\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.271385 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.271322    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bd8af8c2-2c6b-4dbe-8bcf-e3d908de7bbe-agent-certs\") pod \"konnectivity-agent-drg4d\" (UID: \"bd8af8c2-2c6b-4dbe-8bcf-e3d908de7bbe\") " pod="kube-system/konnectivity-agent-drg4d"
Jul 28 15:14:01.271385 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.271349    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0-os-release\") pod \"multus-additional-cni-plugins-lrwfs\" (UID: \"8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0\") " pod="openshift-multus/multus-additional-cni-plugins-lrwfs"
Jul 28 15:14:01.271878 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.271476    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2a40e45d-440d-4f88-8dc9-3047798a5239-ovnkube-config\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.271878 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.271532    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlrrp\" (UniqueName: \"kubernetes.io/projected/2a40e45d-440d-4f88-8dc9-3047798a5239-kube-api-access-hlrrp\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.271878 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.271569    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mxw5\" (UniqueName: \"kubernetes.io/projected/43c0a413-1cee-48b4-9c69-e7a5429dcc89-kube-api-access-2mxw5\") pod \"node-resolver-lv5xt\" (UID: \"43c0a413-1cee-48b4-9c69-e7a5429dcc89\") " pod="openshift-dns/node-resolver-lv5xt"
Jul 28 15:14:01.271878 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.271602    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2a40e45d-440d-4f88-8dc9-3047798a5239-ovn-node-metrics-cert\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.271878 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.271646    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/20741b19-0b49-488f-86cc-c974cd83fe30-dbus\") pod \"global-pull-secret-syncer-qpvsz\" (UID: \"20741b19-0b49-488f-86cc-c974cd83fe30\") " pod="kube-system/global-pull-secret-syncer-qpvsz"
Jul 28 15:14:01.271878 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.271692    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20741b19-0b49-488f-86cc-c974cd83fe30-original-pull-secret\") pod \"global-pull-secret-syncer-qpvsz\" (UID: \"20741b19-0b49-488f-86cc-c974cd83fe30\") " pod="kube-system/global-pull-secret-syncer-qpvsz"
Jul 28 15:14:01.271878 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.271729    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a40e45d-440d-4f88-8dc9-3047798a5239-run-openvswitch\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.271878 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.271772    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2a40e45d-440d-4f88-8dc9-3047798a5239-run-ovn\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.271878 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.271810    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2a40e45d-440d-4f88-8dc9-3047798a5239-host-cni-bin\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.271878 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.271840    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2a40e45d-440d-4f88-8dc9-3047798a5239-host-cni-netd\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.271878 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.271879    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0-cni-binary-copy\") pod \"multus-additional-cni-plugins-lrwfs\" (UID: \"8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0\") " pod="openshift-multus/multus-additional-cni-plugins-lrwfs"
Jul 28 15:14:01.272521 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.272411    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lrwfs\" (UID: \"8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0\") " pod="openshift-multus/multus-additional-cni-plugins-lrwfs"
Jul 28 15:14:01.272521 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.272447    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a40e45d-440d-4f88-8dc9-3047798a5239-host-kubelet\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.272521 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.272505    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/20741b19-0b49-488f-86cc-c974cd83fe30-kubelet-config\") pod \"global-pull-secret-syncer-qpvsz\" (UID: \"20741b19-0b49-488f-86cc-c974cd83fe30\") " pod="kube-system/global-pull-secret-syncer-qpvsz"
Jul 28 15:14:01.272728 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.272542    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0-cnibin\") pod \"multus-additional-cni-plugins-lrwfs\" (UID: \"8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0\") " pod="openshift-multus/multus-additional-cni-plugins-lrwfs"
Jul 28 15:14:01.272728 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.272576    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2a40e45d-440d-4f88-8dc9-3047798a5239-systemd-units\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.272728 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.272608    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2a40e45d-440d-4f88-8dc9-3047798a5239-run-systemd\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.272728 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.272637    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a40e45d-440d-4f88-8dc9-3047798a5239-var-lib-openvswitch\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.272728 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.272709    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a40e45d-440d-4f88-8dc9-3047798a5239-host-run-ovn-kubernetes\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.273011 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.272738    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2a40e45d-440d-4f88-8dc9-3047798a5239-ovnkube-script-lib\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.273011 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.272766    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bd8af8c2-2c6b-4dbe-8bcf-e3d908de7bbe-konnectivity-ca\") pod \"konnectivity-agent-drg4d\" (UID: \"bd8af8c2-2c6b-4dbe-8bcf-e3d908de7bbe\") " pod="kube-system/konnectivity-agent-drg4d"
Jul 28 15:14:01.273011 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.272856    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2a40e45d-440d-4f88-8dc9-3047798a5239-host-slash\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.273011 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.272890    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a40e45d-440d-4f88-8dc9-3047798a5239-etc-openvswitch\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.273011 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.272940    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2a40e45d-440d-4f88-8dc9-3047798a5239-log-socket\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.273011 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.272981    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a40e45d-440d-4f88-8dc9-3047798a5239-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.273314 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.273014    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43c0a413-1cee-48b4-9c69-e7a5429dcc89-tmp-dir\") pod \"node-resolver-lv5xt\" (UID: \"43c0a413-1cee-48b4-9c69-e7a5429dcc89\") " pod="openshift-dns/node-resolver-lv5xt"
Jul 28 15:14:01.273314 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.273052    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0-system-cni-dir\") pod \"multus-additional-cni-plugins-lrwfs\" (UID: \"8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0\") " pod="openshift-multus/multus-additional-cni-plugins-lrwfs"
Jul 28 15:14:01.275222 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.273726    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 28 15:14:01.275222 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.273724    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lds27\""
Jul 28 15:14:01.275222 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.275051    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hvlq9"
Jul 28 15:14:01.275222 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:01.275121    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hvlq9" podUID="4159b552-0523-406a-8816-4aef10a5829e"
Jul 28 15:14:01.278320 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.278302    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ncczz"
Jul 28 15:14:01.283494 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.282974    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mds5d"
Jul 28 15:14:01.283494 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:01.283037    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mds5d" podUID="07bf4445-9e9d-45b5-9b36-e6cbd745ec0e"
Jul 28 15:14:01.283494 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.283147    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 28 15:14:01.283494 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.283193    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 28 15:14:01.283494 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.283148    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 28 15:14:01.283494 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.283410    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-djp4z\""
Jul 28 15:14:01.283494 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.283443    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d85z2"
Jul 28 15:14:01.286169 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.285640    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wts9"
Jul 28 15:14:01.286284 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.286083    2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 28 15:14:01.287780 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.287760    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-542qq\""
Jul 28 15:14:01.287780 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.287773    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 28 15:14:01.288005 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.287778    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 28 15:14:01.288005 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.287846    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 28 15:14:01.288340 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.288320    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 28 15:14:01.288933 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.288914    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 28 15:14:01.289030 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.289007    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 28 15:14:01.289180 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.289154    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pt8rh\""
Jul 28 15:14:01.299469 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.299447    2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 15:14:01.310982 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.310959    2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-zbnq6"
Jul 28 15:14:01.317987 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.317586    2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-zbnq6"
Jul 28 15:14:01.338744 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.338723    2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 15:14:01.360448 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.360427    2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 28 15:14:01.374382 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.373524    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2a40e45d-440d-4f88-8dc9-3047798a5239-host-slash\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.374382 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.373567    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6da27f06-fd24-42f1-9bcf-20f6aa3e716d-etc-kubernetes\") pod \"multus-mh4nm\" (UID: \"6da27f06-fd24-42f1-9bcf-20f6aa3e716d\") " pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.374382 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.373601    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5jbf\" (UniqueName: \"kubernetes.io/projected/c87ad085-d80c-488c-a557-99f708627772-kube-api-access-w5jbf\") pod \"iptables-alerter-ncczz\" (UID: \"c87ad085-d80c-488c-a557-99f708627772\") " pod="openshift-network-operator/iptables-alerter-ncczz"
Jul 28 15:14:01.374382 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.373629    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b6c83382-dbd5-4f3e-a52a-f33a0365e94e-device-dir\") pod \"aws-ebs-csi-driver-node-8wts9\" (UID: \"b6c83382-dbd5-4f3e-a52a-f33a0365e94e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wts9"
Jul 28 15:14:01.374382 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.373653    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6da27f06-fd24-42f1-9bcf-20f6aa3e716d-host-run-netns\") pod \"multus-mh4nm\" (UID: \"6da27f06-fd24-42f1-9bcf-20f6aa3e716d\") " pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.374382 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.373677    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c9a56fb7-e5de-4cd0-930f-0944440df51a-etc-modprobe-d\") pod \"tuned-r6ngg\" (UID: \"c9a56fb7-e5de-4cd0-930f-0944440df51a\") " pod="openshift-cluster-node-tuning-operator/tuned-r6ngg"
Jul 28 15:14:01.374382 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.373705    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9a56fb7-e5de-4cd0-930f-0944440df51a-tmp\") pod \"tuned-r6ngg\" (UID: \"c9a56fb7-e5de-4cd0-930f-0944440df51a\") " pod="openshift-cluster-node-tuning-operator/tuned-r6ngg"
Jul 28 15:14:01.374382 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.373734    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43c0a413-1cee-48b4-9c69-e7a5429dcc89-tmp-dir\") pod \"node-resolver-lv5xt\" (UID: \"43c0a413-1cee-48b4-9c69-e7a5429dcc89\") " pod="openshift-dns/node-resolver-lv5xt"
Jul 28 15:14:01.374382 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.373756    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8426ba3a-6768-4cea-aad5-dc6f897b568d-host\") pod \"node-ca-d85z2\" (UID: \"8426ba3a-6768-4cea-aad5-dc6f897b568d\") " pod="openshift-image-registry/node-ca-d85z2"
Jul 28 15:14:01.374382 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.373788    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/43c0a413-1cee-48b4-9c69-e7a5429dcc89-hosts-file\") pod \"node-resolver-lv5xt\" (UID: \"43c0a413-1cee-48b4-9c69-e7a5429dcc89\") " pod="openshift-dns/node-resolver-lv5xt"
Jul 28 15:14:01.374382 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.373813    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6da27f06-fd24-42f1-9bcf-20f6aa3e716d-host-var-lib-kubelet\") pod \"multus-mh4nm\" (UID: \"6da27f06-fd24-42f1-9bcf-20f6aa3e716d\") " pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.374382 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.373885    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8426ba3a-6768-4cea-aad5-dc6f897b568d-serviceca\") pod \"node-ca-d85z2\" (UID: \"8426ba3a-6768-4cea-aad5-dc6f897b568d\") " pod="openshift-image-registry/node-ca-d85z2"
Jul 28 15:14:01.374382 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.373924    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/43c0a413-1cee-48b4-9c69-e7a5429dcc89-hosts-file\") pod \"node-resolver-lv5xt\" (UID: \"43c0a413-1cee-48b4-9c69-e7a5429dcc89\") " pod="openshift-dns/node-resolver-lv5xt"
Jul 28 15:14:01.374382 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.373923    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b6c83382-dbd5-4f3e-a52a-f33a0365e94e-sys-fs\") pod \"aws-ebs-csi-driver-node-8wts9\" (UID: \"b6c83382-dbd5-4f3e-a52a-f33a0365e94e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wts9"
Jul 28 15:14:01.374382 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.373978    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9a56fb7-e5de-4cd0-930f-0944440df51a-etc-kubernetes\") pod \"tuned-r6ngg\" (UID: \"c9a56fb7-e5de-4cd0-930f-0944440df51a\") " pod="openshift-cluster-node-tuning-operator/tuned-r6ngg"
Jul 28 15:14:01.374382 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.374033    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2a40e45d-440d-4f88-8dc9-3047798a5239-ovnkube-config\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.374382 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.374039    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2a40e45d-440d-4f88-8dc9-3047798a5239-host-slash\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.375322 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.374059    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6da27f06-fd24-42f1-9bcf-20f6aa3e716d-host-var-lib-cni-bin\") pod \"multus-mh4nm\" (UID: \"6da27f06-fd24-42f1-9bcf-20f6aa3e716d\") " pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.375322 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.374087    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c87ad085-d80c-488c-a557-99f708627772-iptables-alerter-script\") pod \"iptables-alerter-ncczz\" (UID: \"c87ad085-d80c-488c-a557-99f708627772\") " pod="openshift-network-operator/iptables-alerter-ncczz"
Jul 28 15:14:01.375322 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.374113    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh8zn\" (UniqueName: \"kubernetes.io/projected/07bf4445-9e9d-45b5-9b36-e6cbd745ec0e-kube-api-access-sh8zn\") pod \"network-check-target-mds5d\" (UID: \"07bf4445-9e9d-45b5-9b36-e6cbd745ec0e\") " pod="openshift-network-diagnostics/network-check-target-mds5d"
Jul 28 15:14:01.375322 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.374138    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b6c83382-dbd5-4f3e-a52a-f33a0365e94e-etc-selinux\") pod \"aws-ebs-csi-driver-node-8wts9\" (UID: \"b6c83382-dbd5-4f3e-a52a-f33a0365e94e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wts9"
Jul 28 15:14:01.375322 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.374163    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c9a56fb7-e5de-4cd0-930f-0944440df51a-lib-modules\") pod \"tuned-r6ngg\" (UID: \"c9a56fb7-e5de-4cd0-930f-0944440df51a\") " pod="openshift-cluster-node-tuning-operator/tuned-r6ngg"
Jul 28 15:14:01.375322 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.374206    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/43c0a413-1cee-48b4-9c69-e7a5429dcc89-tmp-dir\") pod \"node-resolver-lv5xt\" (UID: \"43c0a413-1cee-48b4-9c69-e7a5429dcc89\") " pod="openshift-dns/node-resolver-lv5xt"
Jul 28 15:14:01.375322 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.374214    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mxw5\" (UniqueName: \"kubernetes.io/projected/43c0a413-1cee-48b4-9c69-e7a5429dcc89-kube-api-access-2mxw5\") pod \"node-resolver-lv5xt\" (UID: \"43c0a413-1cee-48b4-9c69-e7a5429dcc89\") " pod="openshift-dns/node-resolver-lv5xt"
Jul 28 15:14:01.375322 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.374259    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/20741b19-0b49-488f-86cc-c974cd83fe30-dbus\") pod \"global-pull-secret-syncer-qpvsz\" (UID: \"20741b19-0b49-488f-86cc-c974cd83fe30\") " pod="kube-system/global-pull-secret-syncer-qpvsz"
Jul 28 15:14:01.375322 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.374285    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20741b19-0b49-488f-86cc-c974cd83fe30-original-pull-secret\") pod \"global-pull-secret-syncer-qpvsz\" (UID: \"20741b19-0b49-488f-86cc-c974cd83fe30\") " pod="kube-system/global-pull-secret-syncer-qpvsz"
Jul 28 15:14:01.375322 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.374308    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b6c83382-dbd5-4f3e-a52a-f33a0365e94e-registration-dir\") pod \"aws-ebs-csi-driver-node-8wts9\" (UID: \"b6c83382-dbd5-4f3e-a52a-f33a0365e94e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wts9"
Jul 28 15:14:01.375322 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.374328    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c9a56fb7-e5de-4cd0-930f-0944440df51a-etc-sysctl-conf\") pod \"tuned-r6ngg\" (UID: \"c9a56fb7-e5de-4cd0-930f-0944440df51a\") " pod="openshift-cluster-node-tuning-operator/tuned-r6ngg"
Jul 28 15:14:01.375322 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.374346    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9a56fb7-e5de-4cd0-930f-0944440df51a-sys\") pod \"tuned-r6ngg\" (UID: \"c9a56fb7-e5de-4cd0-930f-0944440df51a\") " pod="openshift-cluster-node-tuning-operator/tuned-r6ngg"
Jul 28 15:14:01.375322 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.374365    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6da27f06-fd24-42f1-9bcf-20f6aa3e716d-system-cni-dir\") pod \"multus-mh4nm\" (UID: \"6da27f06-fd24-42f1-9bcf-20f6aa3e716d\") " pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.375322 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.374387    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6da27f06-fd24-42f1-9bcf-20f6aa3e716d-multus-socket-dir-parent\") pod \"multus-mh4nm\" (UID: \"6da27f06-fd24-42f1-9bcf-20f6aa3e716d\") " pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.375322 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.374440    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/20741b19-0b49-488f-86cc-c974cd83fe30-dbus\") pod \"global-pull-secret-syncer-qpvsz\" (UID: \"20741b19-0b49-488f-86cc-c974cd83fe30\") " pod="kube-system/global-pull-secret-syncer-qpvsz"
Jul 28 15:14:01.375322 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.374496    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6da27f06-fd24-42f1-9bcf-20f6aa3e716d-host-run-multus-certs\") pod \"multus-mh4nm\" (UID: \"6da27f06-fd24-42f1-9bcf-20f6aa3e716d\") " pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.375322 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.374527    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a40e45d-440d-4f88-8dc9-3047798a5239-run-openvswitch\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.376190 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.374555    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0-cni-binary-copy\") pod \"multus-additional-cni-plugins-lrwfs\" (UID: \"8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0\") " pod="openshift-multus/multus-additional-cni-plugins-lrwfs"
Jul 28 15:14:01.376190 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.374580    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lrwfs\" (UID: \"8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0\") " pod="openshift-multus/multus-additional-cni-plugins-lrwfs"
Jul 28 15:14:01.376190 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.374620    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a40e45d-440d-4f88-8dc9-3047798a5239-host-kubelet\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.376190 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.374655    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/20741b19-0b49-488f-86cc-c974cd83fe30-kubelet-config\") pod \"global-pull-secret-syncer-qpvsz\" (UID: \"20741b19-0b49-488f-86cc-c974cd83fe30\") " pod="kube-system/global-pull-secret-syncer-qpvsz"
Jul 28 15:14:01.376190 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.374678    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0-cnibin\") pod \"multus-additional-cni-plugins-lrwfs\" (UID: \"8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0\") " pod="openshift-multus/multus-additional-cni-plugins-lrwfs"
Jul 28 15:14:01.376190 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.374731    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2a40e45d-440d-4f88-8dc9-3047798a5239-run-systemd\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.376190 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.374768    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2a40e45d-440d-4f88-8dc9-3047798a5239-ovnkube-config\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.376190 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.374771    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a40e45d-440d-4f88-8dc9-3047798a5239-var-lib-openvswitch\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.376190 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.375218    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2a40e45d-440d-4f88-8dc9-3047798a5239-ovnkube-script-lib\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.376190 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.375289    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7skv\" (UniqueName: \"kubernetes.io/projected/6da27f06-fd24-42f1-9bcf-20f6aa3e716d-kube-api-access-d7skv\") pod \"multus-mh4nm\" (UID: \"6da27f06-fd24-42f1-9bcf-20f6aa3e716d\") " pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.383736 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.377182    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b6c83382-dbd5-4f3e-a52a-f33a0365e94e-socket-dir\") pod \"aws-ebs-csi-driver-node-8wts9\" (UID: \"b6c83382-dbd5-4f3e-a52a-f33a0365e94e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wts9"
Jul 28 15:14:01.383736 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.377242    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c9a56fb7-e5de-4cd0-930f-0944440df51a-etc-sysctl-d\") pod \"tuned-r6ngg\" (UID: \"c9a56fb7-e5de-4cd0-930f-0944440df51a\") " pod="openshift-cluster-node-tuning-operator/tuned-r6ngg"
Jul 28 15:14:01.383736 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.377278    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a40e45d-440d-4f88-8dc9-3047798a5239-etc-openvswitch\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.383736 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.377315    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6da27f06-fd24-42f1-9bcf-20f6aa3e716d-multus-conf-dir\") pod \"multus-mh4nm\" (UID: \"6da27f06-fd24-42f1-9bcf-20f6aa3e716d\") " pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.383736 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.377363    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rj64x\" (UniqueName: \"kubernetes.io/projected/4159b552-0523-406a-8816-4aef10a5829e-kube-api-access-rj64x\") pod \"network-metrics-daemon-hvlq9\" (UID: \"4159b552-0523-406a-8816-4aef10a5829e\") " pod="openshift-multus/network-metrics-daemon-hvlq9"
Jul 28 15:14:01.383736 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.377402    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2a40e45d-440d-4f88-8dc9-3047798a5239-log-socket\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.383736 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.377438    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a40e45d-440d-4f88-8dc9-3047798a5239-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.383736 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.377474    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6da27f06-fd24-42f1-9bcf-20f6aa3e716d-host-run-k8s-cni-cncf-io\") pod \"multus-mh4nm\" (UID: \"6da27f06-fd24-42f1-9bcf-20f6aa3e716d\") " pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.383736 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.377510    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dp99c\" (UniqueName: \"kubernetes.io/projected/8426ba3a-6768-4cea-aad5-dc6f897b568d-kube-api-access-dp99c\") pod \"node-ca-d85z2\" (UID: \"8426ba3a-6768-4cea-aad5-dc6f897b568d\") " pod="openshift-image-registry/node-ca-d85z2"
Jul 28 15:14:01.383736 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.377548    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0-system-cni-dir\") pod \"multus-additional-cni-plugins-lrwfs\" (UID: \"8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0\") " pod="openshift-multus/multus-additional-cni-plugins-lrwfs"
Jul 28 15:14:01.383736 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.377584    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzgs8\" (UniqueName: \"kubernetes.io/projected/8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0-kube-api-access-jzgs8\") pod \"multus-additional-cni-plugins-lrwfs\" (UID: \"8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0\") " pod="openshift-multus/multus-additional-cni-plugins-lrwfs"
Jul 28 15:14:01.383736 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.377619    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2a40e45d-440d-4f88-8dc9-3047798a5239-host-run-netns\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.383736 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.377658    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6da27f06-fd24-42f1-9bcf-20f6aa3e716d-os-release\") pod \"multus-mh4nm\" (UID: \"6da27f06-fd24-42f1-9bcf-20f6aa3e716d\") " pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.383736 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.377698    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6da27f06-fd24-42f1-9bcf-20f6aa3e716d-host-var-lib-cni-multus\") pod \"multus-mh4nm\" (UID: \"6da27f06-fd24-42f1-9bcf-20f6aa3e716d\") " pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.383736 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.377737    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6da27f06-fd24-42f1-9bcf-20f6aa3e716d-multus-daemon-config\") pod \"multus-mh4nm\" (UID: \"6da27f06-fd24-42f1-9bcf-20f6aa3e716d\") " pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.383736 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.377774    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq9wf\" (UniqueName: \"kubernetes.io/projected/b6c83382-dbd5-4f3e-a52a-f33a0365e94e-kube-api-access-rq9wf\") pod \"aws-ebs-csi-driver-node-8wts9\" (UID: \"b6c83382-dbd5-4f3e-a52a-f33a0365e94e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wts9"
Jul 28 15:14:01.384662 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.377808    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lrwfs\" (UID: \"8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0\") " pod="openshift-multus/multus-additional-cni-plugins-lrwfs"
Jul 28 15:14:01.384662 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.377845    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lrwfs\" (UID: \"8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0\") " pod="openshift-multus/multus-additional-cni-plugins-lrwfs"
Jul 28 15:14:01.384662 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.377880    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2a40e45d-440d-4f88-8dc9-3047798a5239-node-log\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.384662 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.377941    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2a40e45d-440d-4f88-8dc9-3047798a5239-env-overrides\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.384662 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.377983    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bd8af8c2-2c6b-4dbe-8bcf-e3d908de7bbe-agent-certs\") pod \"konnectivity-agent-drg4d\" (UID: \"bd8af8c2-2c6b-4dbe-8bcf-e3d908de7bbe\") " pod="kube-system/konnectivity-agent-drg4d"
Jul 28 15:14:01.384662 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.378014    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0-system-cni-dir\") pod \"multus-additional-cni-plugins-lrwfs\" (UID: \"8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0\") " pod="openshift-multus/multus-additional-cni-plugins-lrwfs"
Jul 28 15:14:01.384662 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.378102    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2a40e45d-440d-4f88-8dc9-3047798a5239-host-run-netns\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.384662 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.378398    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-lrwfs\" (UID: \"8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0\") " pod="openshift-multus/multus-additional-cni-plugins-lrwfs"
Jul 28 15:14:01.384662 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.378934    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-lrwfs\" (UID: \"8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0\") " pod="openshift-multus/multus-additional-cni-plugins-lrwfs"
Jul 28 15:14:01.384662 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.379017    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2a40e45d-440d-4f88-8dc9-3047798a5239-node-log\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.384662 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.379426    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2a40e45d-440d-4f88-8dc9-3047798a5239-env-overrides\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.384662 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.379762    2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 28 15:14:01.384662 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.380543    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2a40e45d-440d-4f88-8dc9-3047798a5239-run-systemd\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.384662 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.380614    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a40e45d-440d-4f88-8dc9-3047798a5239-run-openvswitch\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.384662 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.381109    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0-cni-binary-copy\") pod \"multus-additional-cni-plugins-lrwfs\" (UID: \"8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0\") " pod="openshift-multus/multus-additional-cni-plugins-lrwfs"
Jul 28 15:14:01.384662 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.381607    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-lrwfs\" (UID: \"8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0\") " pod="openshift-multus/multus-additional-cni-plugins-lrwfs"
Jul 28 15:14:01.384662 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.381696    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2a40e45d-440d-4f88-8dc9-3047798a5239-host-kubelet\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.385418 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.381765    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/20741b19-0b49-488f-86cc-c974cd83fe30-kubelet-config\") pod \"global-pull-secret-syncer-qpvsz\" (UID: \"20741b19-0b49-488f-86cc-c974cd83fe30\") " pod="kube-system/global-pull-secret-syncer-qpvsz"
Jul 28 15:14:01.385418 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.381815    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0-cnibin\") pod \"multus-additional-cni-plugins-lrwfs\" (UID: \"8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0\") " pod="openshift-multus/multus-additional-cni-plugins-lrwfs"
Jul 28 15:14:01.385418 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.382288    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a40e45d-440d-4f88-8dc9-3047798a5239-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.385418 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.382374    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2a40e45d-440d-4f88-8dc9-3047798a5239-log-socket\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.385418 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.382424    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a40e45d-440d-4f88-8dc9-3047798a5239-var-lib-openvswitch\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.385418 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.378018    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6da27f06-fd24-42f1-9bcf-20f6aa3e716d-cnibin\") pod \"multus-mh4nm\" (UID: \"6da27f06-fd24-42f1-9bcf-20f6aa3e716d\") " pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.385418 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.382470    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c87ad085-d80c-488c-a557-99f708627772-host-slash\") pod \"iptables-alerter-ncczz\" (UID: \"c87ad085-d80c-488c-a557-99f708627772\") " pod="openshift-network-operator/iptables-alerter-ncczz"
Jul 28 15:14:01.385418 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.382508    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0-os-release\") pod \"multus-additional-cni-plugins-lrwfs\" (UID: \"8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0\") " pod="openshift-multus/multus-additional-cni-plugins-lrwfs"
Jul 28 15:14:01.385418 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.382559    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlrrp\" (UniqueName: \"kubernetes.io/projected/2a40e45d-440d-4f88-8dc9-3047798a5239-kube-api-access-hlrrp\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.385418 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.382593    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6da27f06-fd24-42f1-9bcf-20f6aa3e716d-cni-binary-copy\") pod \"multus-mh4nm\" (UID: \"6da27f06-fd24-42f1-9bcf-20f6aa3e716d\") " pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.385418 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.382619    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c9a56fb7-e5de-4cd0-930f-0944440df51a-run\") pod \"tuned-r6ngg\" (UID: \"c9a56fb7-e5de-4cd0-930f-0944440df51a\") " pod="openshift-cluster-node-tuning-operator/tuned-r6ngg"
Jul 28 15:14:01.385418 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.382651    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c9a56fb7-e5de-4cd0-930f-0944440df51a-var-lib-kubelet\") pod \"tuned-r6ngg\" (UID: \"c9a56fb7-e5de-4cd0-930f-0944440df51a\") " pod="openshift-cluster-node-tuning-operator/tuned-r6ngg"
Jul 28 15:14:01.385418 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.382682    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c9a56fb7-e5de-4cd0-930f-0944440df51a-host\") pod \"tuned-r6ngg\" (UID: \"c9a56fb7-e5de-4cd0-930f-0944440df51a\") " pod="openshift-cluster-node-tuning-operator/tuned-r6ngg"
Jul 28 15:14:01.385418 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.382714    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q496t\" (UniqueName: \"kubernetes.io/projected/c9a56fb7-e5de-4cd0-930f-0944440df51a-kube-api-access-q496t\") pod \"tuned-r6ngg\" (UID: \"c9a56fb7-e5de-4cd0-930f-0944440df51a\") " pod="openshift-cluster-node-tuning-operator/tuned-r6ngg"
Jul 28 15:14:01.385418 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.382992    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2a40e45d-440d-4f88-8dc9-3047798a5239-ovnkube-script-lib\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.385418 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.383115    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0-os-release\") pod \"multus-additional-cni-plugins-lrwfs\" (UID: \"8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0\") " pod="openshift-multus/multus-additional-cni-plugins-lrwfs"
Jul 28 15:14:01.385418 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:01.383266    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 15:14:01.386244 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.382747    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2a40e45d-440d-4f88-8dc9-3047798a5239-ovn-node-metrics-cert\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.386244 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.383322    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c9a56fb7-e5de-4cd0-930f-0944440df51a-etc-systemd\") pod \"tuned-r6ngg\" (UID: \"c9a56fb7-e5de-4cd0-930f-0944440df51a\") " pod="openshift-cluster-node-tuning-operator/tuned-r6ngg"
Jul 28 15:14:01.386244 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.383372    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2a40e45d-440d-4f88-8dc9-3047798a5239-run-ovn\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.386244 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.383455    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2a40e45d-440d-4f88-8dc9-3047798a5239-host-cni-bin\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.386244 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.383527    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2a40e45d-440d-4f88-8dc9-3047798a5239-etc-openvswitch\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.386244 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.383539    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2a40e45d-440d-4f88-8dc9-3047798a5239-host-cni-bin\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.386244 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.383684    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2a40e45d-440d-4f88-8dc9-3047798a5239-run-ovn\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.386244 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:01.383935    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20741b19-0b49-488f-86cc-c974cd83fe30-original-pull-secret podName:20741b19-0b49-488f-86cc-c974cd83fe30 nodeName:}" failed. No retries permitted until 2026-07-28 15:14:01.883666766 +0000 UTC m=+2.934034870 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20741b19-0b49-488f-86cc-c974cd83fe30-original-pull-secret") pod "global-pull-secret-syncer-qpvsz" (UID: "20741b19-0b49-488f-86cc-c974cd83fe30") : object "kube-system"/"original-pull-secret" not registered
Jul 28 15:14:01.386244 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.383988    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2a40e45d-440d-4f88-8dc9-3047798a5239-host-cni-netd\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.386244 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.384034    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4159b552-0523-406a-8816-4aef10a5829e-metrics-certs\") pod \"network-metrics-daemon-hvlq9\" (UID: \"4159b552-0523-406a-8816-4aef10a5829e\") " pod="openshift-multus/network-metrics-daemon-hvlq9"
Jul 28 15:14:01.386244 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.384043    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2a40e45d-440d-4f88-8dc9-3047798a5239-host-cni-netd\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.386244 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.384076    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b6c83382-dbd5-4f3e-a52a-f33a0365e94e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8wts9\" (UID: \"b6c83382-dbd5-4f3e-a52a-f33a0365e94e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wts9"
Jul 28 15:14:01.386244 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.384117    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c9a56fb7-e5de-4cd0-930f-0944440df51a-etc-sysconfig\") pod \"tuned-r6ngg\" (UID: \"c9a56fb7-e5de-4cd0-930f-0944440df51a\") " pod="openshift-cluster-node-tuning-operator/tuned-r6ngg"
Jul 28 15:14:01.386244 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.384156    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2a40e45d-440d-4f88-8dc9-3047798a5239-systemd-units\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.386244 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.384190    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a40e45d-440d-4f88-8dc9-3047798a5239-host-run-ovn-kubernetes\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.386244 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.384224    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bd8af8c2-2c6b-4dbe-8bcf-e3d908de7bbe-konnectivity-ca\") pod \"konnectivity-agent-drg4d\" (UID: \"bd8af8c2-2c6b-4dbe-8bcf-e3d908de7bbe\") " pod="kube-system/konnectivity-agent-drg4d"
Jul 28 15:14:01.387085 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.384259    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6da27f06-fd24-42f1-9bcf-20f6aa3e716d-multus-cni-dir\") pod \"multus-mh4nm\" (UID: \"6da27f06-fd24-42f1-9bcf-20f6aa3e716d\") " pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.387085 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.384267    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2a40e45d-440d-4f88-8dc9-3047798a5239-systemd-units\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.387085 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.384293    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6da27f06-fd24-42f1-9bcf-20f6aa3e716d-hostroot\") pod \"multus-mh4nm\" (UID: \"6da27f06-fd24-42f1-9bcf-20f6aa3e716d\") " pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.387085 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.384385    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2a40e45d-440d-4f88-8dc9-3047798a5239-host-run-ovn-kubernetes\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.387085 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.384427    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c9a56fb7-e5de-4cd0-930f-0944440df51a-etc-tuned\") pod \"tuned-r6ngg\" (UID: \"c9a56fb7-e5de-4cd0-930f-0944440df51a\") " pod="openshift-cluster-node-tuning-operator/tuned-r6ngg"
Jul 28 15:14:01.387085 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.385027    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bd8af8c2-2c6b-4dbe-8bcf-e3d908de7bbe-konnectivity-ca\") pod \"konnectivity-agent-drg4d\" (UID: \"bd8af8c2-2c6b-4dbe-8bcf-e3d908de7bbe\") " pod="kube-system/konnectivity-agent-drg4d"
Jul 28 15:14:01.390048 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.388939    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bd8af8c2-2c6b-4dbe-8bcf-e3d908de7bbe-agent-certs\") pod \"konnectivity-agent-drg4d\" (UID: \"bd8af8c2-2c6b-4dbe-8bcf-e3d908de7bbe\") " pod="kube-system/konnectivity-agent-drg4d"
Jul 28 15:14:01.390433 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.390411    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mxw5\" (UniqueName: \"kubernetes.io/projected/43c0a413-1cee-48b4-9c69-e7a5429dcc89-kube-api-access-2mxw5\") pod \"node-resolver-lv5xt\" (UID: \"43c0a413-1cee-48b4-9c69-e7a5429dcc89\") " pod="openshift-dns/node-resolver-lv5xt"
Jul 28 15:14:01.391039 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.390992    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2a40e45d-440d-4f88-8dc9-3047798a5239-ovn-node-metrics-cert\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.398506 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.398478    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlrrp\" (UniqueName: \"kubernetes.io/projected/2a40e45d-440d-4f88-8dc9-3047798a5239-kube-api-access-hlrrp\") pod \"ovnkube-node-zrkfd\" (UID: \"2a40e45d-440d-4f88-8dc9-3047798a5239\") " pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.399304 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.399256    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzgs8\" (UniqueName: \"kubernetes.io/projected/8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0-kube-api-access-jzgs8\") pod \"multus-additional-cni-plugins-lrwfs\" (UID: \"8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0\") " pod="openshift-multus/multus-additional-cni-plugins-lrwfs"
Jul 28 15:14:01.411198 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.411139    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-125.ec2.internal" event={"ID":"15fb43c0c3be2d4b2fc124f01e5795dd","Type":"ContainerStarted","Data":"c6f2ddba3e9539f59be505943f2a75c8d956b2816c13554dbb120be3c2d72a8e"}
Jul 28 15:14:01.414857 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.414823    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-125.ec2.internal" event={"ID":"693b917588309c87173dc513569db3fd","Type":"ContainerStarted","Data":"c73f5ce40e5e8735ded6315664fd2dd988430ca6c91e325229c948f6f5e07459"}
Jul 28 15:14:01.484872 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.484833    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6da27f06-fd24-42f1-9bcf-20f6aa3e716d-cni-binary-copy\") pod \"multus-mh4nm\" (UID: \"6da27f06-fd24-42f1-9bcf-20f6aa3e716d\") " pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.485092 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.484893    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c9a56fb7-e5de-4cd0-930f-0944440df51a-run\") pod \"tuned-r6ngg\" (UID: \"c9a56fb7-e5de-4cd0-930f-0944440df51a\") " pod="openshift-cluster-node-tuning-operator/tuned-r6ngg"
Jul 28 15:14:01.485092 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.484920    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c9a56fb7-e5de-4cd0-930f-0944440df51a-var-lib-kubelet\") pod \"tuned-r6ngg\" (UID: \"c9a56fb7-e5de-4cd0-930f-0944440df51a\") " pod="openshift-cluster-node-tuning-operator/tuned-r6ngg"
Jul 28 15:14:01.485092 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.484945    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c9a56fb7-e5de-4cd0-930f-0944440df51a-host\") pod \"tuned-r6ngg\" (UID: \"c9a56fb7-e5de-4cd0-930f-0944440df51a\") " pod="openshift-cluster-node-tuning-operator/tuned-r6ngg"
Jul 28 15:14:01.485092 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.485019    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c9a56fb7-e5de-4cd0-930f-0944440df51a-host\") pod \"tuned-r6ngg\" (UID: \"c9a56fb7-e5de-4cd0-930f-0944440df51a\") " pod="openshift-cluster-node-tuning-operator/tuned-r6ngg"
Jul 28 15:14:01.485092 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.485075    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c9a56fb7-e5de-4cd0-930f-0944440df51a-run\") pod \"tuned-r6ngg\" (UID: \"c9a56fb7-e5de-4cd0-930f-0944440df51a\") " pod="openshift-cluster-node-tuning-operator/tuned-r6ngg"
Jul 28 15:14:01.485367 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.485129    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c9a56fb7-e5de-4cd0-930f-0944440df51a-var-lib-kubelet\") pod \"tuned-r6ngg\" (UID: \"c9a56fb7-e5de-4cd0-930f-0944440df51a\") " pod="openshift-cluster-node-tuning-operator/tuned-r6ngg"
Jul 28 15:14:01.485367 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.485182    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q496t\" (UniqueName: \"kubernetes.io/projected/c9a56fb7-e5de-4cd0-930f-0944440df51a-kube-api-access-q496t\") pod \"tuned-r6ngg\" (UID: \"c9a56fb7-e5de-4cd0-930f-0944440df51a\") " pod="openshift-cluster-node-tuning-operator/tuned-r6ngg"
Jul 28 15:14:01.485367 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.485225    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c9a56fb7-e5de-4cd0-930f-0944440df51a-etc-systemd\") pod \"tuned-r6ngg\" (UID: \"c9a56fb7-e5de-4cd0-930f-0944440df51a\") " pod="openshift-cluster-node-tuning-operator/tuned-r6ngg"
Jul 28 15:14:01.485367 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.485256    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4159b552-0523-406a-8816-4aef10a5829e-metrics-certs\") pod \"network-metrics-daemon-hvlq9\" (UID: \"4159b552-0523-406a-8816-4aef10a5829e\") " pod="openshift-multus/network-metrics-daemon-hvlq9"
Jul 28 15:14:01.485367 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.485279    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b6c83382-dbd5-4f3e-a52a-f33a0365e94e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8wts9\" (UID: \"b6c83382-dbd5-4f3e-a52a-f33a0365e94e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wts9"
Jul 28 15:14:01.485367 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.485301    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c9a56fb7-e5de-4cd0-930f-0944440df51a-etc-sysconfig\") pod \"tuned-r6ngg\" (UID: \"c9a56fb7-e5de-4cd0-930f-0944440df51a\") " pod="openshift-cluster-node-tuning-operator/tuned-r6ngg"
Jul 28 15:14:01.485367 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.485339    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6da27f06-fd24-42f1-9bcf-20f6aa3e716d-multus-cni-dir\") pod \"multus-mh4nm\" (UID: \"6da27f06-fd24-42f1-9bcf-20f6aa3e716d\") " pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.485367 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.485365    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6da27f06-fd24-42f1-9bcf-20f6aa3e716d-hostroot\") pod \"multus-mh4nm\" (UID: \"6da27f06-fd24-42f1-9bcf-20f6aa3e716d\") " pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.485777 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.485391    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c9a56fb7-e5de-4cd0-930f-0944440df51a-etc-tuned\") pod \"tuned-r6ngg\" (UID: \"c9a56fb7-e5de-4cd0-930f-0944440df51a\") " pod="openshift-cluster-node-tuning-operator/tuned-r6ngg"
Jul 28 15:14:01.485777 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.485417    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6da27f06-fd24-42f1-9bcf-20f6aa3e716d-etc-kubernetes\") pod \"multus-mh4nm\" (UID: \"6da27f06-fd24-42f1-9bcf-20f6aa3e716d\") " pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.485777 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.485446    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5jbf\" (UniqueName: \"kubernetes.io/projected/c87ad085-d80c-488c-a557-99f708627772-kube-api-access-w5jbf\") pod \"iptables-alerter-ncczz\" (UID: \"c87ad085-d80c-488c-a557-99f708627772\") " pod="openshift-network-operator/iptables-alerter-ncczz"
Jul 28 15:14:01.485777 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.485479    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b6c83382-dbd5-4f3e-a52a-f33a0365e94e-device-dir\") pod \"aws-ebs-csi-driver-node-8wts9\" (UID: \"b6c83382-dbd5-4f3e-a52a-f33a0365e94e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wts9"
Jul 28 15:14:01.485777 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.485504    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6da27f06-fd24-42f1-9bcf-20f6aa3e716d-host-run-netns\") pod \"multus-mh4nm\" (UID: \"6da27f06-fd24-42f1-9bcf-20f6aa3e716d\") " pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.485777 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.485531    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c9a56fb7-e5de-4cd0-930f-0944440df51a-etc-modprobe-d\") pod \"tuned-r6ngg\" (UID: \"c9a56fb7-e5de-4cd0-930f-0944440df51a\") " pod="openshift-cluster-node-tuning-operator/tuned-r6ngg"
Jul 28 15:14:01.485777 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.485550    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6da27f06-fd24-42f1-9bcf-20f6aa3e716d-cni-binary-copy\") pod \"multus-mh4nm\" (UID: \"6da27f06-fd24-42f1-9bcf-20f6aa3e716d\") " pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.485777 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.485558    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9a56fb7-e5de-4cd0-930f-0944440df51a-tmp\") pod \"tuned-r6ngg\" (UID: \"c9a56fb7-e5de-4cd0-930f-0944440df51a\") " pod="openshift-cluster-node-tuning-operator/tuned-r6ngg"
Jul 28 15:14:01.485777 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.485582    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8426ba3a-6768-4cea-aad5-dc6f897b568d-host\") pod \"node-ca-d85z2\" (UID: \"8426ba3a-6768-4cea-aad5-dc6f897b568d\") " pod="openshift-image-registry/node-ca-d85z2"
Jul 28 15:14:01.485777 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.485606    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6da27f06-fd24-42f1-9bcf-20f6aa3e716d-host-var-lib-kubelet\") pod \"multus-mh4nm\" (UID: \"6da27f06-fd24-42f1-9bcf-20f6aa3e716d\") " pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.485777 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.485614    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6da27f06-fd24-42f1-9bcf-20f6aa3e716d-hostroot\") pod \"multus-mh4nm\" (UID: \"6da27f06-fd24-42f1-9bcf-20f6aa3e716d\") " pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.485777 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.485634    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8426ba3a-6768-4cea-aad5-dc6f897b568d-serviceca\") pod \"node-ca-d85z2\" (UID: \"8426ba3a-6768-4cea-aad5-dc6f897b568d\") " pod="openshift-image-registry/node-ca-d85z2"
Jul 28 15:14:01.485777 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.485661    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b6c83382-dbd5-4f3e-a52a-f33a0365e94e-sys-fs\") pod \"aws-ebs-csi-driver-node-8wts9\" (UID: \"b6c83382-dbd5-4f3e-a52a-f33a0365e94e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wts9"
Jul 28 15:14:01.485777 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.485684    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9a56fb7-e5de-4cd0-930f-0944440df51a-etc-kubernetes\") pod \"tuned-r6ngg\" (UID: \"c9a56fb7-e5de-4cd0-930f-0944440df51a\") " pod="openshift-cluster-node-tuning-operator/tuned-r6ngg"
Jul 28 15:14:01.485777 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.485708    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6da27f06-fd24-42f1-9bcf-20f6aa3e716d-host-var-lib-cni-bin\") pod \"multus-mh4nm\" (UID: \"6da27f06-fd24-42f1-9bcf-20f6aa3e716d\") " pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.485777 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.485732    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c87ad085-d80c-488c-a557-99f708627772-iptables-alerter-script\") pod \"iptables-alerter-ncczz\" (UID: \"c87ad085-d80c-488c-a557-99f708627772\") " pod="openshift-network-operator/iptables-alerter-ncczz"
Jul 28 15:14:01.485777 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.485758    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh8zn\" (UniqueName: \"kubernetes.io/projected/07bf4445-9e9d-45b5-9b36-e6cbd745ec0e-kube-api-access-sh8zn\") pod \"network-check-target-mds5d\" (UID: \"07bf4445-9e9d-45b5-9b36-e6cbd745ec0e\") " pod="openshift-network-diagnostics/network-check-target-mds5d"
Jul 28 15:14:01.485777 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.485783    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b6c83382-dbd5-4f3e-a52a-f33a0365e94e-etc-selinux\") pod \"aws-ebs-csi-driver-node-8wts9\" (UID: \"b6c83382-dbd5-4f3e-a52a-f33a0365e94e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wts9"
Jul 28 15:14:01.486724 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.485808    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c9a56fb7-e5de-4cd0-930f-0944440df51a-lib-modules\") pod \"tuned-r6ngg\" (UID: \"c9a56fb7-e5de-4cd0-930f-0944440df51a\") " pod="openshift-cluster-node-tuning-operator/tuned-r6ngg"
Jul 28 15:14:01.486724 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.485857    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b6c83382-dbd5-4f3e-a52a-f33a0365e94e-registration-dir\") pod \"aws-ebs-csi-driver-node-8wts9\" (UID: \"b6c83382-dbd5-4f3e-a52a-f33a0365e94e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wts9"
Jul 28 15:14:01.486724 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.485906    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c9a56fb7-e5de-4cd0-930f-0944440df51a-etc-sysctl-conf\") pod \"tuned-r6ngg\" (UID: \"c9a56fb7-e5de-4cd0-930f-0944440df51a\") " pod="openshift-cluster-node-tuning-operator/tuned-r6ngg"
Jul 28 15:14:01.486724 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.485965    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b6c83382-dbd5-4f3e-a52a-f33a0365e94e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8wts9\" (UID: \"b6c83382-dbd5-4f3e-a52a-f33a0365e94e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wts9"
Jul 28 15:14:01.486724 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.485939    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9a56fb7-e5de-4cd0-930f-0944440df51a-sys\") pod \"tuned-r6ngg\" (UID: \"c9a56fb7-e5de-4cd0-930f-0944440df51a\") " pod="openshift-cluster-node-tuning-operator/tuned-r6ngg"
Jul 28 15:14:01.486724 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.485998    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6da27f06-fd24-42f1-9bcf-20f6aa3e716d-system-cni-dir\") pod \"multus-mh4nm\" (UID: \"6da27f06-fd24-42f1-9bcf-20f6aa3e716d\") " pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.486724 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.485898    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c9a56fb7-e5de-4cd0-930f-0944440df51a-etc-systemd\") pod \"tuned-r6ngg\" (UID: \"c9a56fb7-e5de-4cd0-930f-0944440df51a\") " pod="openshift-cluster-node-tuning-operator/tuned-r6ngg"
Jul 28 15:14:01.486724 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:01.486123    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 15:14:01.486724 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.486135    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c9a56fb7-e5de-4cd0-930f-0944440df51a-etc-sysconfig\") pod \"tuned-r6ngg\" (UID: \"c9a56fb7-e5de-4cd0-930f-0944440df51a\") " pod="openshift-cluster-node-tuning-operator/tuned-r6ngg"
Jul 28 15:14:01.486724 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:01.486187    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4159b552-0523-406a-8816-4aef10a5829e-metrics-certs podName:4159b552-0523-406a-8816-4aef10a5829e nodeName:}" failed. No retries permitted until 2026-07-28 15:14:01.986167885 +0000 UTC m=+3.036535973 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4159b552-0523-406a-8816-4aef10a5829e-metrics-certs") pod "network-metrics-daemon-hvlq9" (UID: "4159b552-0523-406a-8816-4aef10a5829e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 15:14:01.486724 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.486190    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6da27f06-fd24-42f1-9bcf-20f6aa3e716d-multus-cni-dir\") pod \"multus-mh4nm\" (UID: \"6da27f06-fd24-42f1-9bcf-20f6aa3e716d\") " pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.486724 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.486236    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b6c83382-dbd5-4f3e-a52a-f33a0365e94e-sys-fs\") pod \"aws-ebs-csi-driver-node-8wts9\" (UID: \"b6c83382-dbd5-4f3e-a52a-f33a0365e94e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wts9"
Jul 28 15:14:01.486724 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.486285    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6da27f06-fd24-42f1-9bcf-20f6aa3e716d-multus-socket-dir-parent\") pod \"multus-mh4nm\" (UID: \"6da27f06-fd24-42f1-9bcf-20f6aa3e716d\") " pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.486724 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.486314    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6da27f06-fd24-42f1-9bcf-20f6aa3e716d-host-run-multus-certs\") pod \"multus-mh4nm\" (UID: \"6da27f06-fd24-42f1-9bcf-20f6aa3e716d\") " pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.486724 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.486363    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7skv\" (UniqueName: \"kubernetes.io/projected/6da27f06-fd24-42f1-9bcf-20f6aa3e716d-kube-api-access-d7skv\") pod \"multus-mh4nm\" (UID: \"6da27f06-fd24-42f1-9bcf-20f6aa3e716d\") " pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.486724 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.486389    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b6c83382-dbd5-4f3e-a52a-f33a0365e94e-socket-dir\") pod \"aws-ebs-csi-driver-node-8wts9\" (UID: \"b6c83382-dbd5-4f3e-a52a-f33a0365e94e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wts9"
Jul 28 15:14:01.486724 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.486422    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c9a56fb7-e5de-4cd0-930f-0944440df51a-etc-sysctl-d\") pod \"tuned-r6ngg\" (UID: \"c9a56fb7-e5de-4cd0-930f-0944440df51a\") " pod="openshift-cluster-node-tuning-operator/tuned-r6ngg"
Jul 28 15:14:01.487621 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.486449    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6da27f06-fd24-42f1-9bcf-20f6aa3e716d-multus-conf-dir\") pod \"multus-mh4nm\" (UID: \"6da27f06-fd24-42f1-9bcf-20f6aa3e716d\") " pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.487621 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.486476    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rj64x\" (UniqueName: \"kubernetes.io/projected/4159b552-0523-406a-8816-4aef10a5829e-kube-api-access-rj64x\") pod \"network-metrics-daemon-hvlq9\" (UID: \"4159b552-0523-406a-8816-4aef10a5829e\") " pod="openshift-multus/network-metrics-daemon-hvlq9"
Jul 28 15:14:01.487621 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.486544    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6da27f06-fd24-42f1-9bcf-20f6aa3e716d-system-cni-dir\") pod \"multus-mh4nm\" (UID: \"6da27f06-fd24-42f1-9bcf-20f6aa3e716d\") " pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.487621 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.486893    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b6c83382-dbd5-4f3e-a52a-f33a0365e94e-device-dir\") pod \"aws-ebs-csi-driver-node-8wts9\" (UID: \"b6c83382-dbd5-4f3e-a52a-f33a0365e94e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wts9"
Jul 28 15:14:01.487621 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.486959    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6da27f06-fd24-42f1-9bcf-20f6aa3e716d-etc-kubernetes\") pod \"multus-mh4nm\" (UID: \"6da27f06-fd24-42f1-9bcf-20f6aa3e716d\") " pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.487621 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.487007    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c9a56fb7-e5de-4cd0-930f-0944440df51a-etc-kubernetes\") pod \"tuned-r6ngg\" (UID: \"c9a56fb7-e5de-4cd0-930f-0944440df51a\") " pod="openshift-cluster-node-tuning-operator/tuned-r6ngg"
Jul 28 15:14:01.487621 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.487097    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c9a56fb7-e5de-4cd0-930f-0944440df51a-sys\") pod \"tuned-r6ngg\" (UID: \"c9a56fb7-e5de-4cd0-930f-0944440df51a\") " pod="openshift-cluster-node-tuning-operator/tuned-r6ngg"
Jul 28 15:14:01.487621 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.487158    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b6c83382-dbd5-4f3e-a52a-f33a0365e94e-etc-selinux\") pod \"aws-ebs-csi-driver-node-8wts9\" (UID: \"b6c83382-dbd5-4f3e-a52a-f33a0365e94e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wts9"
Jul 28 15:14:01.487621 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.487206    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8426ba3a-6768-4cea-aad5-dc6f897b568d-host\") pod \"node-ca-d85z2\" (UID: \"8426ba3a-6768-4cea-aad5-dc6f897b568d\") " pod="openshift-image-registry/node-ca-d85z2"
Jul 28 15:14:01.487621 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.487258    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6da27f06-fd24-42f1-9bcf-20f6aa3e716d-multus-socket-dir-parent\") pod \"multus-mh4nm\" (UID: \"6da27f06-fd24-42f1-9bcf-20f6aa3e716d\") " pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.487621 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.487293    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6da27f06-fd24-42f1-9bcf-20f6aa3e716d-host-run-multus-certs\") pod \"multus-mh4nm\" (UID: \"6da27f06-fd24-42f1-9bcf-20f6aa3e716d\") " pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.487621 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.487342    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c9a56fb7-e5de-4cd0-930f-0944440df51a-lib-modules\") pod \"tuned-r6ngg\" (UID: \"c9a56fb7-e5de-4cd0-930f-0944440df51a\") " pod="openshift-cluster-node-tuning-operator/tuned-r6ngg"
Jul 28 15:14:01.487621 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.487457    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b6c83382-dbd5-4f3e-a52a-f33a0365e94e-socket-dir\") pod \"aws-ebs-csi-driver-node-8wts9\" (UID: \"b6c83382-dbd5-4f3e-a52a-f33a0365e94e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wts9"
Jul 28 15:14:01.487621 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.487497    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6da27f06-fd24-42f1-9bcf-20f6aa3e716d-host-var-lib-kubelet\") pod \"multus-mh4nm\" (UID: \"6da27f06-fd24-42f1-9bcf-20f6aa3e716d\") " pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.487621 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.487550    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6da27f06-fd24-42f1-9bcf-20f6aa3e716d-multus-conf-dir\") pod \"multus-mh4nm\" (UID: \"6da27f06-fd24-42f1-9bcf-20f6aa3e716d\") " pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.488490 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.487670    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c9a56fb7-e5de-4cd0-930f-0944440df51a-etc-sysctl-d\") pod \"tuned-r6ngg\" (UID: \"c9a56fb7-e5de-4cd0-930f-0944440df51a\") " pod="openshift-cluster-node-tuning-operator/tuned-r6ngg"
Jul 28 15:14:01.488490 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.487919    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6da27f06-fd24-42f1-9bcf-20f6aa3e716d-host-run-k8s-cni-cncf-io\") pod \"multus-mh4nm\" (UID: \"6da27f06-fd24-42f1-9bcf-20f6aa3e716d\") " pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.488490 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.487954    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dp99c\" (UniqueName: \"kubernetes.io/projected/8426ba3a-6768-4cea-aad5-dc6f897b568d-kube-api-access-dp99c\") pod \"node-ca-d85z2\" (UID: \"8426ba3a-6768-4cea-aad5-dc6f897b568d\") " pod="openshift-image-registry/node-ca-d85z2"
Jul 28 15:14:01.488490 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.487984    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/8426ba3a-6768-4cea-aad5-dc6f897b568d-serviceca\") pod \"node-ca-d85z2\" (UID: \"8426ba3a-6768-4cea-aad5-dc6f897b568d\") " pod="openshift-image-registry/node-ca-d85z2"
Jul 28 15:14:01.488490 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.488038    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6da27f06-fd24-42f1-9bcf-20f6aa3e716d-host-run-k8s-cni-cncf-io\") pod \"multus-mh4nm\" (UID: \"6da27f06-fd24-42f1-9bcf-20f6aa3e716d\") " pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.488490 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.488049    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6da27f06-fd24-42f1-9bcf-20f6aa3e716d-os-release\") pod \"multus-mh4nm\" (UID: \"6da27f06-fd24-42f1-9bcf-20f6aa3e716d\") " pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.488490 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.488091    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b6c83382-dbd5-4f3e-a52a-f33a0365e94e-registration-dir\") pod \"aws-ebs-csi-driver-node-8wts9\" (UID: \"b6c83382-dbd5-4f3e-a52a-f33a0365e94e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wts9"
Jul 28 15:14:01.488490 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.488221    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c9a56fb7-e5de-4cd0-930f-0944440df51a-etc-sysctl-conf\") pod \"tuned-r6ngg\" (UID: \"c9a56fb7-e5de-4cd0-930f-0944440df51a\") " pod="openshift-cluster-node-tuning-operator/tuned-r6ngg"
Jul 28 15:14:01.488490 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.487988    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6da27f06-fd24-42f1-9bcf-20f6aa3e716d-os-release\") pod \"multus-mh4nm\" (UID: \"6da27f06-fd24-42f1-9bcf-20f6aa3e716d\") " pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.488490 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.488264    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6da27f06-fd24-42f1-9bcf-20f6aa3e716d-host-run-netns\") pod \"multus-mh4nm\" (UID: \"6da27f06-fd24-42f1-9bcf-20f6aa3e716d\") " pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.488490 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.488274    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6da27f06-fd24-42f1-9bcf-20f6aa3e716d-host-var-lib-cni-multus\") pod \"multus-mh4nm\" (UID: \"6da27f06-fd24-42f1-9bcf-20f6aa3e716d\") " pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.488490 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.488309    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6da27f06-fd24-42f1-9bcf-20f6aa3e716d-multus-daemon-config\") pod \"multus-mh4nm\" (UID: \"6da27f06-fd24-42f1-9bcf-20f6aa3e716d\") " pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.488490 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.488311    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6da27f06-fd24-42f1-9bcf-20f6aa3e716d-host-var-lib-cni-bin\") pod \"multus-mh4nm\" (UID: \"6da27f06-fd24-42f1-9bcf-20f6aa3e716d\") " pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.488490 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.488397    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c9a56fb7-e5de-4cd0-930f-0944440df51a-etc-modprobe-d\") pod \"tuned-r6ngg\" (UID: \"c9a56fb7-e5de-4cd0-930f-0944440df51a\") " pod="openshift-cluster-node-tuning-operator/tuned-r6ngg"
Jul 28 15:14:01.488490 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.488425    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rq9wf\" (UniqueName: \"kubernetes.io/projected/b6c83382-dbd5-4f3e-a52a-f33a0365e94e-kube-api-access-rq9wf\") pod \"aws-ebs-csi-driver-node-8wts9\" (UID: \"b6c83382-dbd5-4f3e-a52a-f33a0365e94e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wts9"
Jul 28 15:14:01.489258 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.488672    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6da27f06-fd24-42f1-9bcf-20f6aa3e716d-cnibin\") pod \"multus-mh4nm\" (UID: \"6da27f06-fd24-42f1-9bcf-20f6aa3e716d\") " pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.489258 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.488716    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c87ad085-d80c-488c-a557-99f708627772-host-slash\") pod \"iptables-alerter-ncczz\" (UID: \"c87ad085-d80c-488c-a557-99f708627772\") " pod="openshift-network-operator/iptables-alerter-ncczz"
Jul 28 15:14:01.489258 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.488819    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6da27f06-fd24-42f1-9bcf-20f6aa3e716d-multus-daemon-config\") pod \"multus-mh4nm\" (UID: \"6da27f06-fd24-42f1-9bcf-20f6aa3e716d\") " pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.489258 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.488825    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c87ad085-d80c-488c-a557-99f708627772-host-slash\") pod \"iptables-alerter-ncczz\" (UID: \"c87ad085-d80c-488c-a557-99f708627772\") " pod="openshift-network-operator/iptables-alerter-ncczz"
Jul 28 15:14:01.489258 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.488870    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6da27f06-fd24-42f1-9bcf-20f6aa3e716d-host-var-lib-cni-multus\") pod \"multus-mh4nm\" (UID: \"6da27f06-fd24-42f1-9bcf-20f6aa3e716d\") " pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.489258 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.488871    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6da27f06-fd24-42f1-9bcf-20f6aa3e716d-cnibin\") pod \"multus-mh4nm\" (UID: \"6da27f06-fd24-42f1-9bcf-20f6aa3e716d\") " pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.489569 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.489413    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/c87ad085-d80c-488c-a557-99f708627772-iptables-alerter-script\") pod \"iptables-alerter-ncczz\" (UID: \"c87ad085-d80c-488c-a557-99f708627772\") " pod="openshift-network-operator/iptables-alerter-ncczz"
Jul 28 15:14:01.492071 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.491989    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c9a56fb7-e5de-4cd0-930f-0944440df51a-tmp\") pod \"tuned-r6ngg\" (UID: \"c9a56fb7-e5de-4cd0-930f-0944440df51a\") " pod="openshift-cluster-node-tuning-operator/tuned-r6ngg"
Jul 28 15:14:01.493073 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.493026    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c9a56fb7-e5de-4cd0-930f-0944440df51a-etc-tuned\") pod \"tuned-r6ngg\" (UID: \"c9a56fb7-e5de-4cd0-930f-0944440df51a\") " pod="openshift-cluster-node-tuning-operator/tuned-r6ngg"
Jul 28 15:14:01.493194 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:01.493081    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 15:14:01.493194 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:01.493108    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 15:14:01.493194 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:01.493123    2561 projected.go:196] Error preparing data for projected volume kube-api-access-sh8zn for pod openshift-network-diagnostics/network-check-target-mds5d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 15:14:01.493194 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:01.493184    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07bf4445-9e9d-45b5-9b36-e6cbd745ec0e-kube-api-access-sh8zn podName:07bf4445-9e9d-45b5-9b36-e6cbd745ec0e nodeName:}" failed. No retries permitted until 2026-07-28 15:14:01.993164732 +0000 UTC m=+3.043532817 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-sh8zn" (UniqueName: "kubernetes.io/projected/07bf4445-9e9d-45b5-9b36-e6cbd745ec0e-kube-api-access-sh8zn") pod "network-check-target-mds5d" (UID: "07bf4445-9e9d-45b5-9b36-e6cbd745ec0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 15:14:01.497044 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.497018    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q496t\" (UniqueName: \"kubernetes.io/projected/c9a56fb7-e5de-4cd0-930f-0944440df51a-kube-api-access-q496t\") pod \"tuned-r6ngg\" (UID: \"c9a56fb7-e5de-4cd0-930f-0944440df51a\") " pod="openshift-cluster-node-tuning-operator/tuned-r6ngg"
Jul 28 15:14:01.497614 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.497584    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rj64x\" (UniqueName: \"kubernetes.io/projected/4159b552-0523-406a-8816-4aef10a5829e-kube-api-access-rj64x\") pod \"network-metrics-daemon-hvlq9\" (UID: \"4159b552-0523-406a-8816-4aef10a5829e\") " pod="openshift-multus/network-metrics-daemon-hvlq9"
Jul 28 15:14:01.497773 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.497748    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5jbf\" (UniqueName: \"kubernetes.io/projected/c87ad085-d80c-488c-a557-99f708627772-kube-api-access-w5jbf\") pod \"iptables-alerter-ncczz\" (UID: \"c87ad085-d80c-488c-a557-99f708627772\") " pod="openshift-network-operator/iptables-alerter-ncczz"
Jul 28 15:14:01.498562 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.498510    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7skv\" (UniqueName: \"kubernetes.io/projected/6da27f06-fd24-42f1-9bcf-20f6aa3e716d-kube-api-access-d7skv\") pod \"multus-mh4nm\" (UID: \"6da27f06-fd24-42f1-9bcf-20f6aa3e716d\") " pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.501553 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.501532    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq9wf\" (UniqueName: \"kubernetes.io/projected/b6c83382-dbd5-4f3e-a52a-f33a0365e94e-kube-api-access-rq9wf\") pod \"aws-ebs-csi-driver-node-8wts9\" (UID: \"b6c83382-dbd5-4f3e-a52a-f33a0365e94e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wts9"
Jul 28 15:14:01.502488 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.502461    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dp99c\" (UniqueName: \"kubernetes.io/projected/8426ba3a-6768-4cea-aad5-dc6f897b568d-kube-api-access-dp99c\") pod \"node-ca-d85z2\" (UID: \"8426ba3a-6768-4cea-aad5-dc6f897b568d\") " pod="openshift-image-registry/node-ca-d85z2"
Jul 28 15:14:01.578100 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.578067    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lv5xt"
Jul 28 15:14:01.590142 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.589943    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-lrwfs"
Jul 28 15:14:01.602104 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.602058    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:01.610105 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.610080    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-drg4d"
Jul 28 15:14:01.619155 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.619124    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-r6ngg"
Jul 28 15:14:01.628182 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.628158    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mh4nm"
Jul 28 15:14:01.637996 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.637976    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-ncczz"
Jul 28 15:14:01.652911 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.652884    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-d85z2"
Jul 28 15:14:01.659833 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.659809    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wts9"
Jul 28 15:14:01.893319 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.893252    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20741b19-0b49-488f-86cc-c974cd83fe30-original-pull-secret\") pod \"global-pull-secret-syncer-qpvsz\" (UID: \"20741b19-0b49-488f-86cc-c974cd83fe30\") " pod="kube-system/global-pull-secret-syncer-qpvsz"
Jul 28 15:14:01.893453 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:01.893358    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 15:14:01.893453 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:01.893412    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20741b19-0b49-488f-86cc-c974cd83fe30-original-pull-secret podName:20741b19-0b49-488f-86cc-c974cd83fe30 nodeName:}" failed. No retries permitted until 2026-07-28 15:14:02.893396811 +0000 UTC m=+3.943764895 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20741b19-0b49-488f-86cc-c974cd83fe30-original-pull-secret") pod "global-pull-secret-syncer-qpvsz" (UID: "20741b19-0b49-488f-86cc-c974cd83fe30") : object "kube-system"/"original-pull-secret" not registered
Jul 28 15:14:01.993669 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.993633    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4159b552-0523-406a-8816-4aef10a5829e-metrics-certs\") pod \"network-metrics-daemon-hvlq9\" (UID: \"4159b552-0523-406a-8816-4aef10a5829e\") " pod="openshift-multus/network-metrics-daemon-hvlq9"
Jul 28 15:14:01.993895 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:01.993719    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh8zn\" (UniqueName: \"kubernetes.io/projected/07bf4445-9e9d-45b5-9b36-e6cbd745ec0e-kube-api-access-sh8zn\") pod \"network-check-target-mds5d\" (UID: \"07bf4445-9e9d-45b5-9b36-e6cbd745ec0e\") " pod="openshift-network-diagnostics/network-check-target-mds5d"
Jul 28 15:14:01.993895 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:01.993865    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 15:14:01.993895 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:01.993876    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 15:14:01.993895 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:01.993891    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 15:14:01.993895 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:01.993900    2561 projected.go:196] Error preparing data for projected volume kube-api-access-sh8zn for pod openshift-network-diagnostics/network-check-target-mds5d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 15:14:01.994166 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:01.993931    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4159b552-0523-406a-8816-4aef10a5829e-metrics-certs podName:4159b552-0523-406a-8816-4aef10a5829e nodeName:}" failed. No retries permitted until 2026-07-28 15:14:02.993910138 +0000 UTC m=+4.044278241 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4159b552-0523-406a-8816-4aef10a5829e-metrics-certs") pod "network-metrics-daemon-hvlq9" (UID: "4159b552-0523-406a-8816-4aef10a5829e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 15:14:01.994166 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:01.993956    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07bf4445-9e9d-45b5-9b36-e6cbd745ec0e-kube-api-access-sh8zn podName:07bf4445-9e9d-45b5-9b36-e6cbd745ec0e nodeName:}" failed. No retries permitted until 2026-07-28 15:14:02.993943339 +0000 UTC m=+4.044311429 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-sh8zn" (UniqueName: "kubernetes.io/projected/07bf4445-9e9d-45b5-9b36-e6cbd745ec0e-kube-api-access-sh8zn") pod "network-check-target-mds5d" (UID: "07bf4445-9e9d-45b5-9b36-e6cbd745ec0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 15:14:02.321610 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:02.321515    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 15:09:01 +0000 UTC" deadline="2028-04-26 04:26:56.446535948 +0000 UTC"
Jul 28 15:14:02.321610 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:02.321548    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15301h12m54.124991153s"
Jul 28 15:14:02.405681 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:02.405651    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpvsz"
Jul 28 15:14:02.405870 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:02.405787    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qpvsz" podUID="20741b19-0b49-488f-86cc-c974cd83fe30"
Jul 28 15:14:02.425770 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:02.425744    2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 28 15:14:02.619778 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:14:02.619750    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6da27f06_fd24_42f1_9bcf_20f6aa3e716d.slice/crio-41f99a5d069e24ea2dc00d1da7f61ea620b230e5c68aa8eae0f4927a6fff3b31 WatchSource:0}: Error finding container 41f99a5d069e24ea2dc00d1da7f61ea620b230e5c68aa8eae0f4927a6fff3b31: Status 404 returned error can't find the container with id 41f99a5d069e24ea2dc00d1da7f61ea620b230e5c68aa8eae0f4927a6fff3b31
Jul 28 15:14:02.620838 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:14:02.620769    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43c0a413_1cee_48b4_9c69_e7a5429dcc89.slice/crio-073e995d0b62d761012fadeb2cb205dd72605d96a65c98699f02cf2fc5c36e2a WatchSource:0}: Error finding container 073e995d0b62d761012fadeb2cb205dd72605d96a65c98699f02cf2fc5c36e2a: Status 404 returned error can't find the container with id 073e995d0b62d761012fadeb2cb205dd72605d96a65c98699f02cf2fc5c36e2a
Jul 28 15:14:02.626951 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:14:02.625306    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc87ad085_d80c_488c_a557_99f708627772.slice/crio-7f8dd0819ae23eb73c0cb91a73b037196c348c912a3b9ed0377b47b4bc2633c9 WatchSource:0}: Error finding container 7f8dd0819ae23eb73c0cb91a73b037196c348c912a3b9ed0377b47b4bc2633c9: Status 404 returned error can't find the container with id 7f8dd0819ae23eb73c0cb91a73b037196c348c912a3b9ed0377b47b4bc2633c9
Jul 28 15:14:02.627824 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:14:02.627793    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8426ba3a_6768_4cea_aad5_dc6f897b568d.slice/crio-77193a6012fdc79f88bc38c738f60271b68ea15760b34c10cef21666eb7b64e5 WatchSource:0}: Error finding container 77193a6012fdc79f88bc38c738f60271b68ea15760b34c10cef21666eb7b64e5: Status 404 returned error can't find the container with id 77193a6012fdc79f88bc38c738f60271b68ea15760b34c10cef21666eb7b64e5
Jul 28 15:14:02.629571 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:14:02.629535    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9a56fb7_e5de_4cd0_930f_0944440df51a.slice/crio-2da402906826cb226a85e57910f1b838a5b1509cf357027d6e3dfb970f305672 WatchSource:0}: Error finding container 2da402906826cb226a85e57910f1b838a5b1509cf357027d6e3dfb970f305672: Status 404 returned error can't find the container with id 2da402906826cb226a85e57910f1b838a5b1509cf357027d6e3dfb970f305672
Jul 28 15:14:02.654114 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:14:02.653803    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6c83382_dbd5_4f3e_a52a_f33a0365e94e.slice/crio-bb293083e53ecb9f629cb17014101592eb144e76f82c02bc973064d542e46d8c WatchSource:0}: Error finding container bb293083e53ecb9f629cb17014101592eb144e76f82c02bc973064d542e46d8c: Status 404 returned error can't find the container with id bb293083e53ecb9f629cb17014101592eb144e76f82c02bc973064d542e46d8c
Jul 28 15:14:02.654114 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:14:02.654100    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a40e45d_440d_4f88_8dc9_3047798a5239.slice/crio-a4cf8bd7d716996f5d71264ce168651f0b3c44f65619c1fbbc3fbcb881be6662 WatchSource:0}: Error finding container a4cf8bd7d716996f5d71264ce168651f0b3c44f65619c1fbbc3fbcb881be6662: Status 404 returned error can't find the container with id a4cf8bd7d716996f5d71264ce168651f0b3c44f65619c1fbbc3fbcb881be6662
Jul 28 15:14:02.901869 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:02.901611    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20741b19-0b49-488f-86cc-c974cd83fe30-original-pull-secret\") pod \"global-pull-secret-syncer-qpvsz\" (UID: \"20741b19-0b49-488f-86cc-c974cd83fe30\") " pod="kube-system/global-pull-secret-syncer-qpvsz"
Jul 28 15:14:02.901989 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:02.901761    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 15:14:02.902027 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:02.902011    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20741b19-0b49-488f-86cc-c974cd83fe30-original-pull-secret podName:20741b19-0b49-488f-86cc-c974cd83fe30 nodeName:}" failed. No retries permitted until 2026-07-28 15:14:04.901989027 +0000 UTC m=+5.952357139 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20741b19-0b49-488f-86cc-c974cd83fe30-original-pull-secret") pod "global-pull-secret-syncer-qpvsz" (UID: "20741b19-0b49-488f-86cc-c974cd83fe30") : object "kube-system"/"original-pull-secret" not registered
Jul 28 15:14:03.002888 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:03.002821    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh8zn\" (UniqueName: \"kubernetes.io/projected/07bf4445-9e9d-45b5-9b36-e6cbd745ec0e-kube-api-access-sh8zn\") pod \"network-check-target-mds5d\" (UID: \"07bf4445-9e9d-45b5-9b36-e6cbd745ec0e\") " pod="openshift-network-diagnostics/network-check-target-mds5d"
Jul 28 15:14:03.003087 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:03.002945    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4159b552-0523-406a-8816-4aef10a5829e-metrics-certs\") pod \"network-metrics-daemon-hvlq9\" (UID: \"4159b552-0523-406a-8816-4aef10a5829e\") " pod="openshift-multus/network-metrics-daemon-hvlq9"
Jul 28 15:14:03.003087 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:03.003013    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 15:14:03.003087 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:03.003037    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 15:14:03.003087 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:03.003052    2561 projected.go:196] Error preparing data for projected volume kube-api-access-sh8zn for pod openshift-network-diagnostics/network-check-target-mds5d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 15:14:03.003087 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:03.003052    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 15:14:03.003265 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:03.003119    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4159b552-0523-406a-8816-4aef10a5829e-metrics-certs podName:4159b552-0523-406a-8816-4aef10a5829e nodeName:}" failed. No retries permitted until 2026-07-28 15:14:05.003100319 +0000 UTC m=+6.053468404 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4159b552-0523-406a-8816-4aef10a5829e-metrics-certs") pod "network-metrics-daemon-hvlq9" (UID: "4159b552-0523-406a-8816-4aef10a5829e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 15:14:03.003265 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:03.003136    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07bf4445-9e9d-45b5-9b36-e6cbd745ec0e-kube-api-access-sh8zn podName:07bf4445-9e9d-45b5-9b36-e6cbd745ec0e nodeName:}" failed. No retries permitted until 2026-07-28 15:14:05.003129421 +0000 UTC m=+6.053497506 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-sh8zn" (UniqueName: "kubernetes.io/projected/07bf4445-9e9d-45b5-9b36-e6cbd745ec0e-kube-api-access-sh8zn") pod "network-check-target-mds5d" (UID: "07bf4445-9e9d-45b5-9b36-e6cbd745ec0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 15:14:03.322113 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:03.321995    2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 15:09:01 +0000 UTC" deadline="2028-01-24 05:01:06.321937396 +0000 UTC"
Jul 28 15:14:03.322113 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:03.322060    2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13069h47m2.999882536s"
Jul 28 15:14:03.408566 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:03.408530    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mds5d"
Jul 28 15:14:03.408779 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:03.408674    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mds5d" podUID="07bf4445-9e9d-45b5-9b36-e6cbd745ec0e"
Jul 28 15:14:03.409162 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:03.409140    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hvlq9"
Jul 28 15:14:03.409304 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:03.409281    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hvlq9" podUID="4159b552-0523-406a-8816-4aef10a5829e"
Jul 28 15:14:03.428151 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:03.428110    2561 generic.go:356] "Generic (PLEG): container finished" podID="693b917588309c87173dc513569db3fd" containerID="4416678f4a90d2bcb1ef89269803f4037ea86830e2d37d13c7162a711096ebcf" exitCode=0
Jul 28 15:14:03.428342 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:03.428212    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-125.ec2.internal" event={"ID":"693b917588309c87173dc513569db3fd","Type":"ContainerDied","Data":"4416678f4a90d2bcb1ef89269803f4037ea86830e2d37d13c7162a711096ebcf"}
Jul 28 15:14:03.446115 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:03.445946    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-125.ec2.internal" event={"ID":"15fb43c0c3be2d4b2fc124f01e5795dd","Type":"ContainerStarted","Data":"e85c7817eabdf6b361f62eaad14e2b4c1ff097d7afaa731af8959ed6ec4eb53a"}
Jul 28 15:14:03.452720 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:03.452611    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd" event={"ID":"2a40e45d-440d-4f88-8dc9-3047798a5239","Type":"ContainerStarted","Data":"a4cf8bd7d716996f5d71264ce168651f0b3c44f65619c1fbbc3fbcb881be6662"}
Jul 28 15:14:03.462058 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:03.461960    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-drg4d" event={"ID":"bd8af8c2-2c6b-4dbe-8bcf-e3d908de7bbe","Type":"ContainerStarted","Data":"f19599712e3101ff2e73ada60c1d06d93f24ed999413b9863d0c538af497b644"}
Jul 28 15:14:03.464982 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:03.464937    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-125.ec2.internal" podStartSLOduration=2.464919382 podStartE2EDuration="2.464919382s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 15:14:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:14:03.464310855 +0000 UTC m=+4.514678964" watchObservedRunningTime="2026-07-28 15:14:03.464919382 +0000 UTC m=+4.515287488"
Jul 28 15:14:03.473220 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:03.473169    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r6ngg" event={"ID":"c9a56fb7-e5de-4cd0-930f-0944440df51a","Type":"ContainerStarted","Data":"2da402906826cb226a85e57910f1b838a5b1509cf357027d6e3dfb970f305672"}
Jul 28 15:14:03.480778 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:03.480742    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lv5xt" event={"ID":"43c0a413-1cee-48b4-9c69-e7a5429dcc89","Type":"ContainerStarted","Data":"073e995d0b62d761012fadeb2cb205dd72605d96a65c98699f02cf2fc5c36e2a"}
Jul 28 15:14:03.489549 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:03.489421    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wts9" event={"ID":"b6c83382-dbd5-4f3e-a52a-f33a0365e94e","Type":"ContainerStarted","Data":"bb293083e53ecb9f629cb17014101592eb144e76f82c02bc973064d542e46d8c"}
Jul 28 15:14:03.499489 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:03.499422    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d85z2" event={"ID":"8426ba3a-6768-4cea-aad5-dc6f897b568d","Type":"ContainerStarted","Data":"77193a6012fdc79f88bc38c738f60271b68ea15760b34c10cef21666eb7b64e5"}
Jul 28 15:14:03.509200 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:03.508451    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ncczz" event={"ID":"c87ad085-d80c-488c-a557-99f708627772","Type":"ContainerStarted","Data":"7f8dd0819ae23eb73c0cb91a73b037196c348c912a3b9ed0377b47b4bc2633c9"}
Jul 28 15:14:03.522674 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:03.522637    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lrwfs" event={"ID":"8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0","Type":"ContainerStarted","Data":"8a433be596a12a7506d221fe10c041e37c0fe3582b973533bb12b200665c7835"}
Jul 28 15:14:03.534295 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:03.534204    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mh4nm" event={"ID":"6da27f06-fd24-42f1-9bcf-20f6aa3e716d","Type":"ContainerStarted","Data":"41f99a5d069e24ea2dc00d1da7f61ea620b230e5c68aa8eae0f4927a6fff3b31"}
Jul 28 15:14:04.405240 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:04.405194    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpvsz"
Jul 28 15:14:04.405774 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:04.405348    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qpvsz" podUID="20741b19-0b49-488f-86cc-c974cd83fe30"
Jul 28 15:14:04.564883 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:04.564399    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-125.ec2.internal" event={"ID":"693b917588309c87173dc513569db3fd","Type":"ContainerStarted","Data":"3e69b809484706a118deca10e48c0c1055c7fa052dc875866bb51cab2dfcf648"}
Jul 28 15:14:04.922666 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:04.922018    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20741b19-0b49-488f-86cc-c974cd83fe30-original-pull-secret\") pod \"global-pull-secret-syncer-qpvsz\" (UID: \"20741b19-0b49-488f-86cc-c974cd83fe30\") " pod="kube-system/global-pull-secret-syncer-qpvsz"
Jul 28 15:14:04.922666 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:04.922236    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 15:14:04.922666 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:04.922303    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20741b19-0b49-488f-86cc-c974cd83fe30-original-pull-secret podName:20741b19-0b49-488f-86cc-c974cd83fe30 nodeName:}" failed. No retries permitted until 2026-07-28 15:14:08.922283666 +0000 UTC m=+9.972651767 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20741b19-0b49-488f-86cc-c974cd83fe30-original-pull-secret") pod "global-pull-secret-syncer-qpvsz" (UID: "20741b19-0b49-488f-86cc-c974cd83fe30") : object "kube-system"/"original-pull-secret" not registered
Jul 28 15:14:05.023113 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:05.022578    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4159b552-0523-406a-8816-4aef10a5829e-metrics-certs\") pod \"network-metrics-daemon-hvlq9\" (UID: \"4159b552-0523-406a-8816-4aef10a5829e\") " pod="openshift-multus/network-metrics-daemon-hvlq9"
Jul 28 15:14:05.023113 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:05.022666    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh8zn\" (UniqueName: \"kubernetes.io/projected/07bf4445-9e9d-45b5-9b36-e6cbd745ec0e-kube-api-access-sh8zn\") pod \"network-check-target-mds5d\" (UID: \"07bf4445-9e9d-45b5-9b36-e6cbd745ec0e\") " pod="openshift-network-diagnostics/network-check-target-mds5d"
Jul 28 15:14:05.023113 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:05.022860    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 15:14:05.023113 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:05.022882    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 15:14:05.023113 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:05.022896    2561 projected.go:196] Error preparing data for projected volume kube-api-access-sh8zn for pod openshift-network-diagnostics/network-check-target-mds5d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 15:14:05.023113 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:05.022862    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 15:14:05.023113 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:05.022983    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07bf4445-9e9d-45b5-9b36-e6cbd745ec0e-kube-api-access-sh8zn podName:07bf4445-9e9d-45b5-9b36-e6cbd745ec0e nodeName:}" failed. No retries permitted until 2026-07-28 15:14:09.022962232 +0000 UTC m=+10.073330335 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-sh8zn" (UniqueName: "kubernetes.io/projected/07bf4445-9e9d-45b5-9b36-e6cbd745ec0e-kube-api-access-sh8zn") pod "network-check-target-mds5d" (UID: "07bf4445-9e9d-45b5-9b36-e6cbd745ec0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 15:14:05.023113 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:05.023005    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4159b552-0523-406a-8816-4aef10a5829e-metrics-certs podName:4159b552-0523-406a-8816-4aef10a5829e nodeName:}" failed. No retries permitted until 2026-07-28 15:14:09.022990663 +0000 UTC m=+10.073358757 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4159b552-0523-406a-8816-4aef10a5829e-metrics-certs") pod "network-metrics-daemon-hvlq9" (UID: "4159b552-0523-406a-8816-4aef10a5829e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 15:14:05.406604 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:05.405808    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mds5d"
Jul 28 15:14:05.406604 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:05.405965    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mds5d" podUID="07bf4445-9e9d-45b5-9b36-e6cbd745ec0e"
Jul 28 15:14:05.406604 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:05.406393    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hvlq9"
Jul 28 15:14:05.406604 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:05.406505    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hvlq9" podUID="4159b552-0523-406a-8816-4aef10a5829e"
Jul 28 15:14:06.404807 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:06.404773    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpvsz"
Jul 28 15:14:06.405042 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:06.404938    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qpvsz" podUID="20741b19-0b49-488f-86cc-c974cd83fe30"
Jul 28 15:14:07.405999 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:07.405009    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hvlq9"
Jul 28 15:14:07.405999 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:07.405171    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hvlq9" podUID="4159b552-0523-406a-8816-4aef10a5829e"
Jul 28 15:14:07.405999 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:07.405838    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mds5d"
Jul 28 15:14:07.405999 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:07.405955    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mds5d" podUID="07bf4445-9e9d-45b5-9b36-e6cbd745ec0e"
Jul 28 15:14:08.405427 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:08.405394    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpvsz"
Jul 28 15:14:08.405587 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:08.405539    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qpvsz" podUID="20741b19-0b49-488f-86cc-c974cd83fe30"
Jul 28 15:14:08.959465 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:08.959429    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20741b19-0b49-488f-86cc-c974cd83fe30-original-pull-secret\") pod \"global-pull-secret-syncer-qpvsz\" (UID: \"20741b19-0b49-488f-86cc-c974cd83fe30\") " pod="kube-system/global-pull-secret-syncer-qpvsz"
Jul 28 15:14:08.959949 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:08.959553    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 15:14:08.959949 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:08.959618    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20741b19-0b49-488f-86cc-c974cd83fe30-original-pull-secret podName:20741b19-0b49-488f-86cc-c974cd83fe30 nodeName:}" failed. No retries permitted until 2026-07-28 15:14:16.95960392 +0000 UTC m=+18.009972022 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20741b19-0b49-488f-86cc-c974cd83fe30-original-pull-secret") pod "global-pull-secret-syncer-qpvsz" (UID: "20741b19-0b49-488f-86cc-c974cd83fe30") : object "kube-system"/"original-pull-secret" not registered
Jul 28 15:14:09.060784 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:09.060498    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4159b552-0523-406a-8816-4aef10a5829e-metrics-certs\") pod \"network-metrics-daemon-hvlq9\" (UID: \"4159b552-0523-406a-8816-4aef10a5829e\") " pod="openshift-multus/network-metrics-daemon-hvlq9"
Jul 28 15:14:09.060784 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:09.060562    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh8zn\" (UniqueName: \"kubernetes.io/projected/07bf4445-9e9d-45b5-9b36-e6cbd745ec0e-kube-api-access-sh8zn\") pod \"network-check-target-mds5d\" (UID: \"07bf4445-9e9d-45b5-9b36-e6cbd745ec0e\") " pod="openshift-network-diagnostics/network-check-target-mds5d"
Jul 28 15:14:09.060784 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:09.060643    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 15:14:09.060784 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:09.060700    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 15:14:09.060784 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:09.060710    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4159b552-0523-406a-8816-4aef10a5829e-metrics-certs podName:4159b552-0523-406a-8816-4aef10a5829e nodeName:}" failed. No retries permitted until 2026-07-28 15:14:17.060689107 +0000 UTC m=+18.111057196 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4159b552-0523-406a-8816-4aef10a5829e-metrics-certs") pod "network-metrics-daemon-hvlq9" (UID: "4159b552-0523-406a-8816-4aef10a5829e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 15:14:09.060784 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:09.060720    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 15:14:09.060784 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:09.060734    2561 projected.go:196] Error preparing data for projected volume kube-api-access-sh8zn for pod openshift-network-diagnostics/network-check-target-mds5d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 15:14:09.060784 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:09.060781    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07bf4445-9e9d-45b5-9b36-e6cbd745ec0e-kube-api-access-sh8zn podName:07bf4445-9e9d-45b5-9b36-e6cbd745ec0e nodeName:}" failed. No retries permitted until 2026-07-28 15:14:17.060764986 +0000 UTC m=+18.111133074 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-sh8zn" (UniqueName: "kubernetes.io/projected/07bf4445-9e9d-45b5-9b36-e6cbd745ec0e-kube-api-access-sh8zn") pod "network-check-target-mds5d" (UID: "07bf4445-9e9d-45b5-9b36-e6cbd745ec0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 15:14:09.409736 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:09.409649    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mds5d"
Jul 28 15:14:09.409924 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:09.409796    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mds5d" podUID="07bf4445-9e9d-45b5-9b36-e6cbd745ec0e"
Jul 28 15:14:09.409995 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:09.409944    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hvlq9"
Jul 28 15:14:09.410416 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:09.410062    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hvlq9" podUID="4159b552-0523-406a-8816-4aef10a5829e"
Jul 28 15:14:10.405880 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:10.405752    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpvsz"
Jul 28 15:14:10.406466 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:10.405898    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qpvsz" podUID="20741b19-0b49-488f-86cc-c974cd83fe30"
Jul 28 15:14:11.406127 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:11.405994    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hvlq9"
Jul 28 15:14:11.406591 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:11.406229    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hvlq9" podUID="4159b552-0523-406a-8816-4aef10a5829e"
Jul 28 15:14:11.406591 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:11.406296    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mds5d"
Jul 28 15:14:11.406591 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:11.406389    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mds5d" podUID="07bf4445-9e9d-45b5-9b36-e6cbd745ec0e"
Jul 28 15:14:12.404764 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:12.404725    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpvsz"
Jul 28 15:14:12.404974 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:12.404900    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qpvsz" podUID="20741b19-0b49-488f-86cc-c974cd83fe30"
Jul 28 15:14:13.405334 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:13.405292    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hvlq9"
Jul 28 15:14:13.405879 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:13.405337    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mds5d"
Jul 28 15:14:13.405879 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:13.405437    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hvlq9" podUID="4159b552-0523-406a-8816-4aef10a5829e"
Jul 28 15:14:13.405879 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:13.405536    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mds5d" podUID="07bf4445-9e9d-45b5-9b36-e6cbd745ec0e"
Jul 28 15:14:14.404991 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:14.404953    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpvsz"
Jul 28 15:14:14.405167 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:14.405091    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qpvsz" podUID="20741b19-0b49-488f-86cc-c974cd83fe30"
Jul 28 15:14:15.405120 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:15.405083    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hvlq9"
Jul 28 15:14:15.405536 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:15.405235    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hvlq9" podUID="4159b552-0523-406a-8816-4aef10a5829e"
Jul 28 15:14:15.405536 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:15.405295    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mds5d"
Jul 28 15:14:15.405536 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:15.405392    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mds5d" podUID="07bf4445-9e9d-45b5-9b36-e6cbd745ec0e"
Jul 28 15:14:16.405699 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:16.405667    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpvsz"
Jul 28 15:14:16.406194 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:16.405803    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qpvsz" podUID="20741b19-0b49-488f-86cc-c974cd83fe30"
Jul 28 15:14:17.026017 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:17.025972    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20741b19-0b49-488f-86cc-c974cd83fe30-original-pull-secret\") pod \"global-pull-secret-syncer-qpvsz\" (UID: \"20741b19-0b49-488f-86cc-c974cd83fe30\") " pod="kube-system/global-pull-secret-syncer-qpvsz"
Jul 28 15:14:17.026229 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:17.026160    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 15:14:17.026275 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:17.026253    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20741b19-0b49-488f-86cc-c974cd83fe30-original-pull-secret podName:20741b19-0b49-488f-86cc-c974cd83fe30 nodeName:}" failed. No retries permitted until 2026-07-28 15:14:33.026231024 +0000 UTC m=+34.076599112 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20741b19-0b49-488f-86cc-c974cd83fe30-original-pull-secret") pod "global-pull-secret-syncer-qpvsz" (UID: "20741b19-0b49-488f-86cc-c974cd83fe30") : object "kube-system"/"original-pull-secret" not registered
Jul 28 15:14:17.126927 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:17.126886    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4159b552-0523-406a-8816-4aef10a5829e-metrics-certs\") pod \"network-metrics-daemon-hvlq9\" (UID: \"4159b552-0523-406a-8816-4aef10a5829e\") " pod="openshift-multus/network-metrics-daemon-hvlq9"
Jul 28 15:14:17.127106 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:17.126938    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh8zn\" (UniqueName: \"kubernetes.io/projected/07bf4445-9e9d-45b5-9b36-e6cbd745ec0e-kube-api-access-sh8zn\") pod \"network-check-target-mds5d\" (UID: \"07bf4445-9e9d-45b5-9b36-e6cbd745ec0e\") " pod="openshift-network-diagnostics/network-check-target-mds5d"
Jul 28 15:14:17.127106 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:17.127039    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 15:14:17.127106 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:17.127080    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 15:14:17.127106 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:17.127100    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 15:14:17.127308 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:17.127113    2561 projected.go:196] Error preparing data for projected volume kube-api-access-sh8zn for pod openshift-network-diagnostics/network-check-target-mds5d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 15:14:17.127308 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:17.127123    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4159b552-0523-406a-8816-4aef10a5829e-metrics-certs podName:4159b552-0523-406a-8816-4aef10a5829e nodeName:}" failed. No retries permitted until 2026-07-28 15:14:33.127102191 +0000 UTC m=+34.177470276 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4159b552-0523-406a-8816-4aef10a5829e-metrics-certs") pod "network-metrics-daemon-hvlq9" (UID: "4159b552-0523-406a-8816-4aef10a5829e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 15:14:17.127308 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:17.127164    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07bf4445-9e9d-45b5-9b36-e6cbd745ec0e-kube-api-access-sh8zn podName:07bf4445-9e9d-45b5-9b36-e6cbd745ec0e nodeName:}" failed. No retries permitted until 2026-07-28 15:14:33.127149972 +0000 UTC m=+34.177518078 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-sh8zn" (UniqueName: "kubernetes.io/projected/07bf4445-9e9d-45b5-9b36-e6cbd745ec0e-kube-api-access-sh8zn") pod "network-check-target-mds5d" (UID: "07bf4445-9e9d-45b5-9b36-e6cbd745ec0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 15:14:17.405735 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:17.405699    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mds5d"
Jul 28 15:14:17.406220 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:17.405699    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hvlq9"
Jul 28 15:14:17.406220 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:17.405820    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mds5d" podUID="07bf4445-9e9d-45b5-9b36-e6cbd745ec0e"
Jul 28 15:14:17.406220 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:17.405957    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hvlq9" podUID="4159b552-0523-406a-8816-4aef10a5829e"
Jul 28 15:14:18.405580 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:18.405550    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpvsz"
Jul 28 15:14:18.405779 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:18.405675    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qpvsz" podUID="20741b19-0b49-488f-86cc-c974cd83fe30"
Jul 28 15:14:19.405951 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:19.405916    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mds5d"
Jul 28 15:14:19.406393 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:19.406019    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mds5d" podUID="07bf4445-9e9d-45b5-9b36-e6cbd745ec0e"
Jul 28 15:14:19.406393 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:19.406075    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hvlq9"
Jul 28 15:14:19.406393 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:19.406188    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hvlq9" podUID="4159b552-0523-406a-8816-4aef10a5829e"
Jul 28 15:14:20.404980 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:20.404945    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpvsz"
Jul 28 15:14:20.405164 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:20.405092    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qpvsz" podUID="20741b19-0b49-488f-86cc-c974cd83fe30"
Jul 28 15:14:21.406114 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:21.406088    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hvlq9"
Jul 28 15:14:21.406489 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:21.406195    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hvlq9" podUID="4159b552-0523-406a-8816-4aef10a5829e"
Jul 28 15:14:21.406489 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:21.406088    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mds5d"
Jul 28 15:14:21.406589 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:21.406486    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mds5d" podUID="07bf4445-9e9d-45b5-9b36-e6cbd745ec0e"
Jul 28 15:14:21.609881 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:21.609620    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd" event={"ID":"2a40e45d-440d-4f88-8dc9-3047798a5239","Type":"ContainerStarted","Data":"ced3aec8315bcee4cd0eb8f6d77fd9d4d5df4dafe14d02c31179bb11c0440e7e"}
Jul 28 15:14:21.611320 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:21.611294    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-drg4d" event={"ID":"bd8af8c2-2c6b-4dbe-8bcf-e3d908de7bbe","Type":"ContainerStarted","Data":"1c184fa634f3246a6e7f79a9ed68a3605dd0b03f149874e8bdd55f0a954f2e7d"}
Jul 28 15:14:21.612674 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:21.612650    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-r6ngg" event={"ID":"c9a56fb7-e5de-4cd0-930f-0944440df51a","Type":"ContainerStarted","Data":"2b6fcca278afd214f04a59c8d80dadbabaed88b7c21279f4899c791c8b587fc2"}
Jul 28 15:14:21.614290 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:21.614103    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lv5xt" event={"ID":"43c0a413-1cee-48b4-9c69-e7a5429dcc89","Type":"ContainerStarted","Data":"95fc6a269129c41826b381a35082eceb24d3a4333efd2e8648d94a6805fb5850"}
Jul 28 15:14:21.615754 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:21.615731    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wts9" event={"ID":"b6c83382-dbd5-4f3e-a52a-f33a0365e94e","Type":"ContainerStarted","Data":"1602dde1e17e4f03153b06c9f10dd9406d976f71644df664fa614ed53f8ef7fc"}
Jul 28 15:14:21.617107 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:21.617080    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-d85z2" event={"ID":"8426ba3a-6768-4cea-aad5-dc6f897b568d","Type":"ContainerStarted","Data":"da94437e9d679f5382ac1f5008756a475c3c786c6f3c370de4a3121f2ff2ff65"}
Jul 28 15:14:21.618346 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:21.618324    2561 generic.go:356] "Generic (PLEG): container finished" podID="8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0" containerID="a643bb0e8e2e95a25c936a5082a39d544e95e8e17f97e52361f18e1b9b590cea" exitCode=0
Jul 28 15:14:21.618435 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:21.618389    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lrwfs" event={"ID":"8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0","Type":"ContainerDied","Data":"a643bb0e8e2e95a25c936a5082a39d544e95e8e17f97e52361f18e1b9b590cea"}
Jul 28 15:14:21.619732 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:21.619711    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mh4nm" event={"ID":"6da27f06-fd24-42f1-9bcf-20f6aa3e716d","Type":"ContainerStarted","Data":"0f06c705d083846527531cfc6cad446439b844185a88065abbe76ee9ccadb7be"}
Jul 28 15:14:21.631857 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:21.631799    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-drg4d" podStartSLOduration=6.793395581 podStartE2EDuration="21.631786496s" totalImagesPullingTime="14.838390915s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:14:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:14:21.631207946 +0000 UTC m=+22.681576051" watchObservedRunningTime="2026-07-28 15:14:21.631786496 +0000 UTC m=+22.682154600"
Jul 28 15:14:21.632040 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:21.632018    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-125.ec2.internal" podStartSLOduration=20.632013069 podStartE2EDuration="20.632013069s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 15:14:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:14:04.593300304 +0000 UTC m=+5.643668416" watchObservedRunningTime="2026-07-28 15:14:21.632013069 +0000 UTC m=+22.682381174"
Jul 28 15:14:21.669667 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:21.669617    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mh4nm" podStartSLOduration=2.8794406649999997 podStartE2EDuration="21.669601414s" totalImagesPullingTime="18.790160749s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 15:14:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:14:21.669200666 +0000 UTC m=+22.719568771" watchObservedRunningTime="2026-07-28 15:14:21.669601414 +0000 UTC m=+22.719969520"
Jul 28 15:14:21.670063 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:21.670035    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lv5xt" podStartSLOduration=2.944040653 podStartE2EDuration="21.67002759s" totalImagesPullingTime="18.725986937s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 15:14:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:14:21.649536229 +0000 UTC m=+22.699904330" watchObservedRunningTime="2026-07-28 15:14:21.67002759 +0000 UTC m=+22.720395694"
Jul 28 15:14:21.685959 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:21.685895    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-d85z2" podStartSLOduration=2.981391941 podStartE2EDuration="21.685874935s" totalImagesPullingTime="18.704482994s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 15:14:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:14:21.68512464 +0000 UTC m=+22.735492748" watchObservedRunningTime="2026-07-28 15:14:21.685874935 +0000 UTC m=+22.736243041"
Jul 28 15:14:22.110443 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:22.110362    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-drg4d"
Jul 28 15:14:22.111058 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:22.111035    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-drg4d"
Jul 28 15:14:22.128233 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:22.128178    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-r6ngg" podStartSLOduration=3.412644919 podStartE2EDuration="22.128155411s" totalImagesPullingTime="18.715510492s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 15:14:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:14:21.730450774 +0000 UTC m=+22.780818881" watchObservedRunningTime="2026-07-28 15:14:22.128155411 +0000 UTC m=+23.178523517"
Jul 28 15:14:22.405246 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:22.405209    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpvsz"
Jul 28 15:14:22.405412 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:22.405347    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qpvsz" podUID="20741b19-0b49-488f-86cc-c974cd83fe30"
Jul 28 15:14:22.624788 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:22.624748    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd" event={"ID":"2a40e45d-440d-4f88-8dc9-3047798a5239","Type":"ContainerStarted","Data":"1827a5c856896cabd4363bcaa55a90fd932b160032154927464c42e6acf920a8"}
Jul 28 15:14:22.625614 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:22.624843    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd" event={"ID":"2a40e45d-440d-4f88-8dc9-3047798a5239","Type":"ContainerStarted","Data":"721d9956c354a09a2e31b13b5596ac755ef795bf2c1dfca73e4db124cea79218"}
Jul 28 15:14:22.625614 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:22.624880    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd" event={"ID":"2a40e45d-440d-4f88-8dc9-3047798a5239","Type":"ContainerStarted","Data":"d7da33692cda750d65fa47dc4704e39e453573f89918a6a2142b6cd9081861eb"}
Jul 28 15:14:22.625614 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:22.624909    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd" event={"ID":"2a40e45d-440d-4f88-8dc9-3047798a5239","Type":"ContainerStarted","Data":"6351a307ee4b9dbb53adb6b12f57d55b00642c4e4e7938140a115fe8441148dd"}
Jul 28 15:14:22.625614 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:22.624938    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd" event={"ID":"2a40e45d-440d-4f88-8dc9-3047798a5239","Type":"ContainerStarted","Data":"29c98b0113047e7ac79c37ad65473e6295dee58873d6004c3ca40c73c7d058c3"}
Jul 28 15:14:22.625614 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:22.625284    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-drg4d"
Jul 28 15:14:22.625767 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:22.625683    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-drg4d"
Jul 28 15:14:22.928128 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:22.928096    2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 28 15:14:22.963769 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:22.963731    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drg4d_bd8af8c2-2c6b-4dbe-8bcf-e3d908de7bbe/konnectivity-agent/0.log" limit=1024
Jul 28 15:14:23.055703 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:23.055674    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drg4d_bd8af8c2-2c6b-4dbe-8bcf-e3d908de7bbe/konnectivity-agent/0.log" limit=1024
Jul 28 15:14:23.334843 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:23.334717    2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T15:14:22.928122467Z","UUID":"91562ce8-9a1f-413b-9bc7-c58d22b967b4","Handler":null,"Name":"","Endpoint":""}
Jul 28 15:14:23.336351 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:23.336327    2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 28 15:14:23.336462 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:23.336370    2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 28 15:14:23.405673 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:23.405645    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mds5d"
Jul 28 15:14:23.405867 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:23.405645    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hvlq9"
Jul 28 15:14:23.405867 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:23.405763    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mds5d" podUID="07bf4445-9e9d-45b5-9b36-e6cbd745ec0e"
Jul 28 15:14:23.405982 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:23.405866    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hvlq9" podUID="4159b552-0523-406a-8816-4aef10a5829e"
Jul 28 15:14:23.630376 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:23.630280    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wts9" event={"ID":"b6c83382-dbd5-4f3e-a52a-f33a0365e94e","Type":"ContainerStarted","Data":"8f9a515dfd3a3c817229e725acd289a5c1f675e3dea52b6900be583ab59c096d"}
Jul 28 15:14:23.632145 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:23.632116    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-ncczz" event={"ID":"c87ad085-d80c-488c-a557-99f708627772","Type":"ContainerStarted","Data":"9dcd0f1802504941037c8e95ad4872d56a60414c5a06419b9c18ed14564a421b"}
Jul 28 15:14:23.650568 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:23.650516    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-ncczz" podStartSLOduration=4.944569281 podStartE2EDuration="23.650502513s" totalImagesPullingTime="18.705933232s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 15:14:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:14:23.650335763 +0000 UTC m=+24.700703868" watchObservedRunningTime="2026-07-28 15:14:23.650502513 +0000 UTC m=+24.700870618"
Jul 28 15:14:23.772261 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:23.772204    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drg4d_bd8af8c2-2c6b-4dbe-8bcf-e3d908de7bbe/konnectivity-agent/0.log" limit=1024
Jul 28 15:14:23.913640 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:23.913556    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drg4d_bd8af8c2-2c6b-4dbe-8bcf-e3d908de7bbe/konnectivity-agent/0.log" limit=1024
Jul 28 15:14:24.405335 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:24.405303    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpvsz"
Jul 28 15:14:24.405521 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:24.405429    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qpvsz" podUID="20741b19-0b49-488f-86cc-c974cd83fe30"
Jul 28 15:14:24.638356 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:24.638327    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd" event={"ID":"2a40e45d-440d-4f88-8dc9-3047798a5239","Type":"ContainerStarted","Data":"48ef9f0dbed2d21f261cf08d0476be282bb3ee66b8d8fe0f8f684def6b7f9eab"}
Jul 28 15:14:24.640535 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:24.640500    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wts9" event={"ID":"b6c83382-dbd5-4f3e-a52a-f33a0365e94e","Type":"ContainerStarted","Data":"1c8f85486076402f3ae49be94a81b229c190f91ba9b212cfdc0dd3c766612469"}
Jul 28 15:14:25.405215 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:25.404972    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mds5d"
Jul 28 15:14:25.405501 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:25.405061    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hvlq9"
Jul 28 15:14:25.405568 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:25.405536    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mds5d" podUID="07bf4445-9e9d-45b5-9b36-e6cbd745ec0e"
Jul 28 15:14:25.405654 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:25.405631    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hvlq9" podUID="4159b552-0523-406a-8816-4aef10a5829e"
Jul 28 15:14:26.405723 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:26.405597    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpvsz"
Jul 28 15:14:26.406813 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:26.405731    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qpvsz" podUID="20741b19-0b49-488f-86cc-c974cd83fe30"
Jul 28 15:14:26.646405 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:26.646212    2561 generic.go:356] "Generic (PLEG): container finished" podID="8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0" containerID="df6877e50afb02b7e3ea6dbc6dcbc124aec1a7a32f360523dcf0842501d6885c" exitCode=0
Jul 28 15:14:26.646591 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:26.646284    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lrwfs" event={"ID":"8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0","Type":"ContainerDied","Data":"df6877e50afb02b7e3ea6dbc6dcbc124aec1a7a32f360523dcf0842501d6885c"}
Jul 28 15:14:26.650209 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:26.650177    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd" event={"ID":"2a40e45d-440d-4f88-8dc9-3047798a5239","Type":"ContainerStarted","Data":"f286facd1687ca98992b78a67d3bf092bd1cfac0cdd27c5ccc44b1d9440f550f"}
Jul 28 15:14:26.650442 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:26.650427    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:26.650513 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:26.650489    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:26.666064 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:26.666044    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:26.672950 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:26.672913    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8wts9" podStartSLOduration=5.490952114 podStartE2EDuration="26.672899783s" totalImagesPullingTime="21.181947669s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 15:14:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:14:24.663659017 +0000 UTC m=+25.714027121" watchObservedRunningTime="2026-07-28 15:14:26.672899783 +0000 UTC m=+27.723267890"
Jul 28 15:14:26.705703 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:26.705663    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd" podStartSLOduration=7.945897688 podStartE2EDuration="26.70565027s" totalImagesPullingTime="18.759752582s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 15:14:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:14:26.705119375 +0000 UTC m=+27.755487480" watchObservedRunningTime="2026-07-28 15:14:26.70565027 +0000 UTC m=+27.756018375"
Jul 28 15:14:27.405163 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:27.405129    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hvlq9"
Jul 28 15:14:27.405396 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:27.405248    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hvlq9" podUID="4159b552-0523-406a-8816-4aef10a5829e"
Jul 28 15:14:27.405396 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:27.405302    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mds5d"
Jul 28 15:14:27.405469 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:27.405389    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mds5d" podUID="07bf4445-9e9d-45b5-9b36-e6cbd745ec0e"
Jul 28 15:14:27.676300 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:27.669044    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:27.699796 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:27.699764    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:14:27.871749 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:27.871705    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drg4d_bd8af8c2-2c6b-4dbe-8bcf-e3d908de7bbe/konnectivity-agent/0.log" limit=1024
Jul 28 15:14:27.961144 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:27.961073    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drg4d_bd8af8c2-2c6b-4dbe-8bcf-e3d908de7bbe/konnectivity-agent/0.log" limit=1024
Jul 28 15:14:28.138580 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:28.138551    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drg4d_bd8af8c2-2c6b-4dbe-8bcf-e3d908de7bbe/konnectivity-agent/0.log" limit=1024
Jul 28 15:14:28.248760 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:28.248731    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drg4d_bd8af8c2-2c6b-4dbe-8bcf-e3d908de7bbe/konnectivity-agent/0.log" limit=1024
Jul 28 15:14:28.404896 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:28.404870    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpvsz"
Jul 28 15:14:28.405095 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:28.404970    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qpvsz" podUID="20741b19-0b49-488f-86cc-c974cd83fe30"
Jul 28 15:14:28.664990 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:28.664960    2561 generic.go:356] "Generic (PLEG): container finished" podID="8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0" containerID="558474efe0280d81c9cd8901ea7da1bc309bb71382e394b1cc837f2a9d9ab6c9" exitCode=0
Jul 28 15:14:28.665148 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:28.665005    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lrwfs" event={"ID":"8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0","Type":"ContainerDied","Data":"558474efe0280d81c9cd8901ea7da1bc309bb71382e394b1cc837f2a9d9ab6c9"}
Jul 28 15:14:28.716007 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:28.715979    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qpvsz"]
Jul 28 15:14:28.716378 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:28.716083    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpvsz"
Jul 28 15:14:28.716378 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:28.716164    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qpvsz" podUID="20741b19-0b49-488f-86cc-c974cd83fe30"
Jul 28 15:14:28.718742 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:28.718713    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mds5d"]
Jul 28 15:14:28.718924 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:28.718838    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mds5d"
Jul 28 15:14:28.718989 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:28.718942    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mds5d" podUID="07bf4445-9e9d-45b5-9b36-e6cbd745ec0e"
Jul 28 15:14:28.719391 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:28.719357    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hvlq9"]
Jul 28 15:14:28.719500 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:28.719469    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hvlq9"
Jul 28 15:14:28.719616 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:28.719585    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hvlq9" podUID="4159b552-0523-406a-8816-4aef10a5829e"
Jul 28 15:14:30.405336 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:30.405160    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hvlq9"
Jul 28 15:14:30.405719 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:30.405210    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpvsz"
Jul 28 15:14:30.405719 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:30.405423    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hvlq9" podUID="4159b552-0523-406a-8816-4aef10a5829e"
Jul 28 15:14:30.405719 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:30.405210    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mds5d"
Jul 28 15:14:30.405719 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:30.405518    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qpvsz" podUID="20741b19-0b49-488f-86cc-c974cd83fe30"
Jul 28 15:14:30.405719 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:30.405580    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mds5d" podUID="07bf4445-9e9d-45b5-9b36-e6cbd745ec0e"
Jul 28 15:14:30.672412 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:30.672375    2561 generic.go:356] "Generic (PLEG): container finished" podID="8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0" containerID="dc5aeb91de91c9c26e9117103731b28171e3cec537f0a7ec42e93280d23803bf" exitCode=0
Jul 28 15:14:30.672587 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:30.672460    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lrwfs" event={"ID":"8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0","Type":"ContainerDied","Data":"dc5aeb91de91c9c26e9117103731b28171e3cec537f0a7ec42e93280d23803bf"}
Jul 28 15:14:32.405387 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:32.405350    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hvlq9"
Jul 28 15:14:32.405387 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:32.405384    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mds5d"
Jul 28 15:14:32.406030 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:32.405385    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpvsz"
Jul 28 15:14:32.406030 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:32.405519    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-hvlq9" podUID="4159b552-0523-406a-8816-4aef10a5829e"
Jul 28 15:14:32.406030 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:32.405584    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mds5d" podUID="07bf4445-9e9d-45b5-9b36-e6cbd745ec0e"
Jul 28 15:14:32.406030 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:32.405650    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qpvsz" podUID="20741b19-0b49-488f-86cc-c974cd83fe30"
Jul 28 15:14:33.049128 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:33.049089    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20741b19-0b49-488f-86cc-c974cd83fe30-original-pull-secret\") pod \"global-pull-secret-syncer-qpvsz\" (UID: \"20741b19-0b49-488f-86cc-c974cd83fe30\") " pod="kube-system/global-pull-secret-syncer-qpvsz"
Jul 28 15:14:33.049309 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:33.049263    2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 28 15:14:33.049362 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:33.049339    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/20741b19-0b49-488f-86cc-c974cd83fe30-original-pull-secret podName:20741b19-0b49-488f-86cc-c974cd83fe30 nodeName:}" failed. No retries permitted until 2026-07-28 15:15:05.049318873 +0000 UTC m=+66.099686958 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/20741b19-0b49-488f-86cc-c974cd83fe30-original-pull-secret") pod "global-pull-secret-syncer-qpvsz" (UID: "20741b19-0b49-488f-86cc-c974cd83fe30") : object "kube-system"/"original-pull-secret" not registered
Jul 28 15:14:33.149954 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:33.149916    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4159b552-0523-406a-8816-4aef10a5829e-metrics-certs\") pod \"network-metrics-daemon-hvlq9\" (UID: \"4159b552-0523-406a-8816-4aef10a5829e\") " pod="openshift-multus/network-metrics-daemon-hvlq9"
Jul 28 15:14:33.150150 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:33.149978    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh8zn\" (UniqueName: \"kubernetes.io/projected/07bf4445-9e9d-45b5-9b36-e6cbd745ec0e-kube-api-access-sh8zn\") pod \"network-check-target-mds5d\" (UID: \"07bf4445-9e9d-45b5-9b36-e6cbd745ec0e\") " pod="openshift-network-diagnostics/network-check-target-mds5d"
Jul 28 15:14:33.150150 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:33.150084    2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 15:14:33.150150 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:33.150101    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 28 15:14:33.150150 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:33.150122    2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 28 15:14:33.150150 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:33.150135    2561 projected.go:196] Error preparing data for projected volume kube-api-access-sh8zn for pod openshift-network-diagnostics/network-check-target-mds5d: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 15:14:33.150150 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:33.150154    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4159b552-0523-406a-8816-4aef10a5829e-metrics-certs podName:4159b552-0523-406a-8816-4aef10a5829e nodeName:}" failed. No retries permitted until 2026-07-28 15:15:05.150135028 +0000 UTC m=+66.200503112 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4159b552-0523-406a-8816-4aef10a5829e-metrics-certs") pod "network-metrics-daemon-hvlq9" (UID: "4159b552-0523-406a-8816-4aef10a5829e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 28 15:14:33.150470 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:33.150181    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/07bf4445-9e9d-45b5-9b36-e6cbd745ec0e-kube-api-access-sh8zn podName:07bf4445-9e9d-45b5-9b36-e6cbd745ec0e nodeName:}" failed. No retries permitted until 2026-07-28 15:15:05.150167149 +0000 UTC m=+66.200535233 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-sh8zn" (UniqueName: "kubernetes.io/projected/07bf4445-9e9d-45b5-9b36-e6cbd745ec0e-kube-api-access-sh8zn") pod "network-check-target-mds5d" (UID: "07bf4445-9e9d-45b5-9b36-e6cbd745ec0e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 28 15:14:33.563216 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:33.563182    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drg4d_bd8af8c2-2c6b-4dbe-8bcf-e3d908de7bbe/konnectivity-agent/0.log" limit=1024
Jul 28 15:14:34.255549 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:34.255480    2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-125.ec2.internal" event="NodeReady"
Jul 28 15:14:34.255692 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:34.255626    2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 28 15:14:34.318724 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:34.318690    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-fdbqx"]
Jul 28 15:14:34.348739 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:34.348703    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-m7sbs"]
Jul 28 15:14:34.348924 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:34.348847    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fdbqx"
Jul 28 15:14:34.352056 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:34.352031    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 28 15:14:34.352198 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:34.352082    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 28 15:14:34.352198 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:34.352031    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wplwl\""
Jul 28 15:14:34.363735 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:34.363706    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fdbqx"]
Jul 28 15:14:34.363864 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:34.363752    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-m7sbs"]
Jul 28 15:14:34.363928 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:34.363889    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-m7sbs"
Jul 28 15:14:34.367947 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:34.367793    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 28 15:14:34.367947 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:34.367873    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 28 15:14:34.367947 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:34.367946    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 28 15:14:34.368197 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:34.368027    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-lbhsv\""
Jul 28 15:14:34.405859 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:34.405806    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hvlq9"
Jul 28 15:14:34.406065 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:34.405871    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mds5d"
Jul 28 15:14:34.406065 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:34.405870    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpvsz"
Jul 28 15:14:34.410724 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:34.410701    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 28 15:14:34.410884 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:34.410776    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 15:14:34.411365 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:34.411337    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zdqjt\""
Jul 28 15:14:34.411365 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:34.411352    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 28 15:14:34.411559 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:34.411346    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 15:14:34.411691 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:34.411676    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vfzkj\""
Jul 28 15:14:34.458241 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:34.458211    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b76cac71-0442-432d-afc4-c12ef52b534c-cert\") pod \"ingress-canary-m7sbs\" (UID: \"b76cac71-0442-432d-afc4-c12ef52b534c\") " pod="openshift-ingress-canary/ingress-canary-m7sbs"
Jul 28 15:14:34.458386 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:34.458256    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/30319eb2-0e70-4b57-b466-15f119f06c01-config-volume\") pod \"dns-default-fdbqx\" (UID: \"30319eb2-0e70-4b57-b466-15f119f06c01\") " pod="openshift-dns/dns-default-fdbqx"
Jul 28 15:14:34.458386 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:34.458305    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/30319eb2-0e70-4b57-b466-15f119f06c01-metrics-tls\") pod \"dns-default-fdbqx\" (UID: \"30319eb2-0e70-4b57-b466-15f119f06c01\") " pod="openshift-dns/dns-default-fdbqx"
Jul 28 15:14:34.458386 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:34.458333    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30319eb2-0e70-4b57-b466-15f119f06c01-tmp-dir\") pod \"dns-default-fdbqx\" (UID: \"30319eb2-0e70-4b57-b466-15f119f06c01\") " pod="openshift-dns/dns-default-fdbqx"
Jul 28 15:14:34.458386 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:34.458356    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6njp\" (UniqueName: \"kubernetes.io/projected/30319eb2-0e70-4b57-b466-15f119f06c01-kube-api-access-b6njp\") pod \"dns-default-fdbqx\" (UID: \"30319eb2-0e70-4b57-b466-15f119f06c01\") " pod="openshift-dns/dns-default-fdbqx"
Jul 28 15:14:34.458567 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:34.458420    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zrxh\" (UniqueName: \"kubernetes.io/projected/b76cac71-0442-432d-afc4-c12ef52b534c-kube-api-access-8zrxh\") pod \"ingress-canary-m7sbs\" (UID: \"b76cac71-0442-432d-afc4-c12ef52b534c\") " pod="openshift-ingress-canary/ingress-canary-m7sbs"
Jul 28 15:14:34.544490 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:34.544402    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drg4d_bd8af8c2-2c6b-4dbe-8bcf-e3d908de7bbe/konnectivity-agent/0.log" limit=1024
Jul 28 15:14:34.559284 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:34.559259    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6njp\" (UniqueName: \"kubernetes.io/projected/30319eb2-0e70-4b57-b466-15f119f06c01-kube-api-access-b6njp\") pod \"dns-default-fdbqx\" (UID: \"30319eb2-0e70-4b57-b466-15f119f06c01\") " pod="openshift-dns/dns-default-fdbqx"
Jul 28 15:14:34.559284 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:34.559290    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zrxh\" (UniqueName: \"kubernetes.io/projected/b76cac71-0442-432d-afc4-c12ef52b534c-kube-api-access-8zrxh\") pod \"ingress-canary-m7sbs\" (UID: \"b76cac71-0442-432d-afc4-c12ef52b534c\") " pod="openshift-ingress-canary/ingress-canary-m7sbs"
Jul 28 15:14:34.559510 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:34.559341    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b76cac71-0442-432d-afc4-c12ef52b534c-cert\") pod \"ingress-canary-m7sbs\" (UID: \"b76cac71-0442-432d-afc4-c12ef52b534c\") " pod="openshift-ingress-canary/ingress-canary-m7sbs"
Jul 28 15:14:34.559562 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:34.559514    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/30319eb2-0e70-4b57-b466-15f119f06c01-config-volume\") pod \"dns-default-fdbqx\" (UID: \"30319eb2-0e70-4b57-b466-15f119f06c01\") " pod="openshift-dns/dns-default-fdbqx"
Jul 28 15:14:34.559612 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:34.559575    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/30319eb2-0e70-4b57-b466-15f119f06c01-metrics-tls\") pod \"dns-default-fdbqx\" (UID: \"30319eb2-0e70-4b57-b466-15f119f06c01\") " pod="openshift-dns/dns-default-fdbqx"
Jul 28 15:14:34.559665 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:34.559623    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30319eb2-0e70-4b57-b466-15f119f06c01-tmp-dir\") pod \"dns-default-fdbqx\" (UID: \"30319eb2-0e70-4b57-b466-15f119f06c01\") " pod="openshift-dns/dns-default-fdbqx"
Jul 28 15:14:34.559729 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:34.559712    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 15:14:34.559770 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:34.559765    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30319eb2-0e70-4b57-b466-15f119f06c01-metrics-tls podName:30319eb2-0e70-4b57-b466-15f119f06c01 nodeName:}" failed. No retries permitted until 2026-07-28 15:14:35.059750978 +0000 UTC m=+36.110119060 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/30319eb2-0e70-4b57-b466-15f119f06c01-metrics-tls") pod "dns-default-fdbqx" (UID: "30319eb2-0e70-4b57-b466-15f119f06c01") : secret "dns-default-metrics-tls" not found
Jul 28 15:14:34.560003 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:34.559986    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30319eb2-0e70-4b57-b466-15f119f06c01-tmp-dir\") pod \"dns-default-fdbqx\" (UID: \"30319eb2-0e70-4b57-b466-15f119f06c01\") " pod="openshift-dns/dns-default-fdbqx"
Jul 28 15:14:34.560146 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:34.560129    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/30319eb2-0e70-4b57-b466-15f119f06c01-config-volume\") pod \"dns-default-fdbqx\" (UID: \"30319eb2-0e70-4b57-b466-15f119f06c01\") " pod="openshift-dns/dns-default-fdbqx"
Jul 28 15:14:34.564648 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:34.564624    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b76cac71-0442-432d-afc4-c12ef52b534c-cert\") pod \"ingress-canary-m7sbs\" (UID: \"b76cac71-0442-432d-afc4-c12ef52b534c\") " pod="openshift-ingress-canary/ingress-canary-m7sbs"
Jul 28 15:14:34.569758 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:34.569710    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6njp\" (UniqueName: \"kubernetes.io/projected/30319eb2-0e70-4b57-b466-15f119f06c01-kube-api-access-b6njp\") pod \"dns-default-fdbqx\" (UID: \"30319eb2-0e70-4b57-b466-15f119f06c01\") " pod="openshift-dns/dns-default-fdbqx"
Jul 28 15:14:34.569881 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:34.569782    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zrxh\" (UniqueName: \"kubernetes.io/projected/b76cac71-0442-432d-afc4-c12ef52b534c-kube-api-access-8zrxh\") pod \"ingress-canary-m7sbs\" (UID: \"b76cac71-0442-432d-afc4-c12ef52b534c\") " pod="openshift-ingress-canary/ingress-canary-m7sbs"
Jul 28 15:14:34.637588 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:34.637548    2561 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-drg4d_bd8af8c2-2c6b-4dbe-8bcf-e3d908de7bbe/konnectivity-agent/0.log" limit=1024
Jul 28 15:14:34.673878 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:34.673848    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-m7sbs"
Jul 28 15:14:35.047796 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:35.047610    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-m7sbs"]
Jul 28 15:14:35.064077 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:35.064053    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/30319eb2-0e70-4b57-b466-15f119f06c01-metrics-tls\") pod \"dns-default-fdbqx\" (UID: \"30319eb2-0e70-4b57-b466-15f119f06c01\") " pod="openshift-dns/dns-default-fdbqx"
Jul 28 15:14:35.064192 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:35.064179    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 15:14:35.064243 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:35.064233    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30319eb2-0e70-4b57-b466-15f119f06c01-metrics-tls podName:30319eb2-0e70-4b57-b466-15f119f06c01 nodeName:}" failed. No retries permitted until 2026-07-28 15:14:36.064218896 +0000 UTC m=+37.114586979 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/30319eb2-0e70-4b57-b466-15f119f06c01-metrics-tls") pod "dns-default-fdbqx" (UID: "30319eb2-0e70-4b57-b466-15f119f06c01") : secret "dns-default-metrics-tls" not found
Jul 28 15:14:35.126421 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:14:35.126390    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb76cac71_0442_432d_afc4_c12ef52b534c.slice/crio-98ab852590178a98a207c925860c159da13c227a6c77c2cd8005f38dd021ab53 WatchSource:0}: Error finding container 98ab852590178a98a207c925860c159da13c227a6c77c2cd8005f38dd021ab53: Status 404 returned error can't find the container with id 98ab852590178a98a207c925860c159da13c227a6c77c2cd8005f38dd021ab53
Jul 28 15:14:35.686338 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:35.686295    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-m7sbs" event={"ID":"b76cac71-0442-432d-afc4-c12ef52b534c","Type":"ContainerStarted","Data":"98ab852590178a98a207c925860c159da13c227a6c77c2cd8005f38dd021ab53"}
Jul 28 15:14:35.688845 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:35.688803    2561 generic.go:356] "Generic (PLEG): container finished" podID="8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0" containerID="e97694b73c898d6041772c1070f57856efe22b2bff8e1b0fee22f4c162ceb71e" exitCode=0
Jul 28 15:14:35.688968 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:35.688859    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lrwfs" event={"ID":"8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0","Type":"ContainerDied","Data":"e97694b73c898d6041772c1070f57856efe22b2bff8e1b0fee22f4c162ceb71e"}
Jul 28 15:14:36.073669 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:36.073571    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/30319eb2-0e70-4b57-b466-15f119f06c01-metrics-tls\") pod \"dns-default-fdbqx\" (UID: \"30319eb2-0e70-4b57-b466-15f119f06c01\") " pod="openshift-dns/dns-default-fdbqx"
Jul 28 15:14:36.073851 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:36.073747    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 15:14:36.073851 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:36.073836    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30319eb2-0e70-4b57-b466-15f119f06c01-metrics-tls podName:30319eb2-0e70-4b57-b466-15f119f06c01 nodeName:}" failed. No retries permitted until 2026-07-28 15:14:38.073801334 +0000 UTC m=+39.124169420 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/30319eb2-0e70-4b57-b466-15f119f06c01-metrics-tls") pod "dns-default-fdbqx" (UID: "30319eb2-0e70-4b57-b466-15f119f06c01") : secret "dns-default-metrics-tls" not found
Jul 28 15:14:36.695738 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:36.695702    2561 generic.go:356] "Generic (PLEG): container finished" podID="8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0" containerID="2351a3b896994784281325dfda1b199b7bc1f7a34c5babee9755c094812d05f5" exitCode=0
Jul 28 15:14:36.696183 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:36.695776    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lrwfs" event={"ID":"8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0","Type":"ContainerDied","Data":"2351a3b896994784281325dfda1b199b7bc1f7a34c5babee9755c094812d05f5"}
Jul 28 15:14:37.702946 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:37.702723    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-lrwfs" event={"ID":"8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0","Type":"ContainerStarted","Data":"58e060477aa62ede11e1cee8ab8d2821fc69c0be7350ff5c2519ca15950202e9"}
Jul 28 15:14:38.092055 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:38.092011    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/30319eb2-0e70-4b57-b466-15f119f06c01-metrics-tls\") pod \"dns-default-fdbqx\" (UID: \"30319eb2-0e70-4b57-b466-15f119f06c01\") " pod="openshift-dns/dns-default-fdbqx"
Jul 28 15:14:38.092231 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:38.092186    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 15:14:38.092280 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:38.092266    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30319eb2-0e70-4b57-b466-15f119f06c01-metrics-tls podName:30319eb2-0e70-4b57-b466-15f119f06c01 nodeName:}" failed. No retries permitted until 2026-07-28 15:14:42.092245576 +0000 UTC m=+43.142613678 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/30319eb2-0e70-4b57-b466-15f119f06c01-metrics-tls") pod "dns-default-fdbqx" (UID: "30319eb2-0e70-4b57-b466-15f119f06c01") : secret "dns-default-metrics-tls" not found
Jul 28 15:14:38.706784 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:38.706744    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-m7sbs" event={"ID":"b76cac71-0442-432d-afc4-c12ef52b534c","Type":"ContainerStarted","Data":"f8e9314012df8e573b1c2dd07a56130c35f02108e00819eed19874f1c565ffb6"}
Jul 28 15:14:38.726224 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:38.726171    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-lrwfs" podStartSLOduration=7.9032030429999995 podStartE2EDuration="38.726152707s" totalImagesPullingTime="30.822949664s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 15:14:00 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:14:37.735575457 +0000 UTC m=+38.785943564" watchObservedRunningTime="2026-07-28 15:14:38.726152707 +0000 UTC m=+39.776520812"
Jul 28 15:14:38.726548 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:38.726515    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-m7sbs" podStartSLOduration=1.888329471 podStartE2EDuration="4.726506342s" totalImagesPullingTime="2.838176871s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:14:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:14:38.724970827 +0000 UTC m=+39.775338950" watchObservedRunningTime="2026-07-28 15:14:38.726506342 +0000 UTC m=+39.776874445"
Jul 28 15:14:39.267423 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.267388    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-hfwq7"]
Jul 28 15:14:39.270278 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.270262    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-hfwq7"
Jul 28 15:14:39.274385 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.274362    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 28 15:14:39.274385 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.274372    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-kv964\""
Jul 28 15:14:39.274532 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.274380    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 28 15:14:39.277927 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.277903    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-hfwq7"]
Jul 28 15:14:39.302139 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.302111    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fv7t9\" (UniqueName: \"kubernetes.io/projected/615eb69b-2f19-4483-b1fd-7be078553384-kube-api-access-fv7t9\") pod \"volume-data-source-validator-549c6d54cf-hfwq7\" (UID: \"615eb69b-2f19-4483-b1fd-7be078553384\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-hfwq7"
Jul 28 15:14:39.362668 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.362638    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-5tz62"]
Jul 28 15:14:39.365396 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.365370    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-5tz62"
Jul 28 15:14:39.368718 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.368698    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-lbskt\""
Jul 28 15:14:39.378654 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.378635    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-fzgwv"]
Jul 28 15:14:39.381418 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.381403    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-df69h"]
Jul 28 15:14:39.381549 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.381530    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-fzgwv"
Jul 28 15:14:39.384353 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.384333    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-5tz62"]
Jul 28 15:14:39.384456 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.384447    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-df69h"
Jul 28 15:14:39.385151 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.385128    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 28 15:14:39.386479 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.386461    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-qqs2f\""
Jul 28 15:14:39.386723 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.386707    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 28 15:14:39.386854 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.386706    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 28 15:14:39.386955 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.386727    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 28 15:14:39.393342 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.393320    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 28 15:14:39.394336 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.394315    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-5nlvh\""
Jul 28 15:14:39.394804 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.394734    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 28 15:14:39.394804 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.394770    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 28 15:14:39.394972 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.394958    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 28 15:14:39.395683 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.395660    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 28 15:14:39.396005 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.395981    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-fzgwv"]
Jul 28 15:14:39.402810 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.402788    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b173c54c-c79a-4cdd-803b-c0b218c95bda-snapshots\") pod \"insights-operator-5885fdb759-fzgwv\" (UID: \"b173c54c-c79a-4cdd-803b-c0b218c95bda\") " pod="openshift-insights/insights-operator-5885fdb759-fzgwv"
Jul 28 15:14:39.402912 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.402818    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b173c54c-c79a-4cdd-803b-c0b218c95bda-service-ca-bundle\") pod \"insights-operator-5885fdb759-fzgwv\" (UID: \"b173c54c-c79a-4cdd-803b-c0b218c95bda\") " pod="openshift-insights/insights-operator-5885fdb759-fzgwv"
Jul 28 15:14:39.402912 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.402854    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b173c54c-c79a-4cdd-803b-c0b218c95bda-serving-cert\") pod \"insights-operator-5885fdb759-fzgwv\" (UID: \"b173c54c-c79a-4cdd-803b-c0b218c95bda\") " pod="openshift-insights/insights-operator-5885fdb759-fzgwv"
Jul 28 15:14:39.402912 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.402887    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv7t9\" (UniqueName: \"kubernetes.io/projected/615eb69b-2f19-4483-b1fd-7be078553384-kube-api-access-fv7t9\") pod \"volume-data-source-validator-549c6d54cf-hfwq7\" (UID: \"615eb69b-2f19-4483-b1fd-7be078553384\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-hfwq7"
Jul 28 15:14:39.402912 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.402905    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf96m\" (UniqueName: \"kubernetes.io/projected/8c5d4df8-409b-4317-9654-61b8d19b0b38-kube-api-access-lf96m\") pod \"network-check-source-7d88cb55d8-5tz62\" (UID: \"8c5d4df8-409b-4317-9654-61b8d19b0b38\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-5tz62"
Jul 28 15:14:39.403145 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.402956    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4ps2\" (UniqueName: \"kubernetes.io/projected/c5cbe82e-7228-42f0-8706-5faac882b35e-kube-api-access-f4ps2\") pod \"cluster-monitoring-operator-548b489cb8-df69h\" (UID: \"c5cbe82e-7228-42f0-8706-5faac882b35e\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-df69h"
Jul 28 15:14:39.403145 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.402981    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b173c54c-c79a-4cdd-803b-c0b218c95bda-tmp\") pod \"insights-operator-5885fdb759-fzgwv\" (UID: \"b173c54c-c79a-4cdd-803b-c0b218c95bda\") " pod="openshift-insights/insights-operator-5885fdb759-fzgwv"
Jul 28 15:14:39.403145 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.403022    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b173c54c-c79a-4cdd-803b-c0b218c95bda-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-fzgwv\" (UID: \"b173c54c-c79a-4cdd-803b-c0b218c95bda\") " pod="openshift-insights/insights-operator-5885fdb759-fzgwv"
Jul 28 15:14:39.403145 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.403097    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjw4k\" (UniqueName: \"kubernetes.io/projected/b173c54c-c79a-4cdd-803b-c0b218c95bda-kube-api-access-hjw4k\") pod \"insights-operator-5885fdb759-fzgwv\" (UID: \"b173c54c-c79a-4cdd-803b-c0b218c95bda\") " pod="openshift-insights/insights-operator-5885fdb759-fzgwv"
Jul 28 15:14:39.403145 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.403130    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c5cbe82e-7228-42f0-8706-5faac882b35e-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-df69h\" (UID: \"c5cbe82e-7228-42f0-8706-5faac882b35e\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-df69h"
Jul 28 15:14:39.403354 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.403190    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5cbe82e-7228-42f0-8706-5faac882b35e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-df69h\" (UID: \"c5cbe82e-7228-42f0-8706-5faac882b35e\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-df69h"
Jul 28 15:14:39.404363 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.404343    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-df69h"]
Jul 28 15:14:39.427983 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.427954    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fv7t9\" (UniqueName: \"kubernetes.io/projected/615eb69b-2f19-4483-b1fd-7be078553384-kube-api-access-fv7t9\") pod \"volume-data-source-validator-549c6d54cf-hfwq7\" (UID: \"615eb69b-2f19-4483-b1fd-7be078553384\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-hfwq7"
Jul 28 15:14:39.468434 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.468406    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bfkmm"]
Jul 28 15:14:39.471366 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.471351    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bfkmm"
Jul 28 15:14:39.476372 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.476351    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 28 15:14:39.476372 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.476363    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-fxb7b\""
Jul 28 15:14:39.476550 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.476374    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 28 15:14:39.476550 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.476392    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 28 15:14:39.476687 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.476664    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 28 15:14:39.480024 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.480007    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7dc8547f57-57ktc"]
Jul 28 15:14:39.482601 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.482589    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7dc8547f57-57ktc"
Jul 28 15:14:39.485311 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.485296    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 28 15:14:39.485806 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.485786    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 28 15:14:39.485906 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.485812    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 28 15:14:39.486079 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.485969    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 28 15:14:39.486164 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.486082    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 28 15:14:39.486164 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.486093    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-p28x8\""
Jul 28 15:14:39.486439 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.486421    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 28 15:14:39.487538 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.487514    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bfkmm"]
Jul 28 15:14:39.504158 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.504139    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjw4k\" (UniqueName: \"kubernetes.io/projected/b173c54c-c79a-4cdd-803b-c0b218c95bda-kube-api-access-hjw4k\") pod \"insights-operator-5885fdb759-fzgwv\" (UID: \"b173c54c-c79a-4cdd-803b-c0b218c95bda\") " pod="openshift-insights/insights-operator-5885fdb759-fzgwv"
Jul 28 15:14:39.504277 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.504174    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec1ccecc-777e-492b-b655-75a18faf1aea-service-ca-bundle\") pod \"router-default-7dc8547f57-57ktc\" (UID: \"ec1ccecc-777e-492b-b655-75a18faf1aea\") " pod="openshift-ingress/router-default-7dc8547f57-57ktc"
Jul 28 15:14:39.504277 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.504204    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c5cbe82e-7228-42f0-8706-5faac882b35e-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-df69h\" (UID: \"c5cbe82e-7228-42f0-8706-5faac882b35e\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-df69h"
Jul 28 15:14:39.504277 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.504228    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ec1ccecc-777e-492b-b655-75a18faf1aea-default-certificate\") pod \"router-default-7dc8547f57-57ktc\" (UID: \"ec1ccecc-777e-492b-b655-75a18faf1aea\") " pod="openshift-ingress/router-default-7dc8547f57-57ktc"
Jul 28 15:14:39.504277 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.504260    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5cbe82e-7228-42f0-8706-5faac882b35e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-df69h\" (UID: \"c5cbe82e-7228-42f0-8706-5faac882b35e\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-df69h"
Jul 28 15:14:39.504467 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.504296    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jltp\" (UniqueName: \"kubernetes.io/projected/a8c7852f-a649-484b-b4e9-b24146452370-kube-api-access-5jltp\") pod \"service-ca-operator-5d6c75f84f-bfkmm\" (UID: \"a8c7852f-a649-484b-b4e9-b24146452370\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bfkmm"
Jul 28 15:14:39.504467 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.504327    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b173c54c-c79a-4cdd-803b-c0b218c95bda-snapshots\") pod \"insights-operator-5885fdb759-fzgwv\" (UID: \"b173c54c-c79a-4cdd-803b-c0b218c95bda\") " pod="openshift-insights/insights-operator-5885fdb759-fzgwv"
Jul 28 15:14:39.504467 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.504351    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b173c54c-c79a-4cdd-803b-c0b218c95bda-service-ca-bundle\") pod \"insights-operator-5885fdb759-fzgwv\" (UID: \"b173c54c-c79a-4cdd-803b-c0b218c95bda\") " pod="openshift-insights/insights-operator-5885fdb759-fzgwv"
Jul 28 15:14:39.504467 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:39.504376    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 28 15:14:39.504467 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.504375    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b173c54c-c79a-4cdd-803b-c0b218c95bda-serving-cert\") pod \"insights-operator-5885fdb759-fzgwv\" (UID: \"b173c54c-c79a-4cdd-803b-c0b218c95bda\") " pod="openshift-insights/insights-operator-5885fdb759-fzgwv"
Jul 28 15:14:39.504467 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:39.504448    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5cbe82e-7228-42f0-8706-5faac882b35e-cluster-monitoring-operator-tls podName:c5cbe82e-7228-42f0-8706-5faac882b35e nodeName:}" failed. No retries permitted until 2026-07-28 15:14:40.00442883 +0000 UTC m=+41.054796919 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c5cbe82e-7228-42f0-8706-5faac882b35e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-df69h" (UID: "c5cbe82e-7228-42f0-8706-5faac882b35e") : secret "cluster-monitoring-operator-tls" not found
Jul 28 15:14:39.505629 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.504474    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a8c7852f-a649-484b-b4e9-b24146452370-serving-cert\") pod \"service-ca-operator-5d6c75f84f-bfkmm\" (UID: \"a8c7852f-a649-484b-b4e9-b24146452370\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bfkmm"
Jul 28 15:14:39.505629 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.504523    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdrpj\" (UniqueName: \"kubernetes.io/projected/ec1ccecc-777e-492b-b655-75a18faf1aea-kube-api-access-kdrpj\") pod \"router-default-7dc8547f57-57ktc\" (UID: \"ec1ccecc-777e-492b-b655-75a18faf1aea\") " pod="openshift-ingress/router-default-7dc8547f57-57ktc"
Jul 28 15:14:39.505629 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.504554    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf96m\" (UniqueName: \"kubernetes.io/projected/8c5d4df8-409b-4317-9654-61b8d19b0b38-kube-api-access-lf96m\") pod \"network-check-source-7d88cb55d8-5tz62\" (UID: \"8c5d4df8-409b-4317-9654-61b8d19b0b38\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-5tz62"
Jul 28 15:14:39.505629 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.504577    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ec1ccecc-777e-492b-b655-75a18faf1aea-stats-auth\") pod \"router-default-7dc8547f57-57ktc\" (UID: \"ec1ccecc-777e-492b-b655-75a18faf1aea\") " pod="openshift-ingress/router-default-7dc8547f57-57ktc"
Jul 28 15:14:39.505629 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.504617    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a8c7852f-a649-484b-b4e9-b24146452370-config\") pod \"service-ca-operator-5d6c75f84f-bfkmm\" (UID: \"a8c7852f-a649-484b-b4e9-b24146452370\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bfkmm"
Jul 28 15:14:39.505629 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.504749    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4ps2\" (UniqueName: \"kubernetes.io/projected/c5cbe82e-7228-42f0-8706-5faac882b35e-kube-api-access-f4ps2\") pod \"cluster-monitoring-operator-548b489cb8-df69h\" (UID: \"c5cbe82e-7228-42f0-8706-5faac882b35e\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-df69h"
Jul 28 15:14:39.505629 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.504782    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec1ccecc-777e-492b-b655-75a18faf1aea-metrics-certs\") pod \"router-default-7dc8547f57-57ktc\" (UID: \"ec1ccecc-777e-492b-b655-75a18faf1aea\") " pod="openshift-ingress/router-default-7dc8547f57-57ktc"
Jul 28 15:14:39.505629 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.504813    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b173c54c-c79a-4cdd-803b-c0b218c95bda-tmp\") pod \"insights-operator-5885fdb759-fzgwv\" (UID: \"b173c54c-c79a-4cdd-803b-c0b218c95bda\") " pod="openshift-insights/insights-operator-5885fdb759-fzgwv"
Jul 28 15:14:39.505629 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.504901    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b173c54c-c79a-4cdd-803b-c0b218c95bda-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-fzgwv\" (UID: \"b173c54c-c79a-4cdd-803b-c0b218c95bda\") " pod="openshift-insights/insights-operator-5885fdb759-fzgwv"
Jul 28 15:14:39.505629 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.504996    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c5cbe82e-7228-42f0-8706-5faac882b35e-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-df69h\" (UID: \"c5cbe82e-7228-42f0-8706-5faac882b35e\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-df69h"
Jul 28 15:14:39.505629 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.505105    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/b173c54c-c79a-4cdd-803b-c0b218c95bda-snapshots\") pod \"insights-operator-5885fdb759-fzgwv\" (UID: \"b173c54c-c79a-4cdd-803b-c0b218c95bda\") " pod="openshift-insights/insights-operator-5885fdb759-fzgwv"
Jul 28 15:14:39.505629 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.505269    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b173c54c-c79a-4cdd-803b-c0b218c95bda-tmp\") pod \"insights-operator-5885fdb759-fzgwv\" (UID: \"b173c54c-c79a-4cdd-803b-c0b218c95bda\") " pod="openshift-insights/insights-operator-5885fdb759-fzgwv"
Jul 28 15:14:39.505629 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.505326    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b173c54c-c79a-4cdd-803b-c0b218c95bda-service-ca-bundle\") pod \"insights-operator-5885fdb759-fzgwv\" (UID: \"b173c54c-c79a-4cdd-803b-c0b218c95bda\") " pod="openshift-insights/insights-operator-5885fdb759-fzgwv"
Jul 28 15:14:39.506455 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.506439    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b173c54c-c79a-4cdd-803b-c0b218c95bda-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-fzgwv\" (UID: \"b173c54c-c79a-4cdd-803b-c0b218c95bda\") " pod="openshift-insights/insights-operator-5885fdb759-fzgwv"
Jul 28 15:14:39.507567 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.507551    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b173c54c-c79a-4cdd-803b-c0b218c95bda-serving-cert\") pod \"insights-operator-5885fdb759-fzgwv\" (UID: \"b173c54c-c79a-4cdd-803b-c0b218c95bda\") " pod="openshift-insights/insights-operator-5885fdb759-fzgwv"
Jul 28 15:14:39.507802 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.507787    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7dc8547f57-57ktc"]
Jul 28 15:14:39.519180 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.519125    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4ps2\" (UniqueName: \"kubernetes.io/projected/c5cbe82e-7228-42f0-8706-5faac882b35e-kube-api-access-f4ps2\") pod \"cluster-monitoring-operator-548b489cb8-df69h\" (UID: \"c5cbe82e-7228-42f0-8706-5faac882b35e\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-df69h"
Jul 28 15:14:39.523284 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.523264    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf96m\" (UniqueName: \"kubernetes.io/projected/8c5d4df8-409b-4317-9654-61b8d19b0b38-kube-api-access-lf96m\") pod \"network-check-source-7d88cb55d8-5tz62\" (UID: \"8c5d4df8-409b-4317-9654-61b8d19b0b38\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-5tz62"
Jul 28 15:14:39.524116 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.524097    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjw4k\" (UniqueName: \"kubernetes.io/projected/b173c54c-c79a-4cdd-803b-c0b218c95bda-kube-api-access-hjw4k\") pod \"insights-operator-5885fdb759-fzgwv\" (UID: \"b173c54c-c79a-4cdd-803b-c0b218c95bda\") " pod="openshift-insights/insights-operator-5885fdb759-fzgwv"
Jul 28 15:14:39.579227 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.579190    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-hfwq7"
Jul 28 15:14:39.580215 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.580197    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-55f49db7cc-hls2k"]
Jul 28 15:14:39.583603 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.583590    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55f49db7cc-hls2k"
Jul 28 15:14:39.587654 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.587632    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 28 15:14:39.587654 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.587659    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 28 15:14:39.588378 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.588359    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-p229n\""
Jul 28 15:14:39.588471 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.588404    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 28 15:14:39.595358 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.595297    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 28 15:14:39.599486 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.599463    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-55f49db7cc-hls2k"]
Jul 28 15:14:39.605841 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.605798    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1c546354-dfcf-4cfd-9d78-9836622382db-registry-certificates\") pod \"image-registry-55f49db7cc-hls2k\" (UID: \"1c546354-dfcf-4cfd-9d78-9836622382db\") " pod="openshift-image-registry/image-registry-55f49db7cc-hls2k"
Jul 28 15:14:39.605933 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.605849    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1c546354-dfcf-4cfd-9d78-9836622382db-installation-pull-secrets\") pod \"image-registry-55f49db7cc-hls2k\" (UID: \"1c546354-dfcf-4cfd-9d78-9836622382db\") " pod="openshift-image-registry/image-registry-55f49db7cc-hls2k"
Jul 28 15:14:39.605933 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.605900    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a8c7852f-a649-484b-b4e9-b24146452370-serving-cert\") pod \"service-ca-operator-5d6c75f84f-bfkmm\" (UID: \"a8c7852f-a649-484b-b4e9-b24146452370\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bfkmm"
Jul 28 15:14:39.606032 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.605934    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1c546354-dfcf-4cfd-9d78-9836622382db-image-registry-private-configuration\") pod \"image-registry-55f49db7cc-hls2k\" (UID: \"1c546354-dfcf-4cfd-9d78-9836622382db\") " pod="openshift-image-registry/image-registry-55f49db7cc-hls2k"
Jul 28 15:14:39.606032 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.605953    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1c546354-dfcf-4cfd-9d78-9836622382db-trusted-ca\") pod \"image-registry-55f49db7cc-hls2k\" (UID: \"1c546354-dfcf-4cfd-9d78-9836622382db\") " pod="openshift-image-registry/image-registry-55f49db7cc-hls2k"
Jul 28 15:14:39.606032 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.605981    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jltp\" (UniqueName: \"kubernetes.io/projected/a8c7852f-a649-484b-b4e9-b24146452370-kube-api-access-5jltp\") pod \"service-ca-operator-5d6c75f84f-bfkmm\" (UID: \"a8c7852f-a649-484b-b4e9-b24146452370\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bfkmm"
Jul 28 15:14:39.606177 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.606043    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ec1ccecc-777e-492b-b655-75a18faf1aea-stats-auth\") pod \"router-default-7dc8547f57-57ktc\" (UID: \"ec1ccecc-777e-492b-b655-75a18faf1aea\") " pod="openshift-ingress/router-default-7dc8547f57-57ktc"
Jul 28 15:14:39.606177 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.606072    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6gpp\" (UniqueName: \"kubernetes.io/projected/1c546354-dfcf-4cfd-9d78-9836622382db-kube-api-access-m6gpp\") pod \"image-registry-55f49db7cc-hls2k\" (UID: \"1c546354-dfcf-4cfd-9d78-9836622382db\") " pod="openshift-image-registry/image-registry-55f49db7cc-hls2k"
Jul 28 15:14:39.606177 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.606099    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a8c7852f-a649-484b-b4e9-b24146452370-config\") pod \"service-ca-operator-5d6c75f84f-bfkmm\" (UID: \"a8c7852f-a649-484b-b4e9-b24146452370\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bfkmm"
Jul 28 15:14:39.606177 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.606117    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec1ccecc-777e-492b-b655-75a18faf1aea-metrics-certs\") pod \"router-default-7dc8547f57-57ktc\" (UID: \"ec1ccecc-777e-492b-b655-75a18faf1aea\") " pod="openshift-ingress/router-default-7dc8547f57-57ktc"
Jul 28 15:14:39.606177 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.606148    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1c546354-dfcf-4cfd-9d78-9836622382db-bound-sa-token\") pod \"image-registry-55f49db7cc-hls2k\" (UID: \"1c546354-dfcf-4cfd-9d78-9836622382db\") " pod="openshift-image-registry/image-registry-55f49db7cc-hls2k"
Jul 28 15:14:39.606410 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.606205    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ec1ccecc-777e-492b-b655-75a18faf1aea-default-certificate\") pod \"router-default-7dc8547f57-57ktc\" (UID: \"ec1ccecc-777e-492b-b655-75a18faf1aea\") " pod="openshift-ingress/router-default-7dc8547f57-57ktc"
Jul 28 15:14:39.606410 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.606248    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec1ccecc-777e-492b-b655-75a18faf1aea-service-ca-bundle\") pod \"router-default-7dc8547f57-57ktc\" (UID: \"ec1ccecc-777e-492b-b655-75a18faf1aea\") " pod="openshift-ingress/router-default-7dc8547f57-57ktc"
Jul 28 15:14:39.606410 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:39.606269    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 15:14:39.606410 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.606281    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1c546354-dfcf-4cfd-9d78-9836622382db-registry-tls\") pod \"image-registry-55f49db7cc-hls2k\" (UID: \"1c546354-dfcf-4cfd-9d78-9836622382db\") " pod="openshift-image-registry/image-registry-55f49db7cc-hls2k"
Jul 28 15:14:39.606410 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.606324    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1c546354-dfcf-4cfd-9d78-9836622382db-ca-trust-extracted\") pod \"image-registry-55f49db7cc-hls2k\" (UID: \"1c546354-dfcf-4cfd-9d78-9836622382db\") " pod="openshift-image-registry/image-registry-55f49db7cc-hls2k"
Jul 28 15:14:39.606410 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:39.606343    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec1ccecc-777e-492b-b655-75a18faf1aea-metrics-certs podName:ec1ccecc-777e-492b-b655-75a18faf1aea nodeName:}" failed. No retries permitted until 2026-07-28 15:14:40.106324327 +0000 UTC m=+41.156692416 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec1ccecc-777e-492b-b655-75a18faf1aea-metrics-certs") pod "router-default-7dc8547f57-57ktc" (UID: "ec1ccecc-777e-492b-b655-75a18faf1aea") : secret "router-metrics-certs-default" not found
Jul 28 15:14:39.606742 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:39.606463    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ec1ccecc-777e-492b-b655-75a18faf1aea-service-ca-bundle podName:ec1ccecc-777e-492b-b655-75a18faf1aea nodeName:}" failed. No retries permitted until 2026-07-28 15:14:40.106446962 +0000 UTC m=+41.156815047 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ec1ccecc-777e-492b-b655-75a18faf1aea-service-ca-bundle") pod "router-default-7dc8547f57-57ktc" (UID: "ec1ccecc-777e-492b-b655-75a18faf1aea") : configmap references non-existent config key: service-ca.crt
Jul 28 15:14:39.606742 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.606510    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdrpj\" (UniqueName: \"kubernetes.io/projected/ec1ccecc-777e-492b-b655-75a18faf1aea-kube-api-access-kdrpj\") pod \"router-default-7dc8547f57-57ktc\" (UID: \"ec1ccecc-777e-492b-b655-75a18faf1aea\") " pod="openshift-ingress/router-default-7dc8547f57-57ktc"
Jul 28 15:14:39.606742 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.606736    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/a8c7852f-a649-484b-b4e9-b24146452370-config\") pod \"service-ca-operator-5d6c75f84f-bfkmm\" (UID: \"a8c7852f-a649-484b-b4e9-b24146452370\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bfkmm"
Jul 28 15:14:39.608233 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.608211    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/a8c7852f-a649-484b-b4e9-b24146452370-serving-cert\") pod \"service-ca-operator-5d6c75f84f-bfkmm\" (UID: \"a8c7852f-a649-484b-b4e9-b24146452370\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bfkmm"
Jul 28 15:14:39.608746 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.608723    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/ec1ccecc-777e-492b-b655-75a18faf1aea-default-certificate\") pod \"router-default-7dc8547f57-57ktc\" (UID: \"ec1ccecc-777e-492b-b655-75a18faf1aea\") " pod="openshift-ingress/router-default-7dc8547f57-57ktc"
Jul 28 15:14:39.608818 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.608779    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/ec1ccecc-777e-492b-b655-75a18faf1aea-stats-auth\") pod \"router-default-7dc8547f57-57ktc\" (UID: \"ec1ccecc-777e-492b-b655-75a18faf1aea\") " pod="openshift-ingress/router-default-7dc8547f57-57ktc"
Jul 28 15:14:39.615998 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.615974    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jltp\" (UniqueName: \"kubernetes.io/projected/a8c7852f-a649-484b-b4e9-b24146452370-kube-api-access-5jltp\") pod \"service-ca-operator-5d6c75f84f-bfkmm\" (UID: \"a8c7852f-a649-484b-b4e9-b24146452370\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bfkmm"
Jul 28 15:14:39.616610 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.616590    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdrpj\" (UniqueName: \"kubernetes.io/projected/ec1ccecc-777e-492b-b655-75a18faf1aea-kube-api-access-kdrpj\") pod \"router-default-7dc8547f57-57ktc\" (UID: \"ec1ccecc-777e-492b-b655-75a18faf1aea\") " pod="openshift-ingress/router-default-7dc8547f57-57ktc"
Jul 28 15:14:39.674404 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.674374    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-5tz62"
Jul 28 15:14:39.695238 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.695214    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-fzgwv"
Jul 28 15:14:39.706386 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.706363    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-hfwq7"]
Jul 28 15:14:39.707300 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.707210    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1c546354-dfcf-4cfd-9d78-9836622382db-bound-sa-token\") pod \"image-registry-55f49db7cc-hls2k\" (UID: \"1c546354-dfcf-4cfd-9d78-9836622382db\") " pod="openshift-image-registry/image-registry-55f49db7cc-hls2k"
Jul 28 15:14:39.707300 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.707283    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1c546354-dfcf-4cfd-9d78-9836622382db-registry-tls\") pod \"image-registry-55f49db7cc-hls2k\" (UID: \"1c546354-dfcf-4cfd-9d78-9836622382db\") " pod="openshift-image-registry/image-registry-55f49db7cc-hls2k"
Jul 28 15:14:39.707688 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:39.707386    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 15:14:39.707688 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:39.707401    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55f49db7cc-hls2k: secret "image-registry-tls" not found
Jul 28 15:14:39.707688 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:39.707467    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1c546354-dfcf-4cfd-9d78-9836622382db-registry-tls podName:1c546354-dfcf-4cfd-9d78-9836622382db nodeName:}" failed. No retries permitted until 2026-07-28 15:14:40.20744811 +0000 UTC m=+41.257816213 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1c546354-dfcf-4cfd-9d78-9836622382db-registry-tls") pod "image-registry-55f49db7cc-hls2k" (UID: "1c546354-dfcf-4cfd-9d78-9836622382db") : secret "image-registry-tls" not found
Jul 28 15:14:39.707688 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.707575    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1c546354-dfcf-4cfd-9d78-9836622382db-ca-trust-extracted\") pod \"image-registry-55f49db7cc-hls2k\" (UID: \"1c546354-dfcf-4cfd-9d78-9836622382db\") " pod="openshift-image-registry/image-registry-55f49db7cc-hls2k"
Jul 28 15:14:39.707688 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.707628    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1c546354-dfcf-4cfd-9d78-9836622382db-registry-certificates\") pod \"image-registry-55f49db7cc-hls2k\" (UID: \"1c546354-dfcf-4cfd-9d78-9836622382db\") " pod="openshift-image-registry/image-registry-55f49db7cc-hls2k"
Jul 28 15:14:39.707688 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.707645    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1c546354-dfcf-4cfd-9d78-9836622382db-installation-pull-secrets\") pod \"image-registry-55f49db7cc-hls2k\" (UID: \"1c546354-dfcf-4cfd-9d78-9836622382db\") " pod="openshift-image-registry/image-registry-55f49db7cc-hls2k"
Jul 28 15:14:39.707688 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.707672    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1c546354-dfcf-4cfd-9d78-9836622382db-image-registry-private-configuration\") pod \"image-registry-55f49db7cc-hls2k\" (UID: \"1c546354-dfcf-4cfd-9d78-9836622382db\") " pod="openshift-image-registry/image-registry-55f49db7cc-hls2k"
Jul 28 15:14:39.708129 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.707702    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1c546354-dfcf-4cfd-9d78-9836622382db-trusted-ca\") pod \"image-registry-55f49db7cc-hls2k\" (UID: \"1c546354-dfcf-4cfd-9d78-9836622382db\") " pod="openshift-image-registry/image-registry-55f49db7cc-hls2k"
Jul 28 15:14:39.708129 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.707736    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6gpp\" (UniqueName: \"kubernetes.io/projected/1c546354-dfcf-4cfd-9d78-9836622382db-kube-api-access-m6gpp\") pod \"image-registry-55f49db7cc-hls2k\" (UID: \"1c546354-dfcf-4cfd-9d78-9836622382db\") " pod="openshift-image-registry/image-registry-55f49db7cc-hls2k"
Jul 28 15:14:39.708781 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.708272    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1c546354-dfcf-4cfd-9d78-9836622382db-ca-trust-extracted\") pod \"image-registry-55f49db7cc-hls2k\" (UID: \"1c546354-dfcf-4cfd-9d78-9836622382db\") " pod="openshift-image-registry/image-registry-55f49db7cc-hls2k"
Jul 28 15:14:39.708781 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.708765    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1c546354-dfcf-4cfd-9d78-9836622382db-registry-certificates\") pod \"image-registry-55f49db7cc-hls2k\" (UID: \"1c546354-dfcf-4cfd-9d78-9836622382db\") " pod="openshift-image-registry/image-registry-55f49db7cc-hls2k"
Jul 28 15:14:39.709244 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.709223    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1c546354-dfcf-4cfd-9d78-9836622382db-trusted-ca\") pod \"image-registry-55f49db7cc-hls2k\" (UID: \"1c546354-dfcf-4cfd-9d78-9836622382db\") " pod="openshift-image-registry/image-registry-55f49db7cc-hls2k"
Jul 28 15:14:39.709711 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:14:39.709685    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod615eb69b_2f19_4483_b1fd_7be078553384.slice/crio-de954ecb05e53472c9cad5b519066ba5e10bba259799c9978a06fc79be2a8414 WatchSource:0}: Error finding container de954ecb05e53472c9cad5b519066ba5e10bba259799c9978a06fc79be2a8414: Status 404 returned error can't find the container with id de954ecb05e53472c9cad5b519066ba5e10bba259799c9978a06fc79be2a8414
Jul 28 15:14:39.710728 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.710711    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1c546354-dfcf-4cfd-9d78-9836622382db-installation-pull-secrets\") pod \"image-registry-55f49db7cc-hls2k\" (UID: \"1c546354-dfcf-4cfd-9d78-9836622382db\") " pod="openshift-image-registry/image-registry-55f49db7cc-hls2k"
Jul 28 15:14:39.711951 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.711934    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1c546354-dfcf-4cfd-9d78-9836622382db-image-registry-private-configuration\") pod \"image-registry-55f49db7cc-hls2k\" (UID: \"1c546354-dfcf-4cfd-9d78-9836622382db\") " pod="openshift-image-registry/image-registry-55f49db7cc-hls2k"
Jul 28 15:14:39.718048 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.717689    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1c546354-dfcf-4cfd-9d78-9836622382db-bound-sa-token\") pod \"image-registry-55f49db7cc-hls2k\" (UID: \"1c546354-dfcf-4cfd-9d78-9836622382db\") " pod="openshift-image-registry/image-registry-55f49db7cc-hls2k"
Jul 28 15:14:39.718153 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.718106    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6gpp\" (UniqueName: \"kubernetes.io/projected/1c546354-dfcf-4cfd-9d78-9836622382db-kube-api-access-m6gpp\") pod \"image-registry-55f49db7cc-hls2k\" (UID: \"1c546354-dfcf-4cfd-9d78-9836622382db\") " pod="openshift-image-registry/image-registry-55f49db7cc-hls2k"
Jul 28 15:14:39.780080 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.780007    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bfkmm"
Jul 28 15:14:39.835611 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.835574    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-5tz62"]
Jul 28 15:14:39.839639 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:14:39.839609    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c5d4df8_409b_4317_9654_61b8d19b0b38.slice/crio-c187fa733d443a2e2cadd476f771fbbc1dc667f6239957eaa9d50d4c3825afd6 WatchSource:0}: Error finding container c187fa733d443a2e2cadd476f771fbbc1dc667f6239957eaa9d50d4c3825afd6: Status 404 returned error can't find the container with id c187fa733d443a2e2cadd476f771fbbc1dc667f6239957eaa9d50d4c3825afd6
Jul 28 15:14:39.853362 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.853327    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-fzgwv"]
Jul 28 15:14:39.856890 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:14:39.856866    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb173c54c_c79a_4cdd_803b_c0b218c95bda.slice/crio-d55211e5d56dd574654bee304b9faa7944e5d1b5b7ebcd0c48c9ec08d541fc83 WatchSource:0}: Error finding container d55211e5d56dd574654bee304b9faa7944e5d1b5b7ebcd0c48c9ec08d541fc83: Status 404 returned error can't find the container with id d55211e5d56dd574654bee304b9faa7944e5d1b5b7ebcd0c48c9ec08d541fc83
Jul 28 15:14:39.927129 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:39.927102    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bfkmm"]
Jul 28 15:14:39.930075 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:14:39.930048    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8c7852f_a649_484b_b4e9_b24146452370.slice/crio-b52d101f741a058d135eb4c6b679fd42b9824ea8d0e6283e908170dc6ff0cc92 WatchSource:0}: Error finding container b52d101f741a058d135eb4c6b679fd42b9824ea8d0e6283e908170dc6ff0cc92: Status 404 returned error can't find the container with id b52d101f741a058d135eb4c6b679fd42b9824ea8d0e6283e908170dc6ff0cc92
Jul 28 15:14:40.010666 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:40.010634    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5cbe82e-7228-42f0-8706-5faac882b35e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-df69h\" (UID: \"c5cbe82e-7228-42f0-8706-5faac882b35e\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-df69h"
Jul 28 15:14:40.010817 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:40.010735    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 28 15:14:40.010817 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:40.010785    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5cbe82e-7228-42f0-8706-5faac882b35e-cluster-monitoring-operator-tls podName:c5cbe82e-7228-42f0-8706-5faac882b35e nodeName:}" failed. No retries permitted until 2026-07-28 15:14:41.010772229 +0000 UTC m=+42.061140313 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c5cbe82e-7228-42f0-8706-5faac882b35e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-df69h" (UID: "c5cbe82e-7228-42f0-8706-5faac882b35e") : secret "cluster-monitoring-operator-tls" not found
Jul 28 15:14:40.111596 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:40.111562    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec1ccecc-777e-492b-b655-75a18faf1aea-service-ca-bundle\") pod \"router-default-7dc8547f57-57ktc\" (UID: \"ec1ccecc-777e-492b-b655-75a18faf1aea\") " pod="openshift-ingress/router-default-7dc8547f57-57ktc"
Jul 28 15:14:40.111735 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:40.111703    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec1ccecc-777e-492b-b655-75a18faf1aea-metrics-certs\") pod \"router-default-7dc8547f57-57ktc\" (UID: \"ec1ccecc-777e-492b-b655-75a18faf1aea\") " pod="openshift-ingress/router-default-7dc8547f57-57ktc"
Jul 28 15:14:40.111788 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:40.111743    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ec1ccecc-777e-492b-b655-75a18faf1aea-service-ca-bundle podName:ec1ccecc-777e-492b-b655-75a18faf1aea nodeName:}" failed. No retries permitted until 2026-07-28 15:14:41.111722307 +0000 UTC m=+42.162090408 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ec1ccecc-777e-492b-b655-75a18faf1aea-service-ca-bundle") pod "router-default-7dc8547f57-57ktc" (UID: "ec1ccecc-777e-492b-b655-75a18faf1aea") : configmap references non-existent config key: service-ca.crt
Jul 28 15:14:40.111883 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:40.111795    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 15:14:40.111883 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:40.111870    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec1ccecc-777e-492b-b655-75a18faf1aea-metrics-certs podName:ec1ccecc-777e-492b-b655-75a18faf1aea nodeName:}" failed. No retries permitted until 2026-07-28 15:14:41.111856524 +0000 UTC m=+42.162224630 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec1ccecc-777e-492b-b655-75a18faf1aea-metrics-certs") pod "router-default-7dc8547f57-57ktc" (UID: "ec1ccecc-777e-492b-b655-75a18faf1aea") : secret "router-metrics-certs-default" not found
Jul 28 15:14:40.212107 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:40.212068    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1c546354-dfcf-4cfd-9d78-9836622382db-registry-tls\") pod \"image-registry-55f49db7cc-hls2k\" (UID: \"1c546354-dfcf-4cfd-9d78-9836622382db\") " pod="openshift-image-registry/image-registry-55f49db7cc-hls2k"
Jul 28 15:14:40.212256 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:40.212213    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 15:14:40.212256 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:40.212234    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55f49db7cc-hls2k: secret "image-registry-tls" not found
Jul 28 15:14:40.212363 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:40.212287    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1c546354-dfcf-4cfd-9d78-9836622382db-registry-tls podName:1c546354-dfcf-4cfd-9d78-9836622382db nodeName:}" failed. No retries permitted until 2026-07-28 15:14:41.212271834 +0000 UTC m=+42.262639921 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1c546354-dfcf-4cfd-9d78-9836622382db-registry-tls") pod "image-registry-55f49db7cc-hls2k" (UID: "1c546354-dfcf-4cfd-9d78-9836622382db") : secret "image-registry-tls" not found
Jul 28 15:14:40.715645 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:40.715547    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bfkmm" event={"ID":"a8c7852f-a649-484b-b4e9-b24146452370","Type":"ContainerStarted","Data":"b52d101f741a058d135eb4c6b679fd42b9824ea8d0e6283e908170dc6ff0cc92"}
Jul 28 15:14:40.718183 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:40.718088    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-fzgwv" event={"ID":"b173c54c-c79a-4cdd-803b-c0b218c95bda","Type":"ContainerStarted","Data":"d55211e5d56dd574654bee304b9faa7944e5d1b5b7ebcd0c48c9ec08d541fc83"}
Jul 28 15:14:40.719887 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:40.719793    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-5tz62" event={"ID":"8c5d4df8-409b-4317-9654-61b8d19b0b38","Type":"ContainerStarted","Data":"c187fa733d443a2e2cadd476f771fbbc1dc667f6239957eaa9d50d4c3825afd6"}
Jul 28 15:14:40.721310 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:40.721253    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-hfwq7" event={"ID":"615eb69b-2f19-4483-b1fd-7be078553384","Type":"ContainerStarted","Data":"de954ecb05e53472c9cad5b519066ba5e10bba259799c9978a06fc79be2a8414"}
Jul 28 15:14:41.021082 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:41.020692    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5cbe82e-7228-42f0-8706-5faac882b35e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-df69h\" (UID: \"c5cbe82e-7228-42f0-8706-5faac882b35e\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-df69h"
Jul 28 15:14:41.021082 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:41.020892    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 28 15:14:41.021082 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:41.020965    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5cbe82e-7228-42f0-8706-5faac882b35e-cluster-monitoring-operator-tls podName:c5cbe82e-7228-42f0-8706-5faac882b35e nodeName:}" failed. No retries permitted until 2026-07-28 15:14:43.020946339 +0000 UTC m=+44.071314429 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c5cbe82e-7228-42f0-8706-5faac882b35e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-df69h" (UID: "c5cbe82e-7228-42f0-8706-5faac882b35e") : secret "cluster-monitoring-operator-tls" not found
Jul 28 15:14:41.121455 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:41.121414    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec1ccecc-777e-492b-b655-75a18faf1aea-service-ca-bundle\") pod \"router-default-7dc8547f57-57ktc\" (UID: \"ec1ccecc-777e-492b-b655-75a18faf1aea\") " pod="openshift-ingress/router-default-7dc8547f57-57ktc"
Jul 28 15:14:41.121639 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:41.121558    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec1ccecc-777e-492b-b655-75a18faf1aea-metrics-certs\") pod \"router-default-7dc8547f57-57ktc\" (UID: \"ec1ccecc-777e-492b-b655-75a18faf1aea\") " pod="openshift-ingress/router-default-7dc8547f57-57ktc"
Jul 28 15:14:41.121743 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:41.121705    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 15:14:41.121884 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:41.121773    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec1ccecc-777e-492b-b655-75a18faf1aea-metrics-certs podName:ec1ccecc-777e-492b-b655-75a18faf1aea nodeName:}" failed. No retries permitted until 2026-07-28 15:14:43.121755031 +0000 UTC m=+44.172123117 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec1ccecc-777e-492b-b655-75a18faf1aea-metrics-certs") pod "router-default-7dc8547f57-57ktc" (UID: "ec1ccecc-777e-492b-b655-75a18faf1aea") : secret "router-metrics-certs-default" not found
Jul 28 15:14:41.122301 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:41.122227    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ec1ccecc-777e-492b-b655-75a18faf1aea-service-ca-bundle podName:ec1ccecc-777e-492b-b655-75a18faf1aea nodeName:}" failed. No retries permitted until 2026-07-28 15:14:43.122209378 +0000 UTC m=+44.172577462 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ec1ccecc-777e-492b-b655-75a18faf1aea-service-ca-bundle") pod "router-default-7dc8547f57-57ktc" (UID: "ec1ccecc-777e-492b-b655-75a18faf1aea") : configmap references non-existent config key: service-ca.crt
Jul 28 15:14:41.222113 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:41.222008    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1c546354-dfcf-4cfd-9d78-9836622382db-registry-tls\") pod \"image-registry-55f49db7cc-hls2k\" (UID: \"1c546354-dfcf-4cfd-9d78-9836622382db\") " pod="openshift-image-registry/image-registry-55f49db7cc-hls2k"
Jul 28 15:14:41.222311 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:41.222155    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 15:14:41.222311 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:41.222174    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55f49db7cc-hls2k: secret "image-registry-tls" not found
Jul 28 15:14:41.222311 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:41.222232    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1c546354-dfcf-4cfd-9d78-9836622382db-registry-tls podName:1c546354-dfcf-4cfd-9d78-9836622382db nodeName:}" failed. No retries permitted until 2026-07-28 15:14:43.222215312 +0000 UTC m=+44.272583399 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1c546354-dfcf-4cfd-9d78-9836622382db-registry-tls") pod "image-registry-55f49db7cc-hls2k" (UID: "1c546354-dfcf-4cfd-9d78-9836622382db") : secret "image-registry-tls" not found
Jul 28 15:14:42.131494 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:42.131454    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/30319eb2-0e70-4b57-b466-15f119f06c01-metrics-tls\") pod \"dns-default-fdbqx\" (UID: \"30319eb2-0e70-4b57-b466-15f119f06c01\") " pod="openshift-dns/dns-default-fdbqx"
Jul 28 15:14:42.131973 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:42.131612    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 15:14:42.131973 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:42.131684    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30319eb2-0e70-4b57-b466-15f119f06c01-metrics-tls podName:30319eb2-0e70-4b57-b466-15f119f06c01 nodeName:}" failed. No retries permitted until 2026-07-28 15:14:50.131662985 +0000 UTC m=+51.182031067 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/30319eb2-0e70-4b57-b466-15f119f06c01-metrics-tls") pod "dns-default-fdbqx" (UID: "30319eb2-0e70-4b57-b466-15f119f06c01") : secret "dns-default-metrics-tls" not found
Jul 28 15:14:43.040777 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:43.040744    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5cbe82e-7228-42f0-8706-5faac882b35e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-df69h\" (UID: \"c5cbe82e-7228-42f0-8706-5faac882b35e\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-df69h"
Jul 28 15:14:43.040962 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:43.040912    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 28 15:14:43.041007 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:43.040979    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5cbe82e-7228-42f0-8706-5faac882b35e-cluster-monitoring-operator-tls podName:c5cbe82e-7228-42f0-8706-5faac882b35e nodeName:}" failed. No retries permitted until 2026-07-28 15:14:47.040964002 +0000 UTC m=+48.091332085 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c5cbe82e-7228-42f0-8706-5faac882b35e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-df69h" (UID: "c5cbe82e-7228-42f0-8706-5faac882b35e") : secret "cluster-monitoring-operator-tls" not found
Jul 28 15:14:43.141767 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:43.141728    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec1ccecc-777e-492b-b655-75a18faf1aea-metrics-certs\") pod \"router-default-7dc8547f57-57ktc\" (UID: \"ec1ccecc-777e-492b-b655-75a18faf1aea\") " pod="openshift-ingress/router-default-7dc8547f57-57ktc"
Jul 28 15:14:43.142163 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:43.141795    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec1ccecc-777e-492b-b655-75a18faf1aea-service-ca-bundle\") pod \"router-default-7dc8547f57-57ktc\" (UID: \"ec1ccecc-777e-492b-b655-75a18faf1aea\") " pod="openshift-ingress/router-default-7dc8547f57-57ktc"
Jul 28 15:14:43.142163 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:43.141892    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 15:14:43.142163 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:43.141965    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ec1ccecc-777e-492b-b655-75a18faf1aea-service-ca-bundle podName:ec1ccecc-777e-492b-b655-75a18faf1aea nodeName:}" failed. No retries permitted until 2026-07-28 15:14:47.141947583 +0000 UTC m=+48.192315666 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ec1ccecc-777e-492b-b655-75a18faf1aea-service-ca-bundle") pod "router-default-7dc8547f57-57ktc" (UID: "ec1ccecc-777e-492b-b655-75a18faf1aea") : configmap references non-existent config key: service-ca.crt
Jul 28 15:14:43.142163 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:43.141986    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec1ccecc-777e-492b-b655-75a18faf1aea-metrics-certs podName:ec1ccecc-777e-492b-b655-75a18faf1aea nodeName:}" failed. No retries permitted until 2026-07-28 15:14:47.141980007 +0000 UTC m=+48.192348090 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec1ccecc-777e-492b-b655-75a18faf1aea-metrics-certs") pod "router-default-7dc8547f57-57ktc" (UID: "ec1ccecc-777e-492b-b655-75a18faf1aea") : secret "router-metrics-certs-default" not found
Jul 28 15:14:43.242654 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:43.242615    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1c546354-dfcf-4cfd-9d78-9836622382db-registry-tls\") pod \"image-registry-55f49db7cc-hls2k\" (UID: \"1c546354-dfcf-4cfd-9d78-9836622382db\") " pod="openshift-image-registry/image-registry-55f49db7cc-hls2k"
Jul 28 15:14:43.242818 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:43.242801    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 15:14:43.242903 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:43.242842    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55f49db7cc-hls2k: secret "image-registry-tls" not found
Jul 28 15:14:43.242967 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:43.242914    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1c546354-dfcf-4cfd-9d78-9836622382db-registry-tls podName:1c546354-dfcf-4cfd-9d78-9836622382db nodeName:}" failed. No retries permitted until 2026-07-28 15:14:47.242892086 +0000 UTC m=+48.293260189 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1c546354-dfcf-4cfd-9d78-9836622382db-registry-tls") pod "image-registry-55f49db7cc-hls2k" (UID: "1c546354-dfcf-4cfd-9d78-9836622382db") : secret "image-registry-tls" not found
Jul 28 15:14:44.734069 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:44.734022    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bfkmm" event={"ID":"a8c7852f-a649-484b-b4e9-b24146452370","Type":"ContainerStarted","Data":"2ce9202497a376b21d43c0701da5c178fac97c9667e1e2381411f4ac1f2a71e1"}
Jul 28 15:14:44.735795 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:44.735742    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-fzgwv" event={"ID":"b173c54c-c79a-4cdd-803b-c0b218c95bda","Type":"ContainerStarted","Data":"0da462a4ff4a9b223f72df35271c58f3a43fe0a0ad5557bbb6818fd02686ed92"}
Jul 28 15:14:44.737321 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:44.737291    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-5tz62" event={"ID":"8c5d4df8-409b-4317-9654-61b8d19b0b38","Type":"ContainerStarted","Data":"d86337c955eae13774e5b274524528bfd987026c0c6619cad4a127f88e3f1c7f"}
Jul 28 15:14:44.738954 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:44.738925    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-hfwq7" event={"ID":"615eb69b-2f19-4483-b1fd-7be078553384","Type":"ContainerStarted","Data":"fcb79378fe2b572b0913098078f402cecb55f199ee64cdc83b901f004930cd2f"}
Jul 28 15:14:44.754628 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:44.754589    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bfkmm" podStartSLOduration=1.2704328710000001 podStartE2EDuration="5.754577466s" totalImagesPullingTime="4.484144595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:14:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:14:44.75314202 +0000 UTC m=+45.803510125" watchObservedRunningTime="2026-07-28 15:14:44.754577466 +0000 UTC m=+45.804945570"
Jul 28 15:14:44.777977 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:44.777800    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-5tz62" podStartSLOduration=1.194651476 podStartE2EDuration="5.777781408s" totalImagesPullingTime="4.583129932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:14:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:14:44.776633294 +0000 UTC m=+45.827001400" watchObservedRunningTime="2026-07-28 15:14:44.777781408 +0000 UTC m=+45.828149514"
Jul 28 15:14:44.797658 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:44.797613    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-hfwq7" podStartSLOduration=1.096329194 podStartE2EDuration="5.797594545s" totalImagesPullingTime="4.701265351s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:14:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:14:44.796547737 +0000 UTC m=+45.846915843" watchObservedRunningTime="2026-07-28 15:14:44.797594545 +0000 UTC m=+45.847962651"
Jul 28 15:14:44.818564 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:44.818519    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-fzgwv" podStartSLOduration=1.262065929 podStartE2EDuration="5.818501772s" totalImagesPullingTime="4.556435843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:14:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:14:44.817541974 +0000 UTC m=+45.867910073" watchObservedRunningTime="2026-07-28 15:14:44.818501772 +0000 UTC m=+45.868869879"
Jul 28 15:14:45.806978 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:45.806944    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pr7fd"]
Jul 28 15:14:45.829350 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:45.829323    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pr7fd"
Jul 28 15:14:45.832682 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:45.832632    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 28 15:14:45.832844 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:45.832739    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bk52q\""
Jul 28 15:14:45.833016 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:45.832990    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 28 15:14:45.863495 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:45.863473    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b90505e5-bf3d-4dfa-b88d-0cd9313b609a-data-volume\") pod \"insights-runtime-extractor-pr7fd\" (UID: \"b90505e5-bf3d-4dfa-b88d-0cd9313b609a\") " pod="openshift-insights/insights-runtime-extractor-pr7fd"
Jul 28 15:14:45.863614 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:45.863539    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b90505e5-bf3d-4dfa-b88d-0cd9313b609a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pr7fd\" (UID: \"b90505e5-bf3d-4dfa-b88d-0cd9313b609a\") " pod="openshift-insights/insights-runtime-extractor-pr7fd"
Jul 28 15:14:45.863684 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:45.863641    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b90505e5-bf3d-4dfa-b88d-0cd9313b609a-crio-socket\") pod \"insights-runtime-extractor-pr7fd\" (UID: \"b90505e5-bf3d-4dfa-b88d-0cd9313b609a\") " pod="openshift-insights/insights-runtime-extractor-pr7fd"
Jul 28 15:14:45.863746 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:45.863695    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b90505e5-bf3d-4dfa-b88d-0cd9313b609a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pr7fd\" (UID: \"b90505e5-bf3d-4dfa-b88d-0cd9313b609a\") " pod="openshift-insights/insights-runtime-extractor-pr7fd"
Jul 28 15:14:45.863746 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:45.863712    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpwnr\" (UniqueName: \"kubernetes.io/projected/b90505e5-bf3d-4dfa-b88d-0cd9313b609a-kube-api-access-gpwnr\") pod \"insights-runtime-extractor-pr7fd\" (UID: \"b90505e5-bf3d-4dfa-b88d-0cd9313b609a\") " pod="openshift-insights/insights-runtime-extractor-pr7fd"
Jul 28 15:14:45.871487 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:45.871453    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pr7fd"]
Jul 28 15:14:45.964941 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:45.964899    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b90505e5-bf3d-4dfa-b88d-0cd9313b609a-data-volume\") pod \"insights-runtime-extractor-pr7fd\" (UID: \"b90505e5-bf3d-4dfa-b88d-0cd9313b609a\") " pod="openshift-insights/insights-runtime-extractor-pr7fd"
Jul 28 15:14:45.965119 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:45.965000    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b90505e5-bf3d-4dfa-b88d-0cd9313b609a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pr7fd\" (UID: \"b90505e5-bf3d-4dfa-b88d-0cd9313b609a\") " pod="openshift-insights/insights-runtime-extractor-pr7fd"
Jul 28 15:14:45.965119 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:45.965056    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b90505e5-bf3d-4dfa-b88d-0cd9313b609a-crio-socket\") pod \"insights-runtime-extractor-pr7fd\" (UID: \"b90505e5-bf3d-4dfa-b88d-0cd9313b609a\") " pod="openshift-insights/insights-runtime-extractor-pr7fd"
Jul 28 15:14:45.965240 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:45.965133    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b90505e5-bf3d-4dfa-b88d-0cd9313b609a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pr7fd\" (UID: \"b90505e5-bf3d-4dfa-b88d-0cd9313b609a\") " pod="openshift-insights/insights-runtime-extractor-pr7fd"
Jul 28 15:14:45.965240 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:45.965136    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 15:14:45.965240 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:45.965159    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpwnr\" (UniqueName: \"kubernetes.io/projected/b90505e5-bf3d-4dfa-b88d-0cd9313b609a-kube-api-access-gpwnr\") pod \"insights-runtime-extractor-pr7fd\" (UID: \"b90505e5-bf3d-4dfa-b88d-0cd9313b609a\") " pod="openshift-insights/insights-runtime-extractor-pr7fd"
Jul 28 15:14:45.965240 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:45.965214    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b90505e5-bf3d-4dfa-b88d-0cd9313b609a-kube-rbac-proxy-cm podName:b90505e5-bf3d-4dfa-b88d-0cd9313b609a nodeName:}" failed. No retries permitted until 2026-07-28 15:14:46.465190655 +0000 UTC m=+47.515558741 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b90505e5-bf3d-4dfa-b88d-0cd9313b609a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pr7fd" (UID: "b90505e5-bf3d-4dfa-b88d-0cd9313b609a") : configmap "kube-rbac-proxy" not found
Jul 28 15:14:45.965599 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:45.965553    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 15:14:45.965694 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:45.965636    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b90505e5-bf3d-4dfa-b88d-0cd9313b609a-crio-socket\") pod \"insights-runtime-extractor-pr7fd\" (UID: \"b90505e5-bf3d-4dfa-b88d-0cd9313b609a\") " pod="openshift-insights/insights-runtime-extractor-pr7fd"
Jul 28 15:14:45.965694 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:45.965664    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b90505e5-bf3d-4dfa-b88d-0cd9313b609a-insights-runtime-extractor-tls podName:b90505e5-bf3d-4dfa-b88d-0cd9313b609a nodeName:}" failed. No retries permitted until 2026-07-28 15:14:46.465635208 +0000 UTC m=+47.516003295 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b90505e5-bf3d-4dfa-b88d-0cd9313b609a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pr7fd" (UID: "b90505e5-bf3d-4dfa-b88d-0cd9313b609a") : secret "insights-runtime-extractor-tls" not found
Jul 28 15:14:45.965806 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:45.965709    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b90505e5-bf3d-4dfa-b88d-0cd9313b609a-data-volume\") pod \"insights-runtime-extractor-pr7fd\" (UID: \"b90505e5-bf3d-4dfa-b88d-0cd9313b609a\") " pod="openshift-insights/insights-runtime-extractor-pr7fd"
Jul 28 15:14:45.975138 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:45.975118    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpwnr\" (UniqueName: \"kubernetes.io/projected/b90505e5-bf3d-4dfa-b88d-0cd9313b609a-kube-api-access-gpwnr\") pod \"insights-runtime-extractor-pr7fd\" (UID: \"b90505e5-bf3d-4dfa-b88d-0cd9313b609a\") " pod="openshift-insights/insights-runtime-extractor-pr7fd"
Jul 28 15:14:46.469116 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:46.469084    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b90505e5-bf3d-4dfa-b88d-0cd9313b609a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pr7fd\" (UID: \"b90505e5-bf3d-4dfa-b88d-0cd9313b609a\") " pod="openshift-insights/insights-runtime-extractor-pr7fd"
Jul 28 15:14:46.469287 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:46.469150    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b90505e5-bf3d-4dfa-b88d-0cd9313b609a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pr7fd\" (UID: \"b90505e5-bf3d-4dfa-b88d-0cd9313b609a\") " pod="openshift-insights/insights-runtime-extractor-pr7fd"
Jul 28 15:14:46.469287 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:46.469209    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 15:14:46.469287 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:46.469274    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b90505e5-bf3d-4dfa-b88d-0cd9313b609a-kube-rbac-proxy-cm podName:b90505e5-bf3d-4dfa-b88d-0cd9313b609a nodeName:}" failed. No retries permitted until 2026-07-28 15:14:47.469256195 +0000 UTC m=+48.519624278 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b90505e5-bf3d-4dfa-b88d-0cd9313b609a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pr7fd" (UID: "b90505e5-bf3d-4dfa-b88d-0cd9313b609a") : configmap "kube-rbac-proxy" not found
Jul 28 15:14:46.469425 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:46.469308    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 15:14:46.469425 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:46.469361    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b90505e5-bf3d-4dfa-b88d-0cd9313b609a-insights-runtime-extractor-tls podName:b90505e5-bf3d-4dfa-b88d-0cd9313b609a nodeName:}" failed. No retries permitted until 2026-07-28 15:14:47.469347084 +0000 UTC m=+48.519715167 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b90505e5-bf3d-4dfa-b88d-0cd9313b609a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pr7fd" (UID: "b90505e5-bf3d-4dfa-b88d-0cd9313b609a") : secret "insights-runtime-extractor-tls" not found
Jul 28 15:14:47.072835 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:47.072802    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5cbe82e-7228-42f0-8706-5faac882b35e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-df69h\" (UID: \"c5cbe82e-7228-42f0-8706-5faac882b35e\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-df69h"
Jul 28 15:14:47.073193 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:47.072923    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 28 15:14:47.073193 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:47.072978    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5cbe82e-7228-42f0-8706-5faac882b35e-cluster-monitoring-operator-tls podName:c5cbe82e-7228-42f0-8706-5faac882b35e nodeName:}" failed. No retries permitted until 2026-07-28 15:14:55.072965185 +0000 UTC m=+56.123333268 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c5cbe82e-7228-42f0-8706-5faac882b35e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-df69h" (UID: "c5cbe82e-7228-42f0-8706-5faac882b35e") : secret "cluster-monitoring-operator-tls" not found
Jul 28 15:14:47.173541 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:47.173508    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec1ccecc-777e-492b-b655-75a18faf1aea-metrics-certs\") pod \"router-default-7dc8547f57-57ktc\" (UID: \"ec1ccecc-777e-492b-b655-75a18faf1aea\") " pod="openshift-ingress/router-default-7dc8547f57-57ktc"
Jul 28 15:14:47.173692 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:47.173573    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec1ccecc-777e-492b-b655-75a18faf1aea-service-ca-bundle\") pod \"router-default-7dc8547f57-57ktc\" (UID: \"ec1ccecc-777e-492b-b655-75a18faf1aea\") " pod="openshift-ingress/router-default-7dc8547f57-57ktc"
Jul 28 15:14:47.173692 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:47.173658    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 15:14:47.173764 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:47.173721    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec1ccecc-777e-492b-b655-75a18faf1aea-metrics-certs podName:ec1ccecc-777e-492b-b655-75a18faf1aea nodeName:}" failed. No retries permitted until 2026-07-28 15:14:55.173705055 +0000 UTC m=+56.224073154 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec1ccecc-777e-492b-b655-75a18faf1aea-metrics-certs") pod "router-default-7dc8547f57-57ktc" (UID: "ec1ccecc-777e-492b-b655-75a18faf1aea") : secret "router-metrics-certs-default" not found
Jul 28 15:14:47.173764 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:47.173744    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ec1ccecc-777e-492b-b655-75a18faf1aea-service-ca-bundle podName:ec1ccecc-777e-492b-b655-75a18faf1aea nodeName:}" failed. No retries permitted until 2026-07-28 15:14:55.17372884 +0000 UTC m=+56.224096923 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ec1ccecc-777e-492b-b655-75a18faf1aea-service-ca-bundle") pod "router-default-7dc8547f57-57ktc" (UID: "ec1ccecc-777e-492b-b655-75a18faf1aea") : configmap references non-existent config key: service-ca.crt
Jul 28 15:14:47.275057 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:47.275022    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1c546354-dfcf-4cfd-9d78-9836622382db-registry-tls\") pod \"image-registry-55f49db7cc-hls2k\" (UID: \"1c546354-dfcf-4cfd-9d78-9836622382db\") " pod="openshift-image-registry/image-registry-55f49db7cc-hls2k"
Jul 28 15:14:47.275225 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:47.275170    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 15:14:47.275225 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:47.275192    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55f49db7cc-hls2k: secret "image-registry-tls" not found
Jul 28 15:14:47.275293 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:47.275243    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1c546354-dfcf-4cfd-9d78-9836622382db-registry-tls podName:1c546354-dfcf-4cfd-9d78-9836622382db nodeName:}" failed. No retries permitted until 2026-07-28 15:14:55.27522859 +0000 UTC m=+56.325596676 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1c546354-dfcf-4cfd-9d78-9836622382db-registry-tls") pod "image-registry-55f49db7cc-hls2k" (UID: "1c546354-dfcf-4cfd-9d78-9836622382db") : secret "image-registry-tls" not found
Jul 28 15:14:47.476952 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:47.476919    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b90505e5-bf3d-4dfa-b88d-0cd9313b609a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pr7fd\" (UID: \"b90505e5-bf3d-4dfa-b88d-0cd9313b609a\") " pod="openshift-insights/insights-runtime-extractor-pr7fd"
Jul 28 15:14:47.477119 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:47.477074    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 15:14:47.477119 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:47.477089    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b90505e5-bf3d-4dfa-b88d-0cd9313b609a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pr7fd\" (UID: \"b90505e5-bf3d-4dfa-b88d-0cd9313b609a\") " pod="openshift-insights/insights-runtime-extractor-pr7fd"
Jul 28 15:14:47.477203 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:47.477134    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b90505e5-bf3d-4dfa-b88d-0cd9313b609a-insights-runtime-extractor-tls podName:b90505e5-bf3d-4dfa-b88d-0cd9313b609a nodeName:}" failed. No retries permitted until 2026-07-28 15:14:49.47711977 +0000 UTC m=+50.527487853 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b90505e5-bf3d-4dfa-b88d-0cd9313b609a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pr7fd" (UID: "b90505e5-bf3d-4dfa-b88d-0cd9313b609a") : secret "insights-runtime-extractor-tls" not found
Jul 28 15:14:47.477203 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:47.477158    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 15:14:47.477203 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:47.477195    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b90505e5-bf3d-4dfa-b88d-0cd9313b609a-kube-rbac-proxy-cm podName:b90505e5-bf3d-4dfa-b88d-0cd9313b609a nodeName:}" failed. No retries permitted until 2026-07-28 15:14:49.477184588 +0000 UTC m=+50.527552671 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b90505e5-bf3d-4dfa-b88d-0cd9313b609a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pr7fd" (UID: "b90505e5-bf3d-4dfa-b88d-0cd9313b609a") : configmap "kube-rbac-proxy" not found
Jul 28 15:14:48.161778 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:48.161754    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lv5xt_43c0a413-1cee-48b4-9c69-e7a5429dcc89/dns-node-resolver/0.log"
Jul 28 15:14:49.166885 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:49.166857    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d85z2_8426ba3a-6768-4cea-aad5-dc6f897b568d/node-ca/0.log"
Jul 28 15:14:49.493438 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:49.493357    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b90505e5-bf3d-4dfa-b88d-0cd9313b609a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pr7fd\" (UID: \"b90505e5-bf3d-4dfa-b88d-0cd9313b609a\") " pod="openshift-insights/insights-runtime-extractor-pr7fd"
Jul 28 15:14:49.493613 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:49.493449    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b90505e5-bf3d-4dfa-b88d-0cd9313b609a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pr7fd\" (UID: \"b90505e5-bf3d-4dfa-b88d-0cd9313b609a\") " pod="openshift-insights/insights-runtime-extractor-pr7fd"
Jul 28 15:14:49.493613 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:49.493514    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 15:14:49.493613 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:49.493536    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 15:14:49.493613 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:49.493591    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b90505e5-bf3d-4dfa-b88d-0cd9313b609a-insights-runtime-extractor-tls podName:b90505e5-bf3d-4dfa-b88d-0cd9313b609a nodeName:}" failed. No retries permitted until 2026-07-28 15:14:53.493570821 +0000 UTC m=+54.543938918 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b90505e5-bf3d-4dfa-b88d-0cd9313b609a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pr7fd" (UID: "b90505e5-bf3d-4dfa-b88d-0cd9313b609a") : secret "insights-runtime-extractor-tls" not found
Jul 28 15:14:49.493613 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:49.493611    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b90505e5-bf3d-4dfa-b88d-0cd9313b609a-kube-rbac-proxy-cm podName:b90505e5-bf3d-4dfa-b88d-0cd9313b609a nodeName:}" failed. No retries permitted until 2026-07-28 15:14:53.493602344 +0000 UTC m=+54.543970427 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b90505e5-bf3d-4dfa-b88d-0cd9313b609a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pr7fd" (UID: "b90505e5-bf3d-4dfa-b88d-0cd9313b609a") : configmap "kube-rbac-proxy" not found
Jul 28 15:14:49.961810 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:49.961739    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-m7sbs_b76cac71-0442-432d-afc4-c12ef52b534c/serve-healthcheck-canary/0.log"
Jul 28 15:14:50.199660 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:50.199626    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/30319eb2-0e70-4b57-b466-15f119f06c01-metrics-tls\") pod \"dns-default-fdbqx\" (UID: \"30319eb2-0e70-4b57-b466-15f119f06c01\") " pod="openshift-dns/dns-default-fdbqx"
Jul 28 15:14:50.200032 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:50.199769    2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 28 15:14:50.200032 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:50.199847    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/30319eb2-0e70-4b57-b466-15f119f06c01-metrics-tls podName:30319eb2-0e70-4b57-b466-15f119f06c01 nodeName:}" failed. No retries permitted until 2026-07-28 15:15:06.199814624 +0000 UTC m=+67.250182707 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/30319eb2-0e70-4b57-b466-15f119f06c01-metrics-tls") pod "dns-default-fdbqx" (UID: "30319eb2-0e70-4b57-b466-15f119f06c01") : secret "dns-default-metrics-tls" not found
Jul 28 15:14:53.525246 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:53.525211    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b90505e5-bf3d-4dfa-b88d-0cd9313b609a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pr7fd\" (UID: \"b90505e5-bf3d-4dfa-b88d-0cd9313b609a\") " pod="openshift-insights/insights-runtime-extractor-pr7fd"
Jul 28 15:14:53.525726 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:53.525351    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b90505e5-bf3d-4dfa-b88d-0cd9313b609a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pr7fd\" (UID: \"b90505e5-bf3d-4dfa-b88d-0cd9313b609a\") " pod="openshift-insights/insights-runtime-extractor-pr7fd"
Jul 28 15:14:53.525726 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:53.525364    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 15:14:53.525726 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:53.525425    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b90505e5-bf3d-4dfa-b88d-0cd9313b609a-insights-runtime-extractor-tls podName:b90505e5-bf3d-4dfa-b88d-0cd9313b609a nodeName:}" failed. No retries permitted until 2026-07-28 15:15:01.525410182 +0000 UTC m=+62.575778270 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b90505e5-bf3d-4dfa-b88d-0cd9313b609a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pr7fd" (UID: "b90505e5-bf3d-4dfa-b88d-0cd9313b609a") : secret "insights-runtime-extractor-tls" not found
Jul 28 15:14:53.525726 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:53.525459    2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 28 15:14:53.525726 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:53.525509    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b90505e5-bf3d-4dfa-b88d-0cd9313b609a-kube-rbac-proxy-cm podName:b90505e5-bf3d-4dfa-b88d-0cd9313b609a nodeName:}" failed. No retries permitted until 2026-07-28 15:15:01.525497027 +0000 UTC m=+62.575865116 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b90505e5-bf3d-4dfa-b88d-0cd9313b609a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-pr7fd" (UID: "b90505e5-bf3d-4dfa-b88d-0cd9313b609a") : configmap "kube-rbac-proxy" not found
Jul 28 15:14:55.140028 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:55.139995    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5cbe82e-7228-42f0-8706-5faac882b35e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-df69h\" (UID: \"c5cbe82e-7228-42f0-8706-5faac882b35e\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-df69h"
Jul 28 15:14:55.140412 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:55.140160    2561 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 28 15:14:55.140412 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:55.140224    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5cbe82e-7228-42f0-8706-5faac882b35e-cluster-monitoring-operator-tls podName:c5cbe82e-7228-42f0-8706-5faac882b35e nodeName:}" failed. No retries permitted until 2026-07-28 15:15:11.140209252 +0000 UTC m=+72.190577338 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c5cbe82e-7228-42f0-8706-5faac882b35e-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-df69h" (UID: "c5cbe82e-7228-42f0-8706-5faac882b35e") : secret "cluster-monitoring-operator-tls" not found
Jul 28 15:14:55.240971 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:55.240937    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec1ccecc-777e-492b-b655-75a18faf1aea-metrics-certs\") pod \"router-default-7dc8547f57-57ktc\" (UID: \"ec1ccecc-777e-492b-b655-75a18faf1aea\") " pod="openshift-ingress/router-default-7dc8547f57-57ktc"
Jul 28 15:14:55.241154 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:55.241009    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec1ccecc-777e-492b-b655-75a18faf1aea-service-ca-bundle\") pod \"router-default-7dc8547f57-57ktc\" (UID: \"ec1ccecc-777e-492b-b655-75a18faf1aea\") " pod="openshift-ingress/router-default-7dc8547f57-57ktc"
Jul 28 15:14:55.241154 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:55.241084    2561 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 28 15:14:55.241154 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:55.241149    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec1ccecc-777e-492b-b655-75a18faf1aea-metrics-certs podName:ec1ccecc-777e-492b-b655-75a18faf1aea nodeName:}" failed. No retries permitted until 2026-07-28 15:15:11.241131395 +0000 UTC m=+72.291499499 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ec1ccecc-777e-492b-b655-75a18faf1aea-metrics-certs") pod "router-default-7dc8547f57-57ktc" (UID: "ec1ccecc-777e-492b-b655-75a18faf1aea") : secret "router-metrics-certs-default" not found
Jul 28 15:14:55.241261 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:55.241163    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ec1ccecc-777e-492b-b655-75a18faf1aea-service-ca-bundle podName:ec1ccecc-777e-492b-b655-75a18faf1aea nodeName:}" failed. No retries permitted until 2026-07-28 15:15:11.241156974 +0000 UTC m=+72.291525057 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/ec1ccecc-777e-492b-b655-75a18faf1aea-service-ca-bundle") pod "router-default-7dc8547f57-57ktc" (UID: "ec1ccecc-777e-492b-b655-75a18faf1aea") : configmap references non-existent config key: service-ca.crt
Jul 28 15:14:55.342123 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:55.342092    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1c546354-dfcf-4cfd-9d78-9836622382db-registry-tls\") pod \"image-registry-55f49db7cc-hls2k\" (UID: \"1c546354-dfcf-4cfd-9d78-9836622382db\") " pod="openshift-image-registry/image-registry-55f49db7cc-hls2k"
Jul 28 15:14:55.342328 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:55.342211    2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 28 15:14:55.342328 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:55.342223    2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-55f49db7cc-hls2k: secret "image-registry-tls" not found
Jul 28 15:14:55.342328 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:14:55.342270    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1c546354-dfcf-4cfd-9d78-9836622382db-registry-tls podName:1c546354-dfcf-4cfd-9d78-9836622382db nodeName:}" failed. No retries permitted until 2026-07-28 15:15:11.342255033 +0000 UTC m=+72.392623139 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1c546354-dfcf-4cfd-9d78-9836622382db-registry-tls") pod "image-registry-55f49db7cc-hls2k" (UID: "1c546354-dfcf-4cfd-9d78-9836622382db") : secret "image-registry-tls" not found
Jul 28 15:14:59.677379 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:14:59.677352    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zrkfd"
Jul 28 15:15:01.599572 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:01.599537    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b90505e5-bf3d-4dfa-b88d-0cd9313b609a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pr7fd\" (UID: \"b90505e5-bf3d-4dfa-b88d-0cd9313b609a\") " pod="openshift-insights/insights-runtime-extractor-pr7fd"
Jul 28 15:15:01.600066 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:01.599617    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b90505e5-bf3d-4dfa-b88d-0cd9313b609a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pr7fd\" (UID: \"b90505e5-bf3d-4dfa-b88d-0cd9313b609a\") " pod="openshift-insights/insights-runtime-extractor-pr7fd"
Jul 28 15:15:01.600066 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:15:01.599765    2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 28 15:15:01.600066 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:15:01.599876    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b90505e5-bf3d-4dfa-b88d-0cd9313b609a-insights-runtime-extractor-tls podName:b90505e5-bf3d-4dfa-b88d-0cd9313b609a nodeName:}" failed. No retries permitted until 2026-07-28 15:15:17.599819692 +0000 UTC m=+78.650187775 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b90505e5-bf3d-4dfa-b88d-0cd9313b609a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-pr7fd" (UID: "b90505e5-bf3d-4dfa-b88d-0cd9313b609a") : secret "insights-runtime-extractor-tls" not found
Jul 28 15:15:01.600066 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:01.600039    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b90505e5-bf3d-4dfa-b88d-0cd9313b609a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pr7fd\" (UID: \"b90505e5-bf3d-4dfa-b88d-0cd9313b609a\") " pod="openshift-insights/insights-runtime-extractor-pr7fd"
Jul 28 15:15:05.129105 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:05.129050    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20741b19-0b49-488f-86cc-c974cd83fe30-original-pull-secret\") pod \"global-pull-secret-syncer-qpvsz\" (UID: \"20741b19-0b49-488f-86cc-c974cd83fe30\") " pod="kube-system/global-pull-secret-syncer-qpvsz"
Jul 28 15:15:05.132812 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:05.132793    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 28 15:15:05.141748 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:05.141726    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/20741b19-0b49-488f-86cc-c974cd83fe30-original-pull-secret\") pod \"global-pull-secret-syncer-qpvsz\" (UID: \"20741b19-0b49-488f-86cc-c974cd83fe30\") " pod="kube-system/global-pull-secret-syncer-qpvsz"
Jul 28 15:15:05.230095 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:05.230056    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4159b552-0523-406a-8816-4aef10a5829e-metrics-certs\") pod \"network-metrics-daemon-hvlq9\" (UID: \"4159b552-0523-406a-8816-4aef10a5829e\") " pod="openshift-multus/network-metrics-daemon-hvlq9"
Jul 28 15:15:05.230277 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:05.230108    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh8zn\" (UniqueName: \"kubernetes.io/projected/07bf4445-9e9d-45b5-9b36-e6cbd745ec0e-kube-api-access-sh8zn\") pod \"network-check-target-mds5d\" (UID: \"07bf4445-9e9d-45b5-9b36-e6cbd745ec0e\") " pod="openshift-network-diagnostics/network-check-target-mds5d"
Jul 28 15:15:05.233095 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:05.233071    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 28 15:15:05.233191 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:05.233081    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh8zn\" (UniqueName: \"kubernetes.io/projected/07bf4445-9e9d-45b5-9b36-e6cbd745ec0e-kube-api-access-sh8zn\") pod \"network-check-target-mds5d\" (UID: \"07bf4445-9e9d-45b5-9b36-e6cbd745ec0e\") " pod="openshift-network-diagnostics/network-check-target-mds5d"
Jul 28 15:15:05.242340 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:05.242313    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4159b552-0523-406a-8816-4aef10a5829e-metrics-certs\") pod \"network-metrics-daemon-hvlq9\" (UID: \"4159b552-0523-406a-8816-4aef10a5829e\") " pod="openshift-multus/network-metrics-daemon-hvlq9"
Jul 28 15:15:05.321532 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:05.321502    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zdqjt\""
Jul 28 15:15:05.327771 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:05.327743    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vfzkj\""
Jul 28 15:15:05.328779 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:05.328763    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-hvlq9"
Jul 28 15:15:05.331199 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:05.331181    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qpvsz"
Jul 28 15:15:05.335898 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:05.335881    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mds5d"
Jul 28 15:15:05.489765 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:05.489736    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-hvlq9"]
Jul 28 15:15:05.493146 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:05.493112    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mds5d"]
Jul 28 15:15:05.493473 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:15:05.493445    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4159b552_0523_406a_8816_4aef10a5829e.slice/crio-e336a0c479f0696436e93c8cbf619888f8ddd39b435d78e35d438fa6e116f937 WatchSource:0}: Error finding container e336a0c479f0696436e93c8cbf619888f8ddd39b435d78e35d438fa6e116f937: Status 404 returned error can't find the container with id e336a0c479f0696436e93c8cbf619888f8ddd39b435d78e35d438fa6e116f937
Jul 28 15:15:05.496376 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:15:05.496355    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07bf4445_9e9d_45b5_9b36_e6cbd745ec0e.slice/crio-c344ef911c4f9eadd056df09f95836c2d38e776e02b9c6761a04a5fbfc67b730 WatchSource:0}: Error finding container c344ef911c4f9eadd056df09f95836c2d38e776e02b9c6761a04a5fbfc67b730: Status 404 returned error can't find the container with id c344ef911c4f9eadd056df09f95836c2d38e776e02b9c6761a04a5fbfc67b730
Jul 28 15:15:05.505739 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:05.505715    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qpvsz"]
Jul 28 15:15:05.509075 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:15:05.509052    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20741b19_0b49_488f_86cc_c974cd83fe30.slice/crio-c67b6dfcf10f6222a22e64f92226f45c17aa7f39720c97d444814da4e1fa68b7 WatchSource:0}: Error finding container c67b6dfcf10f6222a22e64f92226f45c17aa7f39720c97d444814da4e1fa68b7: Status 404 returned error can't find the container with id c67b6dfcf10f6222a22e64f92226f45c17aa7f39720c97d444814da4e1fa68b7
Jul 28 15:15:05.791595 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:05.791509    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hvlq9" event={"ID":"4159b552-0523-406a-8816-4aef10a5829e","Type":"ContainerStarted","Data":"e336a0c479f0696436e93c8cbf619888f8ddd39b435d78e35d438fa6e116f937"}
Jul 28 15:15:05.792950 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:05.792916    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mds5d" event={"ID":"07bf4445-9e9d-45b5-9b36-e6cbd745ec0e","Type":"ContainerStarted","Data":"6243c19126b3cf1709093f017c9e16f79afdee83032c9785b25ea03fa6f7a6c9"}
Jul 28 15:15:05.793075 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:05.792963    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mds5d" event={"ID":"07bf4445-9e9d-45b5-9b36-e6cbd745ec0e","Type":"ContainerStarted","Data":"c344ef911c4f9eadd056df09f95836c2d38e776e02b9c6761a04a5fbfc67b730"}
Jul 28 15:15:05.793075 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:05.793049    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mds5d"
Jul 28 15:15:05.794001 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:05.793982    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qpvsz" event={"ID":"20741b19-0b49-488f-86cc-c974cd83fe30","Type":"ContainerStarted","Data":"c67b6dfcf10f6222a22e64f92226f45c17aa7f39720c97d444814da4e1fa68b7"}
Jul 28 15:15:05.813818 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:05.813777    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mds5d" podStartSLOduration=65.813764287 podStartE2EDuration="1m5.813764287s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:14:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:15:05.813350626 +0000 UTC m=+66.863718732" watchObservedRunningTime="2026-07-28 15:15:05.813764287 +0000 UTC m=+66.864132391"
Jul 28 15:15:06.238863 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:06.238803    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/30319eb2-0e70-4b57-b466-15f119f06c01-metrics-tls\") pod \"dns-default-fdbqx\" (UID: \"30319eb2-0e70-4b57-b466-15f119f06c01\") " pod="openshift-dns/dns-default-fdbqx"
Jul 28 15:15:06.241578 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:06.241545    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/30319eb2-0e70-4b57-b466-15f119f06c01-metrics-tls\") pod \"dns-default-fdbqx\" (UID: \"30319eb2-0e70-4b57-b466-15f119f06c01\") " pod="openshift-dns/dns-default-fdbqx"
Jul 28 15:15:06.464537 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:06.464508    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-wplwl\""
Jul 28 15:15:06.471463 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:06.471434    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fdbqx"
Jul 28 15:15:06.773333 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:06.773298    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fdbqx"]
Jul 28 15:15:06.776433 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:15:06.776392    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30319eb2_0e70_4b57_b466_15f119f06c01.slice/crio-dd969c5441ceb312cbae9140a92e8b49d95654c97a0898118d4942586fa2185c WatchSource:0}: Error finding container dd969c5441ceb312cbae9140a92e8b49d95654c97a0898118d4942586fa2185c: Status 404 returned error can't find the container with id dd969c5441ceb312cbae9140a92e8b49d95654c97a0898118d4942586fa2185c
Jul 28 15:15:06.806194 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:06.806153    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fdbqx" event={"ID":"30319eb2-0e70-4b57-b466-15f119f06c01","Type":"ContainerStarted","Data":"dd969c5441ceb312cbae9140a92e8b49d95654c97a0898118d4942586fa2185c"}
Jul 28 15:15:06.809923 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:06.809880    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hvlq9" event={"ID":"4159b552-0523-406a-8816-4aef10a5829e","Type":"ContainerStarted","Data":"914398a6a7a8021362b8525a13d0472c5f80c966ce6e1fdc44e3c62716316582"}
Jul 28 15:15:07.815590 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:07.815549    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-hvlq9" event={"ID":"4159b552-0523-406a-8816-4aef10a5829e","Type":"ContainerStarted","Data":"b3d6de5927e5fd19940a50b78674194c7e1e245652c87fa22cf19915cd91a91d"}
Jul 28 15:15:07.844398 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:07.844341    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-hvlq9" podStartSLOduration=66.667129122 podStartE2EDuration="1m7.844320982s" totalImagesPullingTime="1.17719186s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:14:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:15:07.842171278 +0000 UTC m=+68.892539385" watchObservedRunningTime="2026-07-28 15:15:07.844320982 +0000 UTC m=+68.894689089"
Jul 28 15:15:10.828074 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:10.828038    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qpvsz" event={"ID":"20741b19-0b49-488f-86cc-c974cd83fe30","Type":"ContainerStarted","Data":"79c0bdca0331c239ccdfbba312b16dd8cc29dcf266697cc7bd6d83ff4f32bde6"}
Jul 28 15:15:10.829675 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:10.829653    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fdbqx" event={"ID":"30319eb2-0e70-4b57-b466-15f119f06c01","Type":"ContainerStarted","Data":"7bc408a537199fe0fc33f3787dbd0fd1144bf2c83905c2f0407e5b75ec81123a"}
Jul 28 15:15:10.829759 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:10.829698    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fdbqx" event={"ID":"30319eb2-0e70-4b57-b466-15f119f06c01","Type":"ContainerStarted","Data":"e0e48419201ba6ad733e8aba99e67d909d5ed9303f4862d650760da5f6f47569"}
Jul 28 15:15:10.829759 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:10.829734    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-fdbqx"
Jul 28 15:15:10.850883 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:10.850841    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qpvsz" podStartSLOduration=66.364592507 podStartE2EDuration="1m10.850808437s" totalImagesPullingTime="4.48621593s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 15:14:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:15:10.849290473 +0000 UTC m=+71.899658576" watchObservedRunningTime="2026-07-28 15:15:10.850808437 +0000 UTC m=+71.901176542"
Jul 28 15:15:10.872270 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:10.872222    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-fdbqx" podStartSLOduration=33.666433647 podStartE2EDuration="36.872207765s" totalImagesPullingTime="3.205774118s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:14:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:15:10.872136428 +0000 UTC m=+71.922504534" watchObservedRunningTime="2026-07-28 15:15:10.872207765 +0000 UTC m=+71.922575871"
Jul 28 15:15:11.010728 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.010696    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-557fdd688-d895p"]
Jul 28 15:15:11.013607 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.013592    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-557fdd688-d895p"
Jul 28 15:15:11.017215 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.017191    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 28 15:15:11.017310 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.017276    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 28 15:15:11.017510 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.017490    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-68z59\""
Jul 28 15:15:11.017564 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.017490    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 28 15:15:11.017889 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.017877    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 28 15:15:11.034999 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.034979    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-557fdd688-d895p"]
Jul 28 15:15:11.102341 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.102311    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-55f49db7cc-hls2k"]
Jul 28 15:15:11.102521 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:15:11.102502    2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-55f49db7cc-hls2k" podUID="1c546354-dfcf-4cfd-9d78-9836622382db"
Jul 28 15:15:11.185195 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.185159    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/067f2812-1c09-4be0-9cc7-371b1f1cd761-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-557fdd688-d895p\" (UID: \"067f2812-1c09-4be0-9cc7-371b1f1cd761\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-557fdd688-d895p"
Jul 28 15:15:11.185348 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.185221    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhdn6\" (UniqueName: \"kubernetes.io/projected/067f2812-1c09-4be0-9cc7-371b1f1cd761-kube-api-access-vhdn6\") pod \"managed-serviceaccount-addon-agent-557fdd688-d895p\" (UID: \"067f2812-1c09-4be0-9cc7-371b1f1cd761\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-557fdd688-d895p"
Jul 28 15:15:11.185348 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.185285    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5cbe82e-7228-42f0-8706-5faac882b35e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-df69h\" (UID: \"c5cbe82e-7228-42f0-8706-5faac882b35e\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-df69h"
Jul 28 15:15:11.187550 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.187521    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c5cbe82e-7228-42f0-8706-5faac882b35e-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-df69h\" (UID: \"c5cbe82e-7228-42f0-8706-5faac882b35e\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-df69h"
Jul 28 15:15:11.208740 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.208717    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-5nlvh\""
Jul 28 15:15:11.210812 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.210793    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-df69h"
Jul 28 15:15:11.286187 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.286161    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec1ccecc-777e-492b-b655-75a18faf1aea-metrics-certs\") pod \"router-default-7dc8547f57-57ktc\" (UID: \"ec1ccecc-777e-492b-b655-75a18faf1aea\") " pod="openshift-ingress/router-default-7dc8547f57-57ktc"
Jul 28 15:15:11.286291 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.286215    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhdn6\" (UniqueName: \"kubernetes.io/projected/067f2812-1c09-4be0-9cc7-371b1f1cd761-kube-api-access-vhdn6\") pod \"managed-serviceaccount-addon-agent-557fdd688-d895p\" (UID: \"067f2812-1c09-4be0-9cc7-371b1f1cd761\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-557fdd688-d895p"
Jul 28 15:15:11.286291 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.286251    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec1ccecc-777e-492b-b655-75a18faf1aea-service-ca-bundle\") pod \"router-default-7dc8547f57-57ktc\" (UID: \"ec1ccecc-777e-492b-b655-75a18faf1aea\") " pod="openshift-ingress/router-default-7dc8547f57-57ktc"
Jul 28 15:15:11.286401 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.286359    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/067f2812-1c09-4be0-9cc7-371b1f1cd761-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-557fdd688-d895p\" (UID: \"067f2812-1c09-4be0-9cc7-371b1f1cd761\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-557fdd688-d895p"
Jul 28 15:15:11.287291 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.287256    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec1ccecc-777e-492b-b655-75a18faf1aea-service-ca-bundle\") pod \"router-default-7dc8547f57-57ktc\" (UID: \"ec1ccecc-777e-492b-b655-75a18faf1aea\") " pod="openshift-ingress/router-default-7dc8547f57-57ktc"
Jul 28 15:15:11.289311 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.289286    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ec1ccecc-777e-492b-b655-75a18faf1aea-metrics-certs\") pod \"router-default-7dc8547f57-57ktc\" (UID: \"ec1ccecc-777e-492b-b655-75a18faf1aea\") " pod="openshift-ingress/router-default-7dc8547f57-57ktc"
Jul 28 15:15:11.289949 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.289930    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/067f2812-1c09-4be0-9cc7-371b1f1cd761-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-557fdd688-d895p\" (UID: \"067f2812-1c09-4be0-9cc7-371b1f1cd761\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-557fdd688-d895p"
Jul 28 15:15:11.295229 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.295199    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-p28x8\""
Jul 28 15:15:11.300306 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.300281    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhdn6\" (UniqueName: \"kubernetes.io/projected/067f2812-1c09-4be0-9cc7-371b1f1cd761-kube-api-access-vhdn6\") pod \"managed-serviceaccount-addon-agent-557fdd688-d895p\" (UID: \"067f2812-1c09-4be0-9cc7-371b1f1cd761\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-557fdd688-d895p"
Jul 28 15:15:11.302103 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.302081    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7dc8547f57-57ktc"
Jul 28 15:15:11.334489 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.334459    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-557fdd688-d895p"
Jul 28 15:15:11.343340 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.343187    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-df69h"]
Jul 28 15:15:11.346377 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:15:11.346308    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5cbe82e_7228_42f0_8706_5faac882b35e.slice/crio-d7b1672a03c8f51b737737d82c420521d2a62c67d7b3b2898237b9b330e07a92 WatchSource:0}: Error finding container d7b1672a03c8f51b737737d82c420521d2a62c67d7b3b2898237b9b330e07a92: Status 404 returned error can't find the container with id d7b1672a03c8f51b737737d82c420521d2a62c67d7b3b2898237b9b330e07a92
Jul 28 15:15:11.387284 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.387243    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1c546354-dfcf-4cfd-9d78-9836622382db-registry-tls\") pod \"image-registry-55f49db7cc-hls2k\" (UID: \"1c546354-dfcf-4cfd-9d78-9836622382db\") " pod="openshift-image-registry/image-registry-55f49db7cc-hls2k"
Jul 28 15:15:11.390616 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.390244    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1c546354-dfcf-4cfd-9d78-9836622382db-registry-tls\") pod \"image-registry-55f49db7cc-hls2k\" (UID: \"1c546354-dfcf-4cfd-9d78-9836622382db\") " pod="openshift-image-registry/image-registry-55f49db7cc-hls2k"
Jul 28 15:15:11.455579 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.455548    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7dc8547f57-57ktc"]
Jul 28 15:15:11.459621 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:15:11.459595    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec1ccecc_777e_492b_b655_75a18faf1aea.slice/crio-6730a30b5a4f245946af33b900098fbbd93745c887583994aa8adb3277db6dc0 WatchSource:0}: Error finding container 6730a30b5a4f245946af33b900098fbbd93745c887583994aa8adb3277db6dc0: Status 404 returned error can't find the container with id 6730a30b5a4f245946af33b900098fbbd93745c887583994aa8adb3277db6dc0
Jul 28 15:15:11.467691 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.467671    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-557fdd688-d895p"]
Jul 28 15:15:11.472010 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:15:11.471984    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod067f2812_1c09_4be0_9cc7_371b1f1cd761.slice/crio-9a3fe188117dd186c153d159751b2403b5d089bc5929b2962299b2c76b069646 WatchSource:0}: Error finding container 9a3fe188117dd186c153d159751b2403b5d089bc5929b2962299b2c76b069646: Status 404 returned error can't find the container with id 9a3fe188117dd186c153d159751b2403b5d089bc5929b2962299b2c76b069646
Jul 28 15:15:11.835075 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.835041    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-df69h" event={"ID":"c5cbe82e-7228-42f0-8706-5faac882b35e","Type":"ContainerStarted","Data":"d7b1672a03c8f51b737737d82c420521d2a62c67d7b3b2898237b9b330e07a92"}
Jul 28 15:15:11.836334 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.836302    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-557fdd688-d895p" event={"ID":"067f2812-1c09-4be0-9cc7-371b1f1cd761","Type":"ContainerStarted","Data":"9a3fe188117dd186c153d159751b2403b5d089bc5929b2962299b2c76b069646"}
Jul 28 15:15:11.837858 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.837818    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55f49db7cc-hls2k"
Jul 28 15:15:11.837858 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.837843    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7dc8547f57-57ktc" event={"ID":"ec1ccecc-777e-492b-b655-75a18faf1aea","Type":"ContainerStarted","Data":"ee9b61de0daf1c4d3f749ee6120b24c1cd128e12c7f27d92a90ff119395536e7"}
Jul 28 15:15:11.838010 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.837888    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7dc8547f57-57ktc" event={"ID":"ec1ccecc-777e-492b-b655-75a18faf1aea","Type":"ContainerStarted","Data":"6730a30b5a4f245946af33b900098fbbd93745c887583994aa8adb3277db6dc0"}
Jul 28 15:15:11.845157 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.845136    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55f49db7cc-hls2k"
Jul 28 15:15:11.858250 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.858208    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-7dc8547f57-57ktc" podStartSLOduration=32.858195065 podStartE2EDuration="32.858195065s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:14:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:15:11.857842535 +0000 UTC m=+72.908210633" watchObservedRunningTime="2026-07-28 15:15:11.858195065 +0000 UTC m=+72.908563169"
Jul 28 15:15:11.992448 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.992419    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1c546354-dfcf-4cfd-9d78-9836622382db-installation-pull-secrets\") pod \"1c546354-dfcf-4cfd-9d78-9836622382db\" (UID: \"1c546354-dfcf-4cfd-9d78-9836622382db\") "
Jul 28 15:15:11.992448 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.992450    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1c546354-dfcf-4cfd-9d78-9836622382db-registry-tls\") pod \"1c546354-dfcf-4cfd-9d78-9836622382db\" (UID: \"1c546354-dfcf-4cfd-9d78-9836622382db\") "
Jul 28 15:15:11.992630 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.992482    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1c546354-dfcf-4cfd-9d78-9836622382db-registry-certificates\") pod \"1c546354-dfcf-4cfd-9d78-9836622382db\" (UID: \"1c546354-dfcf-4cfd-9d78-9836622382db\") "
Jul 28 15:15:11.992630 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.992517    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1c546354-dfcf-4cfd-9d78-9836622382db-bound-sa-token\") pod \"1c546354-dfcf-4cfd-9d78-9836622382db\" (UID: \"1c546354-dfcf-4cfd-9d78-9836622382db\") "
Jul 28 15:15:11.992630 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.992560    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1c546354-dfcf-4cfd-9d78-9836622382db-image-registry-private-configuration\") pod \"1c546354-dfcf-4cfd-9d78-9836622382db\" (UID: \"1c546354-dfcf-4cfd-9d78-9836622382db\") "
Jul 28 15:15:11.992630 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.992606    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m6gpp\" (UniqueName: \"kubernetes.io/projected/1c546354-dfcf-4cfd-9d78-9836622382db-kube-api-access-m6gpp\") pod \"1c546354-dfcf-4cfd-9d78-9836622382db\" (UID: \"1c546354-dfcf-4cfd-9d78-9836622382db\") "
Jul 28 15:15:11.992813 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.992631    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1c546354-dfcf-4cfd-9d78-9836622382db-trusted-ca\") pod \"1c546354-dfcf-4cfd-9d78-9836622382db\" (UID: \"1c546354-dfcf-4cfd-9d78-9836622382db\") "
Jul 28 15:15:11.992813 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.992660    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1c546354-dfcf-4cfd-9d78-9836622382db-ca-trust-extracted\") pod \"1c546354-dfcf-4cfd-9d78-9836622382db\" (UID: \"1c546354-dfcf-4cfd-9d78-9836622382db\") "
Jul 28 15:15:11.994000 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.992969    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c546354-dfcf-4cfd-9d78-9836622382db-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "1c546354-dfcf-4cfd-9d78-9836622382db" (UID: "1c546354-dfcf-4cfd-9d78-9836622382db"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 15:15:11.994000 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.993037    2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1c546354-dfcf-4cfd-9d78-9836622382db-registry-certificates\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:15:11.994000 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.993270    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c546354-dfcf-4cfd-9d78-9836622382db-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "1c546354-dfcf-4cfd-9d78-9836622382db" (UID: "1c546354-dfcf-4cfd-9d78-9836622382db"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 15:15:11.994000 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.993498    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c546354-dfcf-4cfd-9d78-9836622382db-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "1c546354-dfcf-4cfd-9d78-9836622382db" (UID: "1c546354-dfcf-4cfd-9d78-9836622382db"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 15:15:11.995090 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.995064    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c546354-dfcf-4cfd-9d78-9836622382db-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "1c546354-dfcf-4cfd-9d78-9836622382db" (UID: "1c546354-dfcf-4cfd-9d78-9836622382db"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 15:15:11.995191 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.995126    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c546354-dfcf-4cfd-9d78-9836622382db-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1c546354-dfcf-4cfd-9d78-9836622382db" (UID: "1c546354-dfcf-4cfd-9d78-9836622382db"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 15:15:11.995244 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.995193    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c546354-dfcf-4cfd-9d78-9836622382db-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "1c546354-dfcf-4cfd-9d78-9836622382db" (UID: "1c546354-dfcf-4cfd-9d78-9836622382db"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 15:15:11.995302 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.995285    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c546354-dfcf-4cfd-9d78-9836622382db-kube-api-access-m6gpp" (OuterVolumeSpecName: "kube-api-access-m6gpp") pod "1c546354-dfcf-4cfd-9d78-9836622382db" (UID: "1c546354-dfcf-4cfd-9d78-9836622382db"). InnerVolumeSpecName "kube-api-access-m6gpp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 15:15:11.995745 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:11.995731    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c546354-dfcf-4cfd-9d78-9836622382db-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "1c546354-dfcf-4cfd-9d78-9836622382db" (UID: "1c546354-dfcf-4cfd-9d78-9836622382db"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 15:15:12.093999 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:12.093927    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6gpp\" (UniqueName: \"kubernetes.io/projected/1c546354-dfcf-4cfd-9d78-9836622382db-kube-api-access-m6gpp\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:15:12.093999 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:12.093958    2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1c546354-dfcf-4cfd-9d78-9836622382db-trusted-ca\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:15:12.093999 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:12.093972    2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1c546354-dfcf-4cfd-9d78-9836622382db-ca-trust-extracted\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:15:12.093999 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:12.093985    2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1c546354-dfcf-4cfd-9d78-9836622382db-installation-pull-secrets\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:15:12.093999 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:12.093999    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1c546354-dfcf-4cfd-9d78-9836622382db-registry-tls\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:15:12.094264 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:12.094012    2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1c546354-dfcf-4cfd-9d78-9836622382db-bound-sa-token\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:15:12.094264 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:12.094024    2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1c546354-dfcf-4cfd-9d78-9836622382db-image-registry-private-configuration\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:15:12.302877 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:12.302838    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7dc8547f57-57ktc"
Jul 28 15:15:12.305794 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:12.305772    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7dc8547f57-57ktc"
Jul 28 15:15:12.841367 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:12.841334    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-55f49db7cc-hls2k"
Jul 28 15:15:12.841841 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:12.841809    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7dc8547f57-57ktc"
Jul 28 15:15:12.843153 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:12.843128    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7dc8547f57-57ktc"
Jul 28 15:15:12.902533 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:12.902505    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-55f49db7cc-hls2k"]
Jul 28 15:15:12.907745 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:12.907719    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-55f49db7cc-hls2k"]
Jul 28 15:15:13.414161 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:13.414080    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c546354-dfcf-4cfd-9d78-9836622382db" path="/var/lib/kubelet/pods/1c546354-dfcf-4cfd-9d78-9836622382db/volumes"
Jul 28 15:15:13.847216 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:13.847174    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-df69h" event={"ID":"c5cbe82e-7228-42f0-8706-5faac882b35e","Type":"ContainerStarted","Data":"1f02c6203a15eb9ef49e1fe3413ff7cc5773920920b733c6d839e7bef1689756"}
Jul 28 15:15:13.866896 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:13.866837    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-df69h" podStartSLOduration=33.150988559 podStartE2EDuration="34.866802561s" totalImagesPullingTime="1.715814002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:14:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:15:13.865326987 +0000 UTC m=+74.915695097" watchObservedRunningTime="2026-07-28 15:15:13.866802561 +0000 UTC m=+74.917170668"
Jul 28 15:15:15.856136 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:15.856102    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-557fdd688-d895p" event={"ID":"067f2812-1c09-4be0-9cc7-371b1f1cd761","Type":"ContainerStarted","Data":"3690d15f2b7e13f73b90f4633650a2bdfff0ce41c5a259d40d00d10612dc6c6f"}
Jul 28 15:15:15.875568 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:15.875523    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-557fdd688-d895p" podStartSLOduration=2.389708073 podStartE2EDuration="5.875508632s" totalImagesPullingTime="3.485800559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:15:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:15:15.874752049 +0000 UTC m=+76.925120154" watchObservedRunningTime="2026-07-28 15:15:15.875508632 +0000 UTC m=+76.925876736"
Jul 28 15:15:17.637241 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:17.637205    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b90505e5-bf3d-4dfa-b88d-0cd9313b609a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pr7fd\" (UID: \"b90505e5-bf3d-4dfa-b88d-0cd9313b609a\") " pod="openshift-insights/insights-runtime-extractor-pr7fd"
Jul 28 15:15:17.639491 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:17.639471    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b90505e5-bf3d-4dfa-b88d-0cd9313b609a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pr7fd\" (UID: \"b90505e5-bf3d-4dfa-b88d-0cd9313b609a\") " pod="openshift-insights/insights-runtime-extractor-pr7fd"
Jul 28 15:15:17.688372 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:17.688346    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-v9kfh"]
Jul 28 15:15:17.721133 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:17.721110    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-v9kfh"]
Jul 28 15:15:17.721251 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:17.721202    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-v9kfh"
Jul 28 15:15:17.724192 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:17.724167    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 28 15:15:17.724308 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:17.724209    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 28 15:15:17.725339 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:17.725320    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 28 15:15:17.725447 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:17.725322    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-plg7l\""
Jul 28 15:15:17.838597 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:17.838567    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7pl9\" (UniqueName: \"kubernetes.io/projected/69326ae8-732c-41ee-9feb-0687eaffdb3b-kube-api-access-q7pl9\") pod \"prometheus-operator-84d69f794d-v9kfh\" (UID: \"69326ae8-732c-41ee-9feb-0687eaffdb3b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-v9kfh"
Jul 28 15:15:17.838735 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:17.838603    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69326ae8-732c-41ee-9feb-0687eaffdb3b-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-v9kfh\" (UID: \"69326ae8-732c-41ee-9feb-0687eaffdb3b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-v9kfh"
Jul 28 15:15:17.838735 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:17.838629    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/69326ae8-732c-41ee-9feb-0687eaffdb3b-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-v9kfh\" (UID: \"69326ae8-732c-41ee-9feb-0687eaffdb3b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-v9kfh"
Jul 28 15:15:17.838735 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:17.838691    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/69326ae8-732c-41ee-9feb-0687eaffdb3b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-v9kfh\" (UID: \"69326ae8-732c-41ee-9feb-0687eaffdb3b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-v9kfh"
Jul 28 15:15:17.939400 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:17.939324    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7pl9\" (UniqueName: \"kubernetes.io/projected/69326ae8-732c-41ee-9feb-0687eaffdb3b-kube-api-access-q7pl9\") pod \"prometheus-operator-84d69f794d-v9kfh\" (UID: \"69326ae8-732c-41ee-9feb-0687eaffdb3b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-v9kfh"
Jul 28 15:15:17.939400 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:17.939364    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69326ae8-732c-41ee-9feb-0687eaffdb3b-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-v9kfh\" (UID: \"69326ae8-732c-41ee-9feb-0687eaffdb3b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-v9kfh"
Jul 28 15:15:17.939400 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:17.939392    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/69326ae8-732c-41ee-9feb-0687eaffdb3b-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-v9kfh\" (UID: \"69326ae8-732c-41ee-9feb-0687eaffdb3b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-v9kfh"
Jul 28 15:15:17.939633 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:17.939430    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/69326ae8-732c-41ee-9feb-0687eaffdb3b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-v9kfh\" (UID: \"69326ae8-732c-41ee-9feb-0687eaffdb3b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-v9kfh"
Jul 28 15:15:17.940041 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:17.940018    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/69326ae8-732c-41ee-9feb-0687eaffdb3b-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-v9kfh\" (UID: \"69326ae8-732c-41ee-9feb-0687eaffdb3b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-v9kfh"
Jul 28 15:15:17.941748 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:17.941727    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/69326ae8-732c-41ee-9feb-0687eaffdb3b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-v9kfh\" (UID: \"69326ae8-732c-41ee-9feb-0687eaffdb3b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-v9kfh"
Jul 28 15:15:17.941748 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:17.941736    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/69326ae8-732c-41ee-9feb-0687eaffdb3b-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-v9kfh\" (UID: \"69326ae8-732c-41ee-9feb-0687eaffdb3b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-v9kfh"
Jul 28 15:15:17.941992 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:17.941975    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-bk52q\""
Jul 28 15:15:17.948578 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:17.948559    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7pl9\" (UniqueName: \"kubernetes.io/projected/69326ae8-732c-41ee-9feb-0687eaffdb3b-kube-api-access-q7pl9\") pod \"prometheus-operator-84d69f794d-v9kfh\" (UID: \"69326ae8-732c-41ee-9feb-0687eaffdb3b\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-v9kfh"
Jul 28 15:15:17.949276 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:17.949259    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pr7fd"
Jul 28 15:15:18.029849 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:18.029803    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-v9kfh"
Jul 28 15:15:18.113315 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:18.113030    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pr7fd"]
Jul 28 15:15:18.116865 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:15:18.116818    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb90505e5_bf3d_4dfa_b88d_0cd9313b609a.slice/crio-1eabdea9738171531c9cdcd279e0ad780ef47be4ad02acf34ba56c80c66c5fa9 WatchSource:0}: Error finding container 1eabdea9738171531c9cdcd279e0ad780ef47be4ad02acf34ba56c80c66c5fa9: Status 404 returned error can't find the container with id 1eabdea9738171531c9cdcd279e0ad780ef47be4ad02acf34ba56c80c66c5fa9
Jul 28 15:15:18.194113 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:18.194046    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-v9kfh"]
Jul 28 15:15:18.197577 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:15:18.197551    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69326ae8_732c_41ee_9feb_0687eaffdb3b.slice/crio-e6a610eb6bc383df4a358e2aa074eeb9be831dda8c4caef4f69de3bdac67917c WatchSource:0}: Error finding container e6a610eb6bc383df4a358e2aa074eeb9be831dda8c4caef4f69de3bdac67917c: Status 404 returned error can't find the container with id e6a610eb6bc383df4a358e2aa074eeb9be831dda8c4caef4f69de3bdac67917c
Jul 28 15:15:18.869522 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:18.869478    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-v9kfh" event={"ID":"69326ae8-732c-41ee-9feb-0687eaffdb3b","Type":"ContainerStarted","Data":"e6a610eb6bc383df4a358e2aa074eeb9be831dda8c4caef4f69de3bdac67917c"}
Jul 28 15:15:18.870798 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:18.870766    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pr7fd" event={"ID":"b90505e5-bf3d-4dfa-b88d-0cd9313b609a","Type":"ContainerStarted","Data":"1eabdea9738171531c9cdcd279e0ad780ef47be4ad02acf34ba56c80c66c5fa9"}
Jul 28 15:15:19.879274 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:19.879176    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-v9kfh" event={"ID":"69326ae8-732c-41ee-9feb-0687eaffdb3b","Type":"ContainerStarted","Data":"5e8cfef62cf65af533d381a802a29a14c7008bf8c52fef23a91ba5d626e6848d"}
Jul 28 15:15:19.879274 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:19.879239    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-v9kfh" event={"ID":"69326ae8-732c-41ee-9feb-0687eaffdb3b","Type":"ContainerStarted","Data":"bc08aaad34a76d89aeb96342854155b29584511fcf2c83baf25d6227d1947547"}
Jul 28 15:15:19.900847 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:19.899672    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-v9kfh" podStartSLOduration=1.520643356 podStartE2EDuration="2.899649206s" totalImagesPullingTime="1.37900585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:15:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:15:19.89876851 +0000 UTC m=+80.949136615" watchObservedRunningTime="2026-07-28 15:15:19.899649206 +0000 UTC m=+80.950017312"
Jul 28 15:15:20.840882 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:20.840852    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-fdbqx"
Jul 28 15:15:22.087190 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.087154    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-9sb6c"]
Jul 28 15:15:22.103252 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.103216    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8gtwn"]
Jul 28 15:15:22.103423 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.103351    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9sb6c"
Jul 28 15:15:22.107260 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.107072    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8gtwn"
Jul 28 15:15:22.107994 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.107964    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-b4szx\""
Jul 28 15:15:22.108132 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.108057    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jul 28 15:15:22.108132 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.108081    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jul 28 15:15:22.108246 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.108166    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jul 28 15:15:22.110078 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.110051    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-9sb6c"]
Jul 28 15:15:22.113867 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.113656    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 28 15:15:22.113867 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.113770    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 28 15:15:22.113867 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.113770    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 28 15:15:22.114081 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.113876    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gx7p2\""
Jul 28 15:15:22.276325 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.276272    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7ed1a5bd-c71d-4365-a808-013079e6970e-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-9sb6c\" (UID: \"7ed1a5bd-c71d-4365-a808-013079e6970e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9sb6c"
Jul 28 15:15:22.276325 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.276321    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/85a13578-ac7e-46b7-92a4-6f23f3fe8901-node-exporter-wtmp\") pod \"node-exporter-8gtwn\" (UID: \"85a13578-ac7e-46b7-92a4-6f23f3fe8901\") " pod="openshift-monitoring/node-exporter-8gtwn"
Jul 28 15:15:22.276574 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.276343    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7ed1a5bd-c71d-4365-a808-013079e6970e-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-9sb6c\" (UID: \"7ed1a5bd-c71d-4365-a808-013079e6970e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9sb6c"
Jul 28 15:15:22.276574 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.276401    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/85a13578-ac7e-46b7-92a4-6f23f3fe8901-sys\") pod \"node-exporter-8gtwn\" (UID: \"85a13578-ac7e-46b7-92a4-6f23f3fe8901\") " pod="openshift-monitoring/node-exporter-8gtwn"
Jul 28 15:15:22.276574 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.276441    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/85a13578-ac7e-46b7-92a4-6f23f3fe8901-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8gtwn\" (UID: \"85a13578-ac7e-46b7-92a4-6f23f3fe8901\") " pod="openshift-monitoring/node-exporter-8gtwn"
Jul 28 15:15:22.276574 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.276504    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ed1a5bd-c71d-4365-a808-013079e6970e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-9sb6c\" (UID: \"7ed1a5bd-c71d-4365-a808-013079e6970e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9sb6c"
Jul 28 15:15:22.276574 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.276558    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85a13578-ac7e-46b7-92a4-6f23f3fe8901-metrics-client-ca\") pod \"node-exporter-8gtwn\" (UID: \"85a13578-ac7e-46b7-92a4-6f23f3fe8901\") " pod="openshift-monitoring/node-exporter-8gtwn"
Jul 28 15:15:22.276803 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.276586    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7ed1a5bd-c71d-4365-a808-013079e6970e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-9sb6c\" (UID: \"7ed1a5bd-c71d-4365-a808-013079e6970e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9sb6c"
Jul 28 15:15:22.276803 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.276625    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ed1a5bd-c71d-4365-a808-013079e6970e-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-9sb6c\" (UID: \"7ed1a5bd-c71d-4365-a808-013079e6970e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9sb6c"
Jul 28 15:15:22.276803 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.276689    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/85a13578-ac7e-46b7-92a4-6f23f3fe8901-node-exporter-accelerators-collector-config\") pod \"node-exporter-8gtwn\" (UID: \"85a13578-ac7e-46b7-92a4-6f23f3fe8901\") " pod="openshift-monitoring/node-exporter-8gtwn"
Jul 28 15:15:22.276803 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.276738    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/85a13578-ac7e-46b7-92a4-6f23f3fe8901-root\") pod \"node-exporter-8gtwn\" (UID: \"85a13578-ac7e-46b7-92a4-6f23f3fe8901\") " pod="openshift-monitoring/node-exporter-8gtwn"
Jul 28 15:15:22.276803 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.276791    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/85a13578-ac7e-46b7-92a4-6f23f3fe8901-node-exporter-textfile\") pod \"node-exporter-8gtwn\" (UID: \"85a13578-ac7e-46b7-92a4-6f23f3fe8901\") " pod="openshift-monitoring/node-exporter-8gtwn"
Jul 28 15:15:22.277065 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.276835    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/85a13578-ac7e-46b7-92a4-6f23f3fe8901-node-exporter-tls\") pod \"node-exporter-8gtwn\" (UID: \"85a13578-ac7e-46b7-92a4-6f23f3fe8901\") " pod="openshift-monitoring/node-exporter-8gtwn"
Jul 28 15:15:22.277065 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.276859    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kt78w\" (UniqueName: \"kubernetes.io/projected/85a13578-ac7e-46b7-92a4-6f23f3fe8901-kube-api-access-kt78w\") pod \"node-exporter-8gtwn\" (UID: \"85a13578-ac7e-46b7-92a4-6f23f3fe8901\") " pod="openshift-monitoring/node-exporter-8gtwn"
Jul 28 15:15:22.277065 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.276886    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p94ml\" (UniqueName: \"kubernetes.io/projected/7ed1a5bd-c71d-4365-a808-013079e6970e-kube-api-access-p94ml\") pod \"kube-state-metrics-56d9f944b4-9sb6c\" (UID: \"7ed1a5bd-c71d-4365-a808-013079e6970e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9sb6c"
Jul 28 15:15:22.377848 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.377756    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85a13578-ac7e-46b7-92a4-6f23f3fe8901-metrics-client-ca\") pod \"node-exporter-8gtwn\" (UID: \"85a13578-ac7e-46b7-92a4-6f23f3fe8901\") " pod="openshift-monitoring/node-exporter-8gtwn"
Jul 28 15:15:22.377848 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.377805    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7ed1a5bd-c71d-4365-a808-013079e6970e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-9sb6c\" (UID: \"7ed1a5bd-c71d-4365-a808-013079e6970e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9sb6c"
Jul 28 15:15:22.378094 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.377861    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ed1a5bd-c71d-4365-a808-013079e6970e-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-9sb6c\" (UID: \"7ed1a5bd-c71d-4365-a808-013079e6970e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9sb6c"
Jul 28 15:15:22.378094 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.377891    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/85a13578-ac7e-46b7-92a4-6f23f3fe8901-node-exporter-accelerators-collector-config\") pod \"node-exporter-8gtwn\" (UID: \"85a13578-ac7e-46b7-92a4-6f23f3fe8901\") " pod="openshift-monitoring/node-exporter-8gtwn"
Jul 28 15:15:22.378094 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.377919    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/85a13578-ac7e-46b7-92a4-6f23f3fe8901-root\") pod \"node-exporter-8gtwn\" (UID: \"85a13578-ac7e-46b7-92a4-6f23f3fe8901\") " pod="openshift-monitoring/node-exporter-8gtwn"
Jul 28 15:15:22.378094 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.377971    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/85a13578-ac7e-46b7-92a4-6f23f3fe8901-node-exporter-textfile\") pod \"node-exporter-8gtwn\" (UID: \"85a13578-ac7e-46b7-92a4-6f23f3fe8901\") " pod="openshift-monitoring/node-exporter-8gtwn"
Jul 28 15:15:22.378094 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.377998    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/85a13578-ac7e-46b7-92a4-6f23f3fe8901-node-exporter-tls\") pod \"node-exporter-8gtwn\" (UID: \"85a13578-ac7e-46b7-92a4-6f23f3fe8901\") " pod="openshift-monitoring/node-exporter-8gtwn"
Jul 28 15:15:22.378094 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.378022    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kt78w\" (UniqueName: \"kubernetes.io/projected/85a13578-ac7e-46b7-92a4-6f23f3fe8901-kube-api-access-kt78w\") pod \"node-exporter-8gtwn\" (UID: \"85a13578-ac7e-46b7-92a4-6f23f3fe8901\") " pod="openshift-monitoring/node-exporter-8gtwn"
Jul 28 15:15:22.378094 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.378049    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p94ml\" (UniqueName: \"kubernetes.io/projected/7ed1a5bd-c71d-4365-a808-013079e6970e-kube-api-access-p94ml\") pod \"kube-state-metrics-56d9f944b4-9sb6c\" (UID: \"7ed1a5bd-c71d-4365-a808-013079e6970e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9sb6c"
Jul 28 15:15:22.378094 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.378081    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7ed1a5bd-c71d-4365-a808-013079e6970e-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-9sb6c\" (UID: \"7ed1a5bd-c71d-4365-a808-013079e6970e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9sb6c"
Jul 28 15:15:22.378485 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.378112    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/85a13578-ac7e-46b7-92a4-6f23f3fe8901-node-exporter-wtmp\") pod \"node-exporter-8gtwn\" (UID: \"85a13578-ac7e-46b7-92a4-6f23f3fe8901\") " pod="openshift-monitoring/node-exporter-8gtwn"
Jul 28 15:15:22.378485 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.378143    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7ed1a5bd-c71d-4365-a808-013079e6970e-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-9sb6c\" (UID: \"7ed1a5bd-c71d-4365-a808-013079e6970e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9sb6c"
Jul 28 15:15:22.378485 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.378171    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/85a13578-ac7e-46b7-92a4-6f23f3fe8901-sys\") pod \"node-exporter-8gtwn\" (UID: \"85a13578-ac7e-46b7-92a4-6f23f3fe8901\") " pod="openshift-monitoring/node-exporter-8gtwn"
Jul 28 15:15:22.378485 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.378195    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/85a13578-ac7e-46b7-92a4-6f23f3fe8901-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8gtwn\" (UID: \"85a13578-ac7e-46b7-92a4-6f23f3fe8901\") " pod="openshift-monitoring/node-exporter-8gtwn"
Jul 28 15:15:22.378485 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.378228    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ed1a5bd-c71d-4365-a808-013079e6970e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-9sb6c\" (UID: \"7ed1a5bd-c71d-4365-a808-013079e6970e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9sb6c"
Jul 28 15:15:22.378485 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.378414    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85a13578-ac7e-46b7-92a4-6f23f3fe8901-metrics-client-ca\") pod \"node-exporter-8gtwn\" (UID: \"85a13578-ac7e-46b7-92a4-6f23f3fe8901\") " pod="openshift-monitoring/node-exporter-8gtwn"
Jul 28 15:15:22.378780 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.378491    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/85a13578-ac7e-46b7-92a4-6f23f3fe8901-root\") pod \"node-exporter-8gtwn\" (UID: \"85a13578-ac7e-46b7-92a4-6f23f3fe8901\") " pod="openshift-monitoring/node-exporter-8gtwn"
Jul 28 15:15:22.378780 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.378549    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/85a13578-ac7e-46b7-92a4-6f23f3fe8901-node-exporter-wtmp\") pod \"node-exporter-8gtwn\" (UID: \"85a13578-ac7e-46b7-92a4-6f23f3fe8901\") " pod="openshift-monitoring/node-exporter-8gtwn"
Jul 28 15:15:22.378780 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.378613    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7ed1a5bd-c71d-4365-a808-013079e6970e-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-9sb6c\" (UID: \"7ed1a5bd-c71d-4365-a808-013079e6970e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9sb6c"
Jul 28 15:15:22.378780 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.378662    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7ed1a5bd-c71d-4365-a808-013079e6970e-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-9sb6c\" (UID: \"7ed1a5bd-c71d-4365-a808-013079e6970e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9sb6c"
Jul 28 15:15:22.378780 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.378707    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/85a13578-ac7e-46b7-92a4-6f23f3fe8901-node-exporter-accelerators-collector-config\") pod \"node-exporter-8gtwn\" (UID: \"85a13578-ac7e-46b7-92a4-6f23f3fe8901\") " pod="openshift-monitoring/node-exporter-8gtwn"
Jul 28 15:15:22.378780 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:15:22.378764    2561 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 28 15:15:22.379114 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.378782    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/85a13578-ac7e-46b7-92a4-6f23f3fe8901-sys\") pod \"node-exporter-8gtwn\" (UID: \"85a13578-ac7e-46b7-92a4-6f23f3fe8901\") " pod="openshift-monitoring/node-exporter-8gtwn"
Jul 28 15:15:22.379114 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.378793    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7ed1a5bd-c71d-4365-a808-013079e6970e-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-9sb6c\" (UID: \"7ed1a5bd-c71d-4365-a808-013079e6970e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9sb6c"
Jul 28 15:15:22.379114 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:15:22.378860    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ed1a5bd-c71d-4365-a808-013079e6970e-kube-state-metrics-tls podName:7ed1a5bd-c71d-4365-a808-013079e6970e nodeName:}" failed. No retries permitted until 2026-07-28 15:15:22.878814158 +0000 UTC m=+83.929182245 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/7ed1a5bd-c71d-4365-a808-013079e6970e-kube-state-metrics-tls") pod "kube-state-metrics-56d9f944b4-9sb6c" (UID: "7ed1a5bd-c71d-4365-a808-013079e6970e") : secret "kube-state-metrics-tls" not found
Jul 28 15:15:22.379114 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.379042    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/85a13578-ac7e-46b7-92a4-6f23f3fe8901-node-exporter-textfile\") pod \"node-exporter-8gtwn\" (UID: \"85a13578-ac7e-46b7-92a4-6f23f3fe8901\") " pod="openshift-monitoring/node-exporter-8gtwn"
Jul 28 15:15:22.381211 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.381185    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7ed1a5bd-c71d-4365-a808-013079e6970e-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-9sb6c\" (UID: \"7ed1a5bd-c71d-4365-a808-013079e6970e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9sb6c"
Jul 28 15:15:22.381329 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.381310    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/85a13578-ac7e-46b7-92a4-6f23f3fe8901-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8gtwn\" (UID: \"85a13578-ac7e-46b7-92a4-6f23f3fe8901\") " pod="openshift-monitoring/node-exporter-8gtwn"
Jul 28 15:15:22.381370 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.381317    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/85a13578-ac7e-46b7-92a4-6f23f3fe8901-node-exporter-tls\") pod \"node-exporter-8gtwn\" (UID: \"85a13578-ac7e-46b7-92a4-6f23f3fe8901\") " pod="openshift-monitoring/node-exporter-8gtwn"
Jul 28 15:15:22.393640 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.393597    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kt78w\" (UniqueName: \"kubernetes.io/projected/85a13578-ac7e-46b7-92a4-6f23f3fe8901-kube-api-access-kt78w\") pod \"node-exporter-8gtwn\" (UID: \"85a13578-ac7e-46b7-92a4-6f23f3fe8901\") " pod="openshift-monitoring/node-exporter-8gtwn"
Jul 28 15:15:22.395671 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.395643    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p94ml\" (UniqueName: \"kubernetes.io/projected/7ed1a5bd-c71d-4365-a808-013079e6970e-kube-api-access-p94ml\") pod \"kube-state-metrics-56d9f944b4-9sb6c\" (UID: \"7ed1a5bd-c71d-4365-a808-013079e6970e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9sb6c"
Jul 28 15:15:22.423697 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.423665    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8gtwn"
Jul 28 15:15:22.881199 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:22.881159    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7ed1a5bd-c71d-4365-a808-013079e6970e-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-9sb6c\" (UID: \"7ed1a5bd-c71d-4365-a808-013079e6970e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9sb6c"
Jul 28 15:15:22.881393 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:15:22.881319    2561 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
Jul 28 15:15:22.881393 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:15:22.881386    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7ed1a5bd-c71d-4365-a808-013079e6970e-kube-state-metrics-tls podName:7ed1a5bd-c71d-4365-a808-013079e6970e nodeName:}" failed. No retries permitted until 2026-07-28 15:15:23.881370753 +0000 UTC m=+84.931738839 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/7ed1a5bd-c71d-4365-a808-013079e6970e-kube-state-metrics-tls") pod "kube-state-metrics-56d9f944b4-9sb6c" (UID: "7ed1a5bd-c71d-4365-a808-013079e6970e") : secret "kube-state-metrics-tls" not found
Jul 28 15:15:23.890651 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:23.890621    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7ed1a5bd-c71d-4365-a808-013079e6970e-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-9sb6c\" (UID: \"7ed1a5bd-c71d-4365-a808-013079e6970e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9sb6c"
Jul 28 15:15:23.893424 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:23.893399    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7ed1a5bd-c71d-4365-a808-013079e6970e-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-9sb6c\" (UID: \"7ed1a5bd-c71d-4365-a808-013079e6970e\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9sb6c"
Jul 28 15:15:23.916719 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:23.916687    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9sb6c"
Jul 28 15:15:24.111816 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:15:24.111704    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85a13578_ac7e_46b7_92a4_6f23f3fe8901.slice/crio-52fa9132b52e838e36b23669a2c822d50bae2cb564dd2859f94ae6beae7ae3ff WatchSource:0}: Error finding container 52fa9132b52e838e36b23669a2c822d50bae2cb564dd2859f94ae6beae7ae3ff: Status 404 returned error can't find the container with id 52fa9132b52e838e36b23669a2c822d50bae2cb564dd2859f94ae6beae7ae3ff
Jul 28 15:15:24.241765 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:24.241739    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-9sb6c"]
Jul 28 15:15:24.244099 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:15:24.244041    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ed1a5bd_c71d_4365_a808_013079e6970e.slice/crio-0d2d74725f6919aee4baec29c9cb812bd4452a59e8d000a88fa577a73169f376 WatchSource:0}: Error finding container 0d2d74725f6919aee4baec29c9cb812bd4452a59e8d000a88fa577a73169f376: Status 404 returned error can't find the container with id 0d2d74725f6919aee4baec29c9cb812bd4452a59e8d000a88fa577a73169f376
Jul 28 15:15:24.902992 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:24.902899    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pr7fd" event={"ID":"b90505e5-bf3d-4dfa-b88d-0cd9313b609a","Type":"ContainerStarted","Data":"ce073db64cfd2c47a83d8da0ec92a2b7a516c63a3cd317db9638f968b3fdf4aa"}
Jul 28 15:15:24.904611 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:24.904582    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9sb6c" event={"ID":"7ed1a5bd-c71d-4365-a808-013079e6970e","Type":"ContainerStarted","Data":"0d2d74725f6919aee4baec29c9cb812bd4452a59e8d000a88fa577a73169f376"}
Jul 28 15:15:24.906035 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:24.905974    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8gtwn" event={"ID":"85a13578-ac7e-46b7-92a4-6f23f3fe8901","Type":"ContainerStarted","Data":"52fa9132b52e838e36b23669a2c822d50bae2cb564dd2859f94ae6beae7ae3ff"}
Jul 28 15:15:25.912272 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:25.912227    2561 generic.go:356] "Generic (PLEG): container finished" podID="85a13578-ac7e-46b7-92a4-6f23f3fe8901" containerID="944a2eab501c2f0eaefccb44bc2522a66d4c0a0d69d657e2df332573cc5b6029" exitCode=0
Jul 28 15:15:25.912708 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:25.912319    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8gtwn" event={"ID":"85a13578-ac7e-46b7-92a4-6f23f3fe8901","Type":"ContainerDied","Data":"944a2eab501c2f0eaefccb44bc2522a66d4c0a0d69d657e2df332573cc5b6029"}
Jul 28 15:15:26.818450 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:26.818417    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-b7rrf"]
Jul 28 15:15:26.837387 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:26.837333    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-b7rrf"]
Jul 28 15:15:26.837564 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:26.837475    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-b7rrf"
Jul 28 15:15:26.841929 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:26.841609    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 28 15:15:26.841929 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:26.841774    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-zcxnw\""
Jul 28 15:15:26.916201 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:26.916171    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0113cdef-c44d-4e14-ade3-4b48aa414ae5-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-b7rrf\" (UID: \"0113cdef-c44d-4e14-ade3-4b48aa414ae5\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-b7rrf"
Jul 28 15:15:26.916555 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:26.916210    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v42pl\" (UniqueName: \"kubernetes.io/projected/0113cdef-c44d-4e14-ade3-4b48aa414ae5-kube-api-access-v42pl\") pod \"monitoring-plugin-68b7fc9574-b7rrf\" (UID: \"0113cdef-c44d-4e14-ade3-4b48aa414ae5\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-b7rrf"
Jul 28 15:15:27.017604 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:27.017568    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v42pl\" (UniqueName: \"kubernetes.io/projected/0113cdef-c44d-4e14-ade3-4b48aa414ae5-kube-api-access-v42pl\") pod \"monitoring-plugin-68b7fc9574-b7rrf\" (UID: \"0113cdef-c44d-4e14-ade3-4b48aa414ae5\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-b7rrf"
Jul 28 15:15:27.017768 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:27.017675    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0113cdef-c44d-4e14-ade3-4b48aa414ae5-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-b7rrf\" (UID: \"0113cdef-c44d-4e14-ade3-4b48aa414ae5\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-b7rrf"
Jul 28 15:15:27.017878 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:15:27.017787    2561 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 28 15:15:27.017878 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:15:27.017876    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0113cdef-c44d-4e14-ade3-4b48aa414ae5-monitoring-plugin-cert podName:0113cdef-c44d-4e14-ade3-4b48aa414ae5 nodeName:}" failed. No retries permitted until 2026-07-28 15:15:27.517852918 +0000 UTC m=+88.568221005 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/0113cdef-c44d-4e14-ade3-4b48aa414ae5-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-b7rrf" (UID: "0113cdef-c44d-4e14-ade3-4b48aa414ae5") : secret "monitoring-plugin-cert" not found
Jul 28 15:15:27.031485 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:27.031457    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v42pl\" (UniqueName: \"kubernetes.io/projected/0113cdef-c44d-4e14-ade3-4b48aa414ae5-kube-api-access-v42pl\") pod \"monitoring-plugin-68b7fc9574-b7rrf\" (UID: \"0113cdef-c44d-4e14-ade3-4b48aa414ae5\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-b7rrf"
Jul 28 15:15:27.525915 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:27.525875    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0113cdef-c44d-4e14-ade3-4b48aa414ae5-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-b7rrf\" (UID: \"0113cdef-c44d-4e14-ade3-4b48aa414ae5\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-b7rrf"
Jul 28 15:15:27.528461 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:27.528440    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0113cdef-c44d-4e14-ade3-4b48aa414ae5-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-b7rrf\" (UID: \"0113cdef-c44d-4e14-ade3-4b48aa414ae5\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-b7rrf"
Jul 28 15:15:27.750381 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:27.750303    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-b7rrf"
Jul 28 15:15:28.107762 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:28.107609    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-b7rrf"]
Jul 28 15:15:28.926555 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:28.926514    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-b7rrf" event={"ID":"0113cdef-c44d-4e14-ade3-4b48aa414ae5","Type":"ContainerStarted","Data":"40d79b56e2ad95894e49ac9d9dab88b4936bd2dfb41a556ed89e6856fab37166"}
Jul 28 15:15:28.929046 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:28.929010    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pr7fd" event={"ID":"b90505e5-bf3d-4dfa-b88d-0cd9313b609a","Type":"ContainerStarted","Data":"b5ea0979604d36ea74747770eeac7ee0a93ee0a9ed990349ac2622a5dd5a1aec"}
Jul 28 15:15:28.932430 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:28.932403    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9sb6c" event={"ID":"7ed1a5bd-c71d-4365-a808-013079e6970e","Type":"ContainerStarted","Data":"438c54de5b0471cd51e4717dd9420c0f3ca00b96d4f7ec78a1bdca8a09d23bc1"}
Jul 28 15:15:28.932570 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:28.932461    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9sb6c" event={"ID":"7ed1a5bd-c71d-4365-a808-013079e6970e","Type":"ContainerStarted","Data":"5bbe4e3fbbcf42786212b630eae599474315d3d1d2311e5b995f5a83c6d2b29f"}
Jul 28 15:15:28.932570 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:28.932493    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9sb6c" event={"ID":"7ed1a5bd-c71d-4365-a808-013079e6970e","Type":"ContainerStarted","Data":"4c9de8014f71a09c162a30bfc9c9db83d169f97ff251fb23ce1e03048b848629"}
Jul 28 15:15:28.935197 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:28.935171    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8gtwn" event={"ID":"85a13578-ac7e-46b7-92a4-6f23f3fe8901","Type":"ContainerStarted","Data":"364e2b62e7cf8a20513f06a2cc7f7ad4d7ccc0265911c829dbad1f6c06e7d40c"}
Jul 28 15:15:28.935310 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:28.935220    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8gtwn" event={"ID":"85a13578-ac7e-46b7-92a4-6f23f3fe8901","Type":"ContainerStarted","Data":"c485a155498f8010710245a7fd85ad6c4f5c13dd5ba9630bd038818d03a591bc"}
Jul 28 15:15:28.959711 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:28.959656    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-9sb6c" podStartSLOduration=3.246758606 podStartE2EDuration="6.959635216s" totalImagesPullingTime="3.71287661s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:15:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:15:28.957867412 +0000 UTC m=+90.008235520" watchObservedRunningTime="2026-07-28 15:15:28.959635216 +0000 UTC m=+90.010003325"
Jul 28 15:15:28.993439 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:28.993247    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8gtwn" podStartSLOduration=5.925275239 podStartE2EDuration="6.993230283s" totalImagesPullingTime="986.487666ms" totalInitContainerRuntime="81.467378ms" isStatefulPod=true podCreationTimestamp="2026-07-28 15:15:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:15:28.991067581 +0000 UTC m=+90.041435687" watchObservedRunningTime="2026-07-28 15:15:28.993230283 +0000 UTC m=+90.043598389"
Jul 28 15:15:29.941993 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:29.941762    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-b7rrf" event={"ID":"0113cdef-c44d-4e14-ade3-4b48aa414ae5","Type":"ContainerStarted","Data":"75b58e5dac8466fce9dcd623112a092a188f6467bc48ead3128b06ec6b2de9e7"}
Jul 28 15:15:29.942341 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:29.942205    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-b7rrf"
Jul 28 15:15:29.943731 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:29.943702    2561 patch_prober.go:28] interesting pod/monitoring-plugin-68b7fc9574-b7rrf container/monitoring-plugin namespace/openshift-monitoring: Readiness probe status=failure output="Get \"https://10.133.0.19:9443/health\": dial tcp 10.133.0.19:9443: connect: connection refused" start-of-body=
Jul 28 15:15:29.943861 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:29.943753    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-b7rrf" podUID="0113cdef-c44d-4e14-ade3-4b48aa414ae5" containerName="monitoring-plugin" probeResult="failure" output="Get \"https://10.133.0.19:9443/health\": dial tcp 10.133.0.19:9443: connect: connection refused"
Jul 28 15:15:29.982557 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:29.982497    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-b7rrf" podStartSLOduration=2.24762371 podStartE2EDuration="3.982476713s" totalImagesPullingTime="1.734853003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:15:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:15:29.981836891 +0000 UTC m=+91.032204989" watchObservedRunningTime="2026-07-28 15:15:29.982476713 +0000 UTC m=+91.032844821"
Jul 28 15:15:30.950151 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:30.950116    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-b7rrf"
Jul 28 15:15:31.951252 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:31.951219    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pr7fd" event={"ID":"b90505e5-bf3d-4dfa-b88d-0cd9313b609a","Type":"ContainerStarted","Data":"4003895ee16d349ab7e7947ad75ee09e22d4a3ec6d7c7fda60c3ee966c312441"}
Jul 28 15:15:31.975908 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:31.975865    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pr7fd" podStartSLOduration=33.415482095 podStartE2EDuration="46.975848693s" totalImagesPullingTime="13.560366598s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 15:14:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:15:31.97517606 +0000 UTC m=+93.025544166" watchObservedRunningTime="2026-07-28 15:15:31.975848693 +0000 UTC m=+93.026216795"
Jul 28 15:15:36.811902 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:36.811873    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mds5d"
Jul 28 15:15:37.628849 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:37.628806    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-44cqd"]
Jul 28 15:15:37.633085 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:37.633067    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-44cqd"
Jul 28 15:15:37.636007 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:37.635989    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 28 15:15:37.636117 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:37.635990    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-k9tm4\""
Jul 28 15:15:37.636117 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:37.636022    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 28 15:15:37.642179 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:37.642159    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-44cqd"]
Jul 28 15:15:37.705679 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:37.705655    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8nfql\" (UniqueName: \"kubernetes.io/projected/8fe03823-8140-423f-b3c9-884405f02cc6-kube-api-access-8nfql\") pod \"downloads-7c97dc4555-44cqd\" (UID: \"8fe03823-8140-423f-b3c9-884405f02cc6\") " pod="openshift-console/downloads-7c97dc4555-44cqd"
Jul 28 15:15:37.806639 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:37.806601    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8nfql\" (UniqueName: \"kubernetes.io/projected/8fe03823-8140-423f-b3c9-884405f02cc6-kube-api-access-8nfql\") pod \"downloads-7c97dc4555-44cqd\" (UID: \"8fe03823-8140-423f-b3c9-884405f02cc6\") " pod="openshift-console/downloads-7c97dc4555-44cqd"
Jul 28 15:15:37.819430 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:37.819403    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8nfql\" (UniqueName: \"kubernetes.io/projected/8fe03823-8140-423f-b3c9-884405f02cc6-kube-api-access-8nfql\") pod \"downloads-7c97dc4555-44cqd\" (UID: \"8fe03823-8140-423f-b3c9-884405f02cc6\") " pod="openshift-console/downloads-7c97dc4555-44cqd"
Jul 28 15:15:37.942186 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:37.942107    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-44cqd"
Jul 28 15:15:38.079621 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:38.079455    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-44cqd"]
Jul 28 15:15:38.081644 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:15:38.081616    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8fe03823_8140_423f_b3c9_884405f02cc6.slice/crio-7c6ac5fd4ec51d9e3033991a81d714f3833ee037738ff069b2d802a339524174 WatchSource:0}: Error finding container 7c6ac5fd4ec51d9e3033991a81d714f3833ee037738ff069b2d802a339524174: Status 404 returned error can't find the container with id 7c6ac5fd4ec51d9e3033991a81d714f3833ee037738ff069b2d802a339524174
Jul 28 15:15:38.983566 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:38.983529    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-44cqd" event={"ID":"8fe03823-8140-423f-b3c9-884405f02cc6","Type":"ContainerStarted","Data":"7c6ac5fd4ec51d9e3033991a81d714f3833ee037738ff069b2d802a339524174"}
Jul 28 15:15:56.053216 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:56.053181    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-44cqd" event={"ID":"8fe03823-8140-423f-b3c9-884405f02cc6","Type":"ContainerStarted","Data":"118417f6e7cf5fd13485db9b79bdef971f7aa361461dd2c2aa3a5fe67f4db3ca"}
Jul 28 15:15:56.053697 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:56.053460    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-44cqd"
Jul 28 15:15:56.066589 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:56.066565    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-44cqd"
Jul 28 15:15:56.075175 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:15:56.075121    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-44cqd" podStartSLOduration=1.946534859 podStartE2EDuration="19.075100296s" totalImagesPullingTime="17.128565437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:15:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:15:56.074483193 +0000 UTC m=+117.124851297" watchObservedRunningTime="2026-07-28 15:15:56.075100296 +0000 UTC m=+117.125468404"
Jul 28 15:16:11.113541 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:16:11.113509    2561 generic.go:356] "Generic (PLEG): container finished" podID="b173c54c-c79a-4cdd-803b-c0b218c95bda" containerID="0da462a4ff4a9b223f72df35271c58f3a43fe0a0ad5557bbb6818fd02686ed92" exitCode=0
Jul 28 15:16:11.114037 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:16:11.113587    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-fzgwv" event={"ID":"b173c54c-c79a-4cdd-803b-c0b218c95bda","Type":"ContainerDied","Data":"0da462a4ff4a9b223f72df35271c58f3a43fe0a0ad5557bbb6818fd02686ed92"}
Jul 28 15:16:11.114037 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:16:11.113964    2561 scope.go:117] "RemoveContainer" containerID="0da462a4ff4a9b223f72df35271c58f3a43fe0a0ad5557bbb6818fd02686ed92"
Jul 28 15:16:11.115058 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:16:11.115034    2561 generic.go:356] "Generic (PLEG): container finished" podID="a8c7852f-a649-484b-b4e9-b24146452370" containerID="2ce9202497a376b21d43c0701da5c178fac97c9667e1e2381411f4ac1f2a71e1" exitCode=0
Jul 28 15:16:11.115172 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:16:11.115091    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bfkmm" event={"ID":"a8c7852f-a649-484b-b4e9-b24146452370","Type":"ContainerDied","Data":"2ce9202497a376b21d43c0701da5c178fac97c9667e1e2381411f4ac1f2a71e1"}
Jul 28 15:16:11.115334 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:16:11.115321    2561 scope.go:117] "RemoveContainer" containerID="2ce9202497a376b21d43c0701da5c178fac97c9667e1e2381411f4ac1f2a71e1"
Jul 28 15:16:11.859743 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:16:11.859705    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7dc8547f57-57ktc_ec1ccecc-777e-492b-b655-75a18faf1aea/router/0.log"
Jul 28 15:16:11.875514 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:16:11.875491    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-m7sbs_b76cac71-0442-432d-afc4-c12ef52b534c/serve-healthcheck-canary/0.log"
Jul 28 15:16:12.120889 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:16:12.120787    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-bfkmm" event={"ID":"a8c7852f-a649-484b-b4e9-b24146452370","Type":"ContainerStarted","Data":"f4ff1d67d717469c8b22d4aec5b3e71c7233a7c5d61a24dea340aceb1a35eb2e"}
Jul 28 15:16:12.122577 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:16:12.122553    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-fzgwv" event={"ID":"b173c54c-c79a-4cdd-803b-c0b218c95bda","Type":"ContainerStarted","Data":"f9eceb9ccad2d63d8343c191df7598d63a0e108ed06b47e629052791afc239fa"}
Jul 28 15:18:59.277265 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:18:59.277231    2561 kubelet.go:1648] "Image garbage collection succeeded"
Jul 28 15:19:30.594156 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:19:30.594124    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["feast-operator-system/feast-operator-controller-manager-79645955c-jzfj2"]
Jul 28 15:19:30.597374 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:19:30.597357    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-79645955c-jzfj2"
Jul 28 15:19:30.601149 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:19:30.601123    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"openshift-service-ca.crt\""
Jul 28 15:19:30.601464 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:19:30.601449    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"feast-operator-system\"/\"kube-root-ca.crt\""
Jul 28 15:19:30.602719 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:19:30.602696    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"feast-operator-system\"/\"feast-operator-controller-manager-dockercfg-xkvlb\""
Jul 28 15:19:30.616846 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:19:30.616800    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgthg\" (UniqueName: \"kubernetes.io/projected/65de8a0c-4de4-4fcd-9e81-eb44b3b543ce-kube-api-access-kgthg\") pod \"feast-operator-controller-manager-79645955c-jzfj2\" (UID: \"65de8a0c-4de4-4fcd-9e81-eb44b3b543ce\") " pod="feast-operator-system/feast-operator-controller-manager-79645955c-jzfj2"
Jul 28 15:19:30.623774 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:19:30.623751    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-79645955c-jzfj2"]
Jul 28 15:19:30.717528 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:19:30.717489    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgthg\" (UniqueName: \"kubernetes.io/projected/65de8a0c-4de4-4fcd-9e81-eb44b3b543ce-kube-api-access-kgthg\") pod \"feast-operator-controller-manager-79645955c-jzfj2\" (UID: \"65de8a0c-4de4-4fcd-9e81-eb44b3b543ce\") " pod="feast-operator-system/feast-operator-controller-manager-79645955c-jzfj2"
Jul 28 15:19:30.729245 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:19:30.729219    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgthg\" (UniqueName: \"kubernetes.io/projected/65de8a0c-4de4-4fcd-9e81-eb44b3b543ce-kube-api-access-kgthg\") pod \"feast-operator-controller-manager-79645955c-jzfj2\" (UID: \"65de8a0c-4de4-4fcd-9e81-eb44b3b543ce\") " pod="feast-operator-system/feast-operator-controller-manager-79645955c-jzfj2"
Jul 28 15:19:30.912671 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:19:30.907972    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-79645955c-jzfj2"
Jul 28 15:19:31.043735 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:19:31.043644    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-79645955c-jzfj2"]
Jul 28 15:19:31.046409 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:19:31.046376    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65de8a0c_4de4_4fcd_9e81_eb44b3b543ce.slice/crio-b962d8d5277356fff7e90ef531e0ce99a67f815c71634b045407dab250a7e0e9 WatchSource:0}: Error finding container b962d8d5277356fff7e90ef531e0ce99a67f815c71634b045407dab250a7e0e9: Status 404 returned error can't find the container with id b962d8d5277356fff7e90ef531e0ce99a67f815c71634b045407dab250a7e0e9
Jul 28 15:19:31.048177 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:19:31.048160    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 15:19:31.840030 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:19:31.839993    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-79645955c-jzfj2" event={"ID":"65de8a0c-4de4-4fcd-9e81-eb44b3b543ce","Type":"ContainerStarted","Data":"b962d8d5277356fff7e90ef531e0ce99a67f815c71634b045407dab250a7e0e9"}
Jul 28 15:19:33.851302 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:19:33.851259    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-79645955c-jzfj2" event={"ID":"65de8a0c-4de4-4fcd-9e81-eb44b3b543ce","Type":"ContainerStarted","Data":"cad52e7d78b3c62f97332d2ef6e5c127960c743fe08ecef29be60f7dff956e86"}
Jul 28 15:19:33.851764 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:19:33.851349    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="feast-operator-system/feast-operator-controller-manager-79645955c-jzfj2"
Jul 28 15:19:33.870856 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:19:33.870759    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="feast-operator-system/feast-operator-controller-manager-79645955c-jzfj2" podStartSLOduration=1.360980646 podStartE2EDuration="3.870737862s" totalImagesPullingTime="2.509757216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:19:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:19:33.870733652 +0000 UTC m=+334.921101758" watchObservedRunningTime="2026-07-28 15:19:33.870737862 +0000 UTC m=+334.921105981"
Jul 28 15:19:44.857309 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:19:44.857275    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="feast-operator-system/feast-operator-controller-manager-79645955c-jzfj2"
Jul 28 15:20:08.468102 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:08.468001    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr"]
Jul 28 15:20:08.476984 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:08.476958    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr"
Jul 28 15:20:08.481650 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:08.481622    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Jul 28 15:20:08.482920 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:08.482899    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Jul 28 15:20:08.483692 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:08.483375    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Jul 28 15:20:08.483692 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:08.483504    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Jul 28 15:20:08.483692 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:08.483645    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-fltz5\""
Jul 28 15:20:08.483887 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:08.483727    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Jul 28 15:20:08.483950 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:08.483909    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Jul 28 15:20:08.484008 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:08.483995    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-intra-comm\""
Jul 28 15:20:08.492332 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:08.492308    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr"]
Jul 28 15:20:08.622274 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:08.622234    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/92201e19-d436-4ec9-a244-194e927a87b5-registry-tls\") pod \"feast-simple-feast-setup-55f4f9844b-nx4vr\" (UID: \"92201e19-d436-4ec9-a244-194e927a87b5\") " pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr"
Jul 28 15:20:08.622274 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:08.622276    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/92201e19-d436-4ec9-a244-194e927a87b5-offline-tls\") pod \"feast-simple-feast-setup-55f4f9844b-nx4vr\" (UID: \"92201e19-d436-4ec9-a244-194e927a87b5\") " pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr"
Jul 28 15:20:08.622505 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:08.622301    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/92201e19-d436-4ec9-a244-194e927a87b5-online-tls\") pod \"feast-simple-feast-setup-55f4f9844b-nx4vr\" (UID: \"92201e19-d436-4ec9-a244-194e927a87b5\") " pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr"
Jul 28 15:20:08.622505 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:08.622377    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/92201e19-d436-4ec9-a244-194e927a87b5-feast-data\") pod \"feast-simple-feast-setup-55f4f9844b-nx4vr\" (UID: \"92201e19-d436-4ec9-a244-194e927a87b5\") " pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr"
Jul 28 15:20:08.622505 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:08.622401    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cczkf\" (UniqueName: \"kubernetes.io/projected/92201e19-d436-4ec9-a244-194e927a87b5-kube-api-access-cczkf\") pod \"feast-simple-feast-setup-55f4f9844b-nx4vr\" (UID: \"92201e19-d436-4ec9-a244-194e927a87b5\") " pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr"
Jul 28 15:20:08.622505 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:08.622429    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/92201e19-d436-4ec9-a244-194e927a87b5-ui-tls\") pod \"feast-simple-feast-setup-55f4f9844b-nx4vr\" (UID: \"92201e19-d436-4ec9-a244-194e927a87b5\") " pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr"
Jul 28 15:20:08.723600 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:08.723518    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/92201e19-d436-4ec9-a244-194e927a87b5-registry-tls\") pod \"feast-simple-feast-setup-55f4f9844b-nx4vr\" (UID: \"92201e19-d436-4ec9-a244-194e927a87b5\") " pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr"
Jul 28 15:20:08.723600 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:08.723560    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/92201e19-d436-4ec9-a244-194e927a87b5-offline-tls\") pod \"feast-simple-feast-setup-55f4f9844b-nx4vr\" (UID: \"92201e19-d436-4ec9-a244-194e927a87b5\") " pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr"
Jul 28 15:20:08.723600 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:08.723580    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/92201e19-d436-4ec9-a244-194e927a87b5-online-tls\") pod \"feast-simple-feast-setup-55f4f9844b-nx4vr\" (UID: \"92201e19-d436-4ec9-a244-194e927a87b5\") " pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr"
Jul 28 15:20:08.723924 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:08.723627    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/92201e19-d436-4ec9-a244-194e927a87b5-feast-data\") pod \"feast-simple-feast-setup-55f4f9844b-nx4vr\" (UID: \"92201e19-d436-4ec9-a244-194e927a87b5\") " pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr"
Jul 28 15:20:08.723924 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:08.723653    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cczkf\" (UniqueName: \"kubernetes.io/projected/92201e19-d436-4ec9-a244-194e927a87b5-kube-api-access-cczkf\") pod \"feast-simple-feast-setup-55f4f9844b-nx4vr\" (UID: \"92201e19-d436-4ec9-a244-194e927a87b5\") " pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr"
Jul 28 15:20:08.723924 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:08.723685    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/92201e19-d436-4ec9-a244-194e927a87b5-ui-tls\") pod \"feast-simple-feast-setup-55f4f9844b-nx4vr\" (UID: \"92201e19-d436-4ec9-a244-194e927a87b5\") " pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr"
Jul 28 15:20:08.724176 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:08.724140    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/92201e19-d436-4ec9-a244-194e927a87b5-feast-data\") pod \"feast-simple-feast-setup-55f4f9844b-nx4vr\" (UID: \"92201e19-d436-4ec9-a244-194e927a87b5\") " pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr"
Jul 28 15:20:08.726370 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:08.726347    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/92201e19-d436-4ec9-a244-194e927a87b5-registry-tls\") pod \"feast-simple-feast-setup-55f4f9844b-nx4vr\" (UID: \"92201e19-d436-4ec9-a244-194e927a87b5\") " pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr"
Jul 28 15:20:08.726466 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:08.726354    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/92201e19-d436-4ec9-a244-194e927a87b5-online-tls\") pod \"feast-simple-feast-setup-55f4f9844b-nx4vr\" (UID: \"92201e19-d436-4ec9-a244-194e927a87b5\") " pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr"
Jul 28 15:20:08.726466 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:08.726411    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/92201e19-d436-4ec9-a244-194e927a87b5-ui-tls\") pod \"feast-simple-feast-setup-55f4f9844b-nx4vr\" (UID: \"92201e19-d436-4ec9-a244-194e927a87b5\") " pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr"
Jul 28 15:20:08.726466 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:08.726417    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/92201e19-d436-4ec9-a244-194e927a87b5-offline-tls\") pod \"feast-simple-feast-setup-55f4f9844b-nx4vr\" (UID: \"92201e19-d436-4ec9-a244-194e927a87b5\") " pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr"
Jul 28 15:20:08.734425 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:08.734401    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cczkf\" (UniqueName: \"kubernetes.io/projected/92201e19-d436-4ec9-a244-194e927a87b5-kube-api-access-cczkf\") pod \"feast-simple-feast-setup-55f4f9844b-nx4vr\" (UID: \"92201e19-d436-4ec9-a244-194e927a87b5\") " pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr"
Jul 28 15:20:08.786561 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:08.786520    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr"
Jul 28 15:20:08.931979 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:08.931954    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr"]
Jul 28 15:20:08.934492 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:20:08.934467    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod92201e19_d436_4ec9_a244_194e927a87b5.slice/crio-5fe8c49dafc9f8c6e35795c80f247fbcf1b29b5f47f8890d4b89b9f11fa940d0 WatchSource:0}: Error finding container 5fe8c49dafc9f8c6e35795c80f247fbcf1b29b5f47f8890d4b89b9f11fa940d0: Status 404 returned error can't find the container with id 5fe8c49dafc9f8c6e35795c80f247fbcf1b29b5f47f8890d4b89b9f11fa940d0
Jul 28 15:20:08.980537 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:08.980446    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr" event={"ID":"92201e19-d436-4ec9-a244-194e927a87b5","Type":"ContainerStarted","Data":"5fe8c49dafc9f8c6e35795c80f247fbcf1b29b5f47f8890d4b89b9f11fa940d0"}
Jul 28 15:20:36.094143 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:36.094104    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr" event={"ID":"92201e19-d436-4ec9-a244-194e927a87b5","Type":"ContainerStarted","Data":"2a9bd1a8305de74ea25f6c16e42b2124c50eb697e743a9ae1966f19ac95e9365"}
Jul 28 15:20:41.115397 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:41.115359    2561 generic.go:356] "Generic (PLEG): container finished" podID="92201e19-d436-4ec9-a244-194e927a87b5" containerID="2a9bd1a8305de74ea25f6c16e42b2124c50eb697e743a9ae1966f19ac95e9365" exitCode=0
Jul 28 15:20:41.115820 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:41.115413    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr" event={"ID":"92201e19-d436-4ec9-a244-194e927a87b5","Type":"ContainerDied","Data":"2a9bd1a8305de74ea25f6c16e42b2124c50eb697e743a9ae1966f19ac95e9365"}
Jul 28 15:20:42.120500 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:42.120465    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr" event={"ID":"92201e19-d436-4ec9-a244-194e927a87b5","Type":"ContainerStarted","Data":"4d999705456601911fe7a5b533b7467a6130e528de6c58ad05eddca059afa97a"}
Jul 28 15:20:48.146052 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:48.146016    2561 generic.go:356] "Generic (PLEG): container finished" podID="92201e19-d436-4ec9-a244-194e927a87b5" containerID="4d999705456601911fe7a5b533b7467a6130e528de6c58ad05eddca059afa97a" exitCode=0
Jul 28 15:20:48.146461 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:48.146073    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr" event={"ID":"92201e19-d436-4ec9-a244-194e927a87b5","Type":"ContainerDied","Data":"4d999705456601911fe7a5b533b7467a6130e528de6c58ad05eddca059afa97a"}
Jul 28 15:20:49.156472 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:49.156436    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr" event={"ID":"92201e19-d436-4ec9-a244-194e927a87b5","Type":"ContainerStarted","Data":"403d55aae1fb044eed6a9495b2c14cd999c0fa00b98c072f367a94fcec216ff8"}
Jul 28 15:20:49.157013 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:49.156489    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr" event={"ID":"92201e19-d436-4ec9-a244-194e927a87b5","Type":"ContainerStarted","Data":"aba85f9118969356f27d477f1bbbe02697783106a8dc11194e14c8ff81ebe314"}
Jul 28 15:20:49.157013 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:49.156503    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr" event={"ID":"92201e19-d436-4ec9-a244-194e927a87b5","Type":"ContainerStarted","Data":"0ee7910d54b8646629c2092e09ef7b21d6cc6c8bfd9d93d865fc7efbbd4f9df3"}
Jul 28 15:20:49.157013 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:49.156516    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr" event={"ID":"92201e19-d436-4ec9-a244-194e927a87b5","Type":"ContainerStarted","Data":"3992e260b2a94f3bd1163d4debded124d563eab110091790fdcd9b2efd8de691"}
Jul 28 15:20:49.191781 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:49.191718    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr" podStartSLOduration=14.99645751 podStartE2EDuration="41.19169469s" totalImagesPullingTime="26.19523718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:20:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:20:49.190896939 +0000 UTC m=+410.241265047" watchObservedRunningTime="2026-07-28 15:20:49.19169469 +0000 UTC m=+410.242062796"
Jul 28 15:20:50.786991 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:50.786943    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr"
Jul 28 15:20:50.787475 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:50.787014    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr"
Jul 28 15:20:50.787475 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:50.787036    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr"
Jul 28 15:20:50.787475 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:50.787054    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr"
Jul 28 15:20:50.789193 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:50.789142    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr" podUID="92201e19-d436-4ec9-a244-194e927a87b5" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.22:6571: connect: connection refused"
Jul 28 15:20:50.789193 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:50.789175    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr" podUID="92201e19-d436-4ec9-a244-194e927a87b5" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.22:8816: connect: connection refused"
Jul 28 15:20:50.789193 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:50.789184    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr" podUID="92201e19-d436-4ec9-a244-194e927a87b5" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused"
Jul 28 15:20:50.789456 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:50.789252    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr" podUID="92201e19-d436-4ec9-a244-194e927a87b5" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.22:8443: connect: connection refused"
Jul 28 15:20:53.787681 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:53.787626    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr" podUID="92201e19-d436-4ec9-a244-194e927a87b5" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.22:6571: connect: connection refused"
Jul 28 15:20:53.788195 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:53.787647    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr" podUID="92201e19-d436-4ec9-a244-194e927a87b5" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.22:8443: connect: connection refused"
Jul 28 15:20:53.788195 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:53.787700    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr" podUID="92201e19-d436-4ec9-a244-194e927a87b5" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused"
Jul 28 15:20:53.788195 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:53.787813    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr" podUID="92201e19-d436-4ec9-a244-194e927a87b5" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.22:8816: connect: connection refused"
Jul 28 15:20:56.788181 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:56.788142    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr"
Jul 28 15:20:56.788656 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:56.788302    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr"
Jul 28 15:20:56.788656 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:56.788472    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr"
Jul 28 15:20:56.789028 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:56.788873    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr"
Jul 28 15:20:56.789028 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:56.788922    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr"
Jul 28 15:20:56.789028 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:56.788940    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr"
Jul 28 15:20:56.789028 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:56.789003    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr"
Jul 28 15:20:56.789298 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:56.789281    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr"
Jul 28 15:20:56.789354 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:56.789346    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr"
Jul 28 15:20:56.793769 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:56.793741    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr"
Jul 28 15:20:57.196192 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:57.196164    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr"
Jul 28 15:20:57.199428 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:20:57.199400    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr"
Jul 28 15:21:59.800650 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:21:59.800613    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr"]
Jul 28 15:21:59.801237 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:21:59.800867    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr" podUID="92201e19-d436-4ec9-a244-194e927a87b5" containerName="registry" containerID="cri-o://3992e260b2a94f3bd1163d4debded124d563eab110091790fdcd9b2efd8de691" gracePeriod=30
Jul 28 15:21:59.801237 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:21:59.801085    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr" podUID="92201e19-d436-4ec9-a244-194e927a87b5" containerName="ui" containerID="cri-o://403d55aae1fb044eed6a9495b2c14cd999c0fa00b98c072f367a94fcec216ff8" gracePeriod=30
Jul 28 15:21:59.801237 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:21:59.801115    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr" podUID="92201e19-d436-4ec9-a244-194e927a87b5" containerName="online" containerID="cri-o://0ee7910d54b8646629c2092e09ef7b21d6cc6c8bfd9d93d865fc7efbbd4f9df3" gracePeriod=30
Jul 28 15:21:59.801409 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:21:59.801255    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr" podUID="92201e19-d436-4ec9-a244-194e927a87b5" containerName="offline" containerID="cri-o://aba85f9118969356f27d477f1bbbe02697783106a8dc11194e14c8ff81ebe314" gracePeriod=30
Jul 28 15:22:00.115146 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:00.115111    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q"]
Jul 28 15:22:00.118950 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:00.118931    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q"
Jul 28 15:22:00.122088 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:00.122065    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-mx6q7\""
Jul 28 15:22:00.136365 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:00.136342    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q"]
Jul 28 15:22:00.220895 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:00.220861    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3a2403cf-252e-4348-a79f-5f3de545d15e-registry-tls\") pod \"feast-simple-feast-setup-55f4f9844b-g5g9q\" (UID: \"3a2403cf-252e-4348-a79f-5f3de545d15e\") " pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q"
Jul 28 15:22:00.220895 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:00.220906    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3a2403cf-252e-4348-a79f-5f3de545d15e-offline-tls\") pod \"feast-simple-feast-setup-55f4f9844b-g5g9q\" (UID: \"3a2403cf-252e-4348-a79f-5f3de545d15e\") " pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q"
Jul 28 15:22:00.221153 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:00.220947    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2m5j\" (UniqueName: \"kubernetes.io/projected/3a2403cf-252e-4348-a79f-5f3de545d15e-kube-api-access-r2m5j\") pod \"feast-simple-feast-setup-55f4f9844b-g5g9q\" (UID: \"3a2403cf-252e-4348-a79f-5f3de545d15e\") " pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q"
Jul 28 15:22:00.221153 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:00.220985    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3a2403cf-252e-4348-a79f-5f3de545d15e-feast-data\") pod \"feast-simple-feast-setup-55f4f9844b-g5g9q\" (UID: \"3a2403cf-252e-4348-a79f-5f3de545d15e\") " pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q"
Jul 28 15:22:00.221153 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:00.221015    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3a2403cf-252e-4348-a79f-5f3de545d15e-online-tls\") pod \"feast-simple-feast-setup-55f4f9844b-g5g9q\" (UID: \"3a2403cf-252e-4348-a79f-5f3de545d15e\") " pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q"
Jul 28 15:22:00.221153 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:00.221081    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3a2403cf-252e-4348-a79f-5f3de545d15e-ui-tls\") pod \"feast-simple-feast-setup-55f4f9844b-g5g9q\" (UID: \"3a2403cf-252e-4348-a79f-5f3de545d15e\") " pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q"
Jul 28 15:22:00.321793 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:00.321770    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3a2403cf-252e-4348-a79f-5f3de545d15e-registry-tls\") pod \"feast-simple-feast-setup-55f4f9844b-g5g9q\" (UID: \"3a2403cf-252e-4348-a79f-5f3de545d15e\") " pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q"
Jul 28 15:22:00.321930 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:00.321802    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3a2403cf-252e-4348-a79f-5f3de545d15e-offline-tls\") pod \"feast-simple-feast-setup-55f4f9844b-g5g9q\" (UID: \"3a2403cf-252e-4348-a79f-5f3de545d15e\") " pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q"
Jul 28 15:22:00.321930 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:00.321835    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2m5j\" (UniqueName: \"kubernetes.io/projected/3a2403cf-252e-4348-a79f-5f3de545d15e-kube-api-access-r2m5j\") pod \"feast-simple-feast-setup-55f4f9844b-g5g9q\" (UID: \"3a2403cf-252e-4348-a79f-5f3de545d15e\") " pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q"
Jul 28 15:22:00.321930 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:00.321869    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3a2403cf-252e-4348-a79f-5f3de545d15e-feast-data\") pod \"feast-simple-feast-setup-55f4f9844b-g5g9q\" (UID: \"3a2403cf-252e-4348-a79f-5f3de545d15e\") " pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q"
Jul 28 15:22:00.321930 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:00.321887    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3a2403cf-252e-4348-a79f-5f3de545d15e-online-tls\") pod \"feast-simple-feast-setup-55f4f9844b-g5g9q\" (UID: \"3a2403cf-252e-4348-a79f-5f3de545d15e\") " pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q"
Jul 28 15:22:00.322142 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:00.321946    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3a2403cf-252e-4348-a79f-5f3de545d15e-ui-tls\") pod \"feast-simple-feast-setup-55f4f9844b-g5g9q\" (UID: \"3a2403cf-252e-4348-a79f-5f3de545d15e\") " pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q"
Jul 28 15:22:00.322345 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:00.322323    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3a2403cf-252e-4348-a79f-5f3de545d15e-feast-data\") pod \"feast-simple-feast-setup-55f4f9844b-g5g9q\" (UID: \"3a2403cf-252e-4348-a79f-5f3de545d15e\") " pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q"
Jul 28 15:22:00.324299 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:00.324269    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3a2403cf-252e-4348-a79f-5f3de545d15e-offline-tls\") pod \"feast-simple-feast-setup-55f4f9844b-g5g9q\" (UID: \"3a2403cf-252e-4348-a79f-5f3de545d15e\") " pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q"
Jul 28 15:22:00.324434 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:00.324408    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3a2403cf-252e-4348-a79f-5f3de545d15e-online-tls\") pod \"feast-simple-feast-setup-55f4f9844b-g5g9q\" (UID: \"3a2403cf-252e-4348-a79f-5f3de545d15e\") " pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q"
Jul 28 15:22:00.324619 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:00.324599    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3a2403cf-252e-4348-a79f-5f3de545d15e-registry-tls\") pod \"feast-simple-feast-setup-55f4f9844b-g5g9q\" (UID: \"3a2403cf-252e-4348-a79f-5f3de545d15e\") " pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q"
Jul 28 15:22:00.324697 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:00.324675    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3a2403cf-252e-4348-a79f-5f3de545d15e-ui-tls\") pod \"feast-simple-feast-setup-55f4f9844b-g5g9q\" (UID: \"3a2403cf-252e-4348-a79f-5f3de545d15e\") " pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q"
Jul 28 15:22:00.331557 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:00.331530    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2m5j\" (UniqueName: \"kubernetes.io/projected/3a2403cf-252e-4348-a79f-5f3de545d15e-kube-api-access-r2m5j\") pod \"feast-simple-feast-setup-55f4f9844b-g5g9q\" (UID: \"3a2403cf-252e-4348-a79f-5f3de545d15e\") " pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q"
Jul 28 15:22:00.428975 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:00.428933    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q"
Jul 28 15:22:00.438895 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:00.438871    2561 generic.go:356] "Generic (PLEG): container finished" podID="92201e19-d436-4ec9-a244-194e927a87b5" containerID="403d55aae1fb044eed6a9495b2c14cd999c0fa00b98c072f367a94fcec216ff8" exitCode=0
Jul 28 15:22:00.438988 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:00.438915    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr" event={"ID":"92201e19-d436-4ec9-a244-194e927a87b5","Type":"ContainerDied","Data":"403d55aae1fb044eed6a9495b2c14cd999c0fa00b98c072f367a94fcec216ff8"}
Jul 28 15:22:00.584191 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:00.584110    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q"]
Jul 28 15:22:00.586400 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:22:00.586370    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3a2403cf_252e_4348_a79f_5f3de545d15e.slice/crio-b69bbbc35a38115c6b830a6a6f7ab81308291eddeabfb5da9ac5e6dfa360e681 WatchSource:0}: Error finding container b69bbbc35a38115c6b830a6a6f7ab81308291eddeabfb5da9ac5e6dfa360e681: Status 404 returned error can't find the container with id b69bbbc35a38115c6b830a6a6f7ab81308291eddeabfb5da9ac5e6dfa360e681
Jul 28 15:22:01.444315 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:01.444278    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q" event={"ID":"3a2403cf-252e-4348-a79f-5f3de545d15e","Type":"ContainerStarted","Data":"0e584bec682081265a2e341e06f24ad369eee35c849bd46b19b6448d816b9499"}
Jul 28 15:22:01.444759 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:01.444322    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q" event={"ID":"3a2403cf-252e-4348-a79f-5f3de545d15e","Type":"ContainerStarted","Data":"b69bbbc35a38115c6b830a6a6f7ab81308291eddeabfb5da9ac5e6dfa360e681"}
Jul 28 15:22:01.447428 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:01.447399    2561 generic.go:356] "Generic (PLEG): container finished" podID="92201e19-d436-4ec9-a244-194e927a87b5" containerID="0ee7910d54b8646629c2092e09ef7b21d6cc6c8bfd9d93d865fc7efbbd4f9df3" exitCode=0
Jul 28 15:22:01.447536 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:01.447462    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr" event={"ID":"92201e19-d436-4ec9-a244-194e927a87b5","Type":"ContainerDied","Data":"0ee7910d54b8646629c2092e09ef7b21d6cc6c8bfd9d93d865fc7efbbd4f9df3"}
Jul 28 15:22:05.464536 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:05.464497    2561 generic.go:356] "Generic (PLEG): container finished" podID="3a2403cf-252e-4348-a79f-5f3de545d15e" containerID="0e584bec682081265a2e341e06f24ad369eee35c849bd46b19b6448d816b9499" exitCode=0
Jul 28 15:22:05.464927 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:05.464554    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q" event={"ID":"3a2403cf-252e-4348-a79f-5f3de545d15e","Type":"ContainerDied","Data":"0e584bec682081265a2e341e06f24ad369eee35c849bd46b19b6448d816b9499"}
Jul 28 15:22:06.470724 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:06.470690    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q" event={"ID":"3a2403cf-252e-4348-a79f-5f3de545d15e","Type":"ContainerStarted","Data":"954428fc1abea41348708bbfbb34c13788ec413bd3d5795f3c1e4f0f7be2fba5"}
Jul 28 15:22:06.789334 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:06.789233    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr" podUID="92201e19-d436-4ec9-a244-194e927a87b5" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.22:8443: connect: connection refused"
Jul 28 15:22:07.196935 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:07.196889    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr" podUID="92201e19-d436-4ec9-a244-194e927a87b5" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused"
Jul 28 15:22:11.491681 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:11.491648    2561 generic.go:356] "Generic (PLEG): container finished" podID="3a2403cf-252e-4348-a79f-5f3de545d15e" containerID="954428fc1abea41348708bbfbb34c13788ec413bd3d5795f3c1e4f0f7be2fba5" exitCode=0
Jul 28 15:22:11.492073 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:11.491723    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q" event={"ID":"3a2403cf-252e-4348-a79f-5f3de545d15e","Type":"ContainerDied","Data":"954428fc1abea41348708bbfbb34c13788ec413bd3d5795f3c1e4f0f7be2fba5"}
Jul 28 15:22:12.501761 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:12.501722    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q" event={"ID":"3a2403cf-252e-4348-a79f-5f3de545d15e","Type":"ContainerStarted","Data":"d975a38d07e3c8dd4b0b40036ad6e215d1191c0ff20453743f5fe6038d1171e9"}
Jul 28 15:22:12.502252 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:12.501783    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q" event={"ID":"3a2403cf-252e-4348-a79f-5f3de545d15e","Type":"ContainerStarted","Data":"9ddb4c9458e4e4f2a1d6d549789826827853c4f27d3e04717d434463ab14c483"}
Jul 28 15:22:12.502252 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:12.501805    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q" event={"ID":"3a2403cf-252e-4348-a79f-5f3de545d15e","Type":"ContainerStarted","Data":"5408619a6c755b49c5696fdb356b5e179ed5499db3a02befe36028aa98e31400"}
Jul 28 15:22:12.502252 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:12.501844    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q" event={"ID":"3a2403cf-252e-4348-a79f-5f3de545d15e","Type":"ContainerStarted","Data":"9c35076389fda89afd0381f2cd00166f550979107f3429aa53b147f3b463bcf8"}
Jul 28 15:22:15.430163 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:15.430129    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q"
Jul 28 15:22:15.430630 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:15.430186    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q"
Jul 28 15:22:15.430630 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:15.430205    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q"
Jul 28 15:22:15.430630 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:15.430222    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q"
Jul 28 15:22:15.432735 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:15.432705    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q" podUID="3a2403cf-252e-4348-a79f-5f3de545d15e" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.23:8816: connect: connection refused"
Jul 28 15:22:15.433007 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:15.432726    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q" podUID="3a2403cf-252e-4348-a79f-5f3de545d15e" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.23:8443: connect: connection refused"
Jul 28 15:22:15.433098 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:15.432774    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q" podUID="3a2403cf-252e-4348-a79f-5f3de545d15e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused"
Jul 28 15:22:15.433098 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:15.432788    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q" podUID="3a2403cf-252e-4348-a79f-5f3de545d15e" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.23:6571: connect: connection refused"
Jul 28 15:22:16.789304 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:16.789264    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr" podUID="92201e19-d436-4ec9-a244-194e927a87b5" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.22:8443: connect: connection refused"
Jul 28 15:22:17.197509 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:17.197194    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr" podUID="92201e19-d436-4ec9-a244-194e927a87b5" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused"
Jul 28 15:22:18.430656 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:18.430540    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q"
Jul 28 15:22:18.431162 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:18.431134    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q"
Jul 28 15:22:18.431289 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:18.431179    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q"
Jul 28 15:22:18.431289 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:18.431287    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q"
Jul 28 15:22:18.431410 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:18.431390    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q"
Jul 28 15:22:18.435811 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:18.435792    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q"
Jul 28 15:22:18.459216 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:18.459174    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q" podStartSLOduration=18.459161363 podStartE2EDuration="18.459161363s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:22:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:22:12.536270193 +0000 UTC m=+493.586638300" watchObservedRunningTime="2026-07-28 15:22:18.459161363 +0000 UTC m=+499.509529449"
Jul 28 15:22:18.533493 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:18.533474    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q"
Jul 28 15:22:18.533614 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:18.533514    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q"
Jul 28 15:22:18.533614 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:18.533534    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q"
Jul 28 15:22:18.533890 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:18.533865    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q"
Jul 28 15:22:18.534001 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:18.533985    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q"
Jul 28 15:22:18.536476 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:18.536460    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q"
Jul 28 15:22:26.789786 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:26.789732    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr" podUID="92201e19-d436-4ec9-a244-194e927a87b5" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.22:8443: connect: connection refused"
Jul 28 15:22:26.790269 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:26.789924    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr"
Jul 28 15:22:27.197089 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:27.197049    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr" podUID="92201e19-d436-4ec9-a244-194e927a87b5" containerName="online" probeResult="failure" output="Get \"https://10.133.0.22:6567/health\": dial tcp 10.133.0.22:6567: connect: connection refused"
Jul 28 15:22:27.197253 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:27.197162    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr"
Jul 28 15:22:30.438745 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.438726    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr"
Jul 28 15:22:30.560696 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.560667    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/92201e19-d436-4ec9-a244-194e927a87b5-ui-tls\") pod \"92201e19-d436-4ec9-a244-194e927a87b5\" (UID: \"92201e19-d436-4ec9-a244-194e927a87b5\") "
Jul 28 15:22:30.560865 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.560704    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/92201e19-d436-4ec9-a244-194e927a87b5-offline-tls\") pod \"92201e19-d436-4ec9-a244-194e927a87b5\" (UID: \"92201e19-d436-4ec9-a244-194e927a87b5\") "
Jul 28 15:22:30.560865 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.560734    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cczkf\" (UniqueName: \"kubernetes.io/projected/92201e19-d436-4ec9-a244-194e927a87b5-kube-api-access-cczkf\") pod \"92201e19-d436-4ec9-a244-194e927a87b5\" (UID: \"92201e19-d436-4ec9-a244-194e927a87b5\") "
Jul 28 15:22:30.560865 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.560760    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/92201e19-d436-4ec9-a244-194e927a87b5-online-tls\") pod \"92201e19-d436-4ec9-a244-194e927a87b5\" (UID: \"92201e19-d436-4ec9-a244-194e927a87b5\") "
Jul 28 15:22:30.561012 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.560948    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/92201e19-d436-4ec9-a244-194e927a87b5-registry-tls\") pod \"92201e19-d436-4ec9-a244-194e927a87b5\" (UID: \"92201e19-d436-4ec9-a244-194e927a87b5\") "
Jul 28 15:22:30.561072 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.561036    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/92201e19-d436-4ec9-a244-194e927a87b5-feast-data\") pod \"92201e19-d436-4ec9-a244-194e927a87b5\" (UID: \"92201e19-d436-4ec9-a244-194e927a87b5\") "
Jul 28 15:22:30.561663 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.561628    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92201e19-d436-4ec9-a244-194e927a87b5-feast-data" (OuterVolumeSpecName: "feast-data") pod "92201e19-d436-4ec9-a244-194e927a87b5" (UID: "92201e19-d436-4ec9-a244-194e927a87b5"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 15:22:30.563042 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.563012    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92201e19-d436-4ec9-a244-194e927a87b5-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "92201e19-d436-4ec9-a244-194e927a87b5" (UID: "92201e19-d436-4ec9-a244-194e927a87b5"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 15:22:30.563042 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.563027    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92201e19-d436-4ec9-a244-194e927a87b5-kube-api-access-cczkf" (OuterVolumeSpecName: "kube-api-access-cczkf") pod "92201e19-d436-4ec9-a244-194e927a87b5" (UID: "92201e19-d436-4ec9-a244-194e927a87b5"). InnerVolumeSpecName "kube-api-access-cczkf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 15:22:30.563042 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.563029    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92201e19-d436-4ec9-a244-194e927a87b5-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "92201e19-d436-4ec9-a244-194e927a87b5" (UID: "92201e19-d436-4ec9-a244-194e927a87b5"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 15:22:30.563251 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.563144    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92201e19-d436-4ec9-a244-194e927a87b5-online-tls" (OuterVolumeSpecName: "online-tls") pod "92201e19-d436-4ec9-a244-194e927a87b5" (UID: "92201e19-d436-4ec9-a244-194e927a87b5"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 15:22:30.563251 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.563168    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/92201e19-d436-4ec9-a244-194e927a87b5-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "92201e19-d436-4ec9-a244-194e927a87b5" (UID: "92201e19-d436-4ec9-a244-194e927a87b5"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 15:22:30.580455 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.580432    2561 generic.go:356] "Generic (PLEG): container finished" podID="92201e19-d436-4ec9-a244-194e927a87b5" containerID="aba85f9118969356f27d477f1bbbe02697783106a8dc11194e14c8ff81ebe314" exitCode=137
Jul 28 15:22:30.580455 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.580453    2561 generic.go:356] "Generic (PLEG): container finished" podID="92201e19-d436-4ec9-a244-194e927a87b5" containerID="3992e260b2a94f3bd1163d4debded124d563eab110091790fdcd9b2efd8de691" exitCode=137
Jul 28 15:22:30.580632 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.580487    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr" event={"ID":"92201e19-d436-4ec9-a244-194e927a87b5","Type":"ContainerDied","Data":"aba85f9118969356f27d477f1bbbe02697783106a8dc11194e14c8ff81ebe314"}
Jul 28 15:22:30.580632 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.580520    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr" event={"ID":"92201e19-d436-4ec9-a244-194e927a87b5","Type":"ContainerDied","Data":"3992e260b2a94f3bd1163d4debded124d563eab110091790fdcd9b2efd8de691"}
Jul 28 15:22:30.580632 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.580524    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr"
Jul 28 15:22:30.580632 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.580533    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr" event={"ID":"92201e19-d436-4ec9-a244-194e927a87b5","Type":"ContainerDied","Data":"5fe8c49dafc9f8c6e35795c80f247fbcf1b29b5f47f8890d4b89b9f11fa940d0"}
Jul 28 15:22:30.580632 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.580551    2561 scope.go:117] "RemoveContainer" containerID="403d55aae1fb044eed6a9495b2c14cd999c0fa00b98c072f367a94fcec216ff8"
Jul 28 15:22:30.589414 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.589399    2561 scope.go:117] "RemoveContainer" containerID="aba85f9118969356f27d477f1bbbe02697783106a8dc11194e14c8ff81ebe314"
Jul 28 15:22:30.597066 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.597049    2561 scope.go:117] "RemoveContainer" containerID="0ee7910d54b8646629c2092e09ef7b21d6cc6c8bfd9d93d865fc7efbbd4f9df3"
Jul 28 15:22:30.604140 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.604127    2561 scope.go:117] "RemoveContainer" containerID="3992e260b2a94f3bd1163d4debded124d563eab110091790fdcd9b2efd8de691"
Jul 28 15:22:30.610896 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.610881    2561 scope.go:117] "RemoveContainer" containerID="4d999705456601911fe7a5b533b7467a6130e528de6c58ad05eddca059afa97a"
Jul 28 15:22:30.617428 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.617411    2561 scope.go:117] "RemoveContainer" containerID="2a9bd1a8305de74ea25f6c16e42b2124c50eb697e743a9ae1966f19ac95e9365"
Jul 28 15:22:30.624454 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.624441    2561 scope.go:117] "RemoveContainer" containerID="403d55aae1fb044eed6a9495b2c14cd999c0fa00b98c072f367a94fcec216ff8"
Jul 28 15:22:30.624700 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:22:30.624679    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"403d55aae1fb044eed6a9495b2c14cd999c0fa00b98c072f367a94fcec216ff8\": container with ID starting with 403d55aae1fb044eed6a9495b2c14cd999c0fa00b98c072f367a94fcec216ff8 not found: ID does not exist" containerID="403d55aae1fb044eed6a9495b2c14cd999c0fa00b98c072f367a94fcec216ff8"
Jul 28 15:22:30.624773 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.624711    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"403d55aae1fb044eed6a9495b2c14cd999c0fa00b98c072f367a94fcec216ff8"} err="failed to get container status \"403d55aae1fb044eed6a9495b2c14cd999c0fa00b98c072f367a94fcec216ff8\": rpc error: code = NotFound desc = could not find container \"403d55aae1fb044eed6a9495b2c14cd999c0fa00b98c072f367a94fcec216ff8\": container with ID starting with 403d55aae1fb044eed6a9495b2c14cd999c0fa00b98c072f367a94fcec216ff8 not found: ID does not exist"
Jul 28 15:22:30.624773 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.624750    2561 scope.go:117] "RemoveContainer" containerID="aba85f9118969356f27d477f1bbbe02697783106a8dc11194e14c8ff81ebe314"
Jul 28 15:22:30.624987 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:22:30.624971    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aba85f9118969356f27d477f1bbbe02697783106a8dc11194e14c8ff81ebe314\": container with ID starting with aba85f9118969356f27d477f1bbbe02697783106a8dc11194e14c8ff81ebe314 not found: ID does not exist" containerID="aba85f9118969356f27d477f1bbbe02697783106a8dc11194e14c8ff81ebe314"
Jul 28 15:22:30.625026 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.624992    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aba85f9118969356f27d477f1bbbe02697783106a8dc11194e14c8ff81ebe314"} err="failed to get container status \"aba85f9118969356f27d477f1bbbe02697783106a8dc11194e14c8ff81ebe314\": rpc error: code = NotFound desc = could not find container \"aba85f9118969356f27d477f1bbbe02697783106a8dc11194e14c8ff81ebe314\": container with ID starting with aba85f9118969356f27d477f1bbbe02697783106a8dc11194e14c8ff81ebe314 not found: ID does not exist"
Jul 28 15:22:30.625026 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.625008    2561 scope.go:117] "RemoveContainer" containerID="0ee7910d54b8646629c2092e09ef7b21d6cc6c8bfd9d93d865fc7efbbd4f9df3"
Jul 28 15:22:30.625238 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:22:30.625220    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ee7910d54b8646629c2092e09ef7b21d6cc6c8bfd9d93d865fc7efbbd4f9df3\": container with ID starting with 0ee7910d54b8646629c2092e09ef7b21d6cc6c8bfd9d93d865fc7efbbd4f9df3 not found: ID does not exist" containerID="0ee7910d54b8646629c2092e09ef7b21d6cc6c8bfd9d93d865fc7efbbd4f9df3"
Jul 28 15:22:30.625290 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.625246    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ee7910d54b8646629c2092e09ef7b21d6cc6c8bfd9d93d865fc7efbbd4f9df3"} err="failed to get container status \"0ee7910d54b8646629c2092e09ef7b21d6cc6c8bfd9d93d865fc7efbbd4f9df3\": rpc error: code = NotFound desc = could not find container \"0ee7910d54b8646629c2092e09ef7b21d6cc6c8bfd9d93d865fc7efbbd4f9df3\": container with ID starting with 0ee7910d54b8646629c2092e09ef7b21d6cc6c8bfd9d93d865fc7efbbd4f9df3 not found: ID does not exist"
Jul 28 15:22:30.625290 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.625262    2561 scope.go:117] "RemoveContainer" containerID="3992e260b2a94f3bd1163d4debded124d563eab110091790fdcd9b2efd8de691"
Jul 28 15:22:30.625483 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:22:30.625467    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3992e260b2a94f3bd1163d4debded124d563eab110091790fdcd9b2efd8de691\": container with ID starting with 3992e260b2a94f3bd1163d4debded124d563eab110091790fdcd9b2efd8de691 not found: ID does not exist" containerID="3992e260b2a94f3bd1163d4debded124d563eab110091790fdcd9b2efd8de691"
Jul 28 15:22:30.625524 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.625487    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3992e260b2a94f3bd1163d4debded124d563eab110091790fdcd9b2efd8de691"} err="failed to get container status \"3992e260b2a94f3bd1163d4debded124d563eab110091790fdcd9b2efd8de691\": rpc error: code = NotFound desc = could not find container \"3992e260b2a94f3bd1163d4debded124d563eab110091790fdcd9b2efd8de691\": container with ID starting with 3992e260b2a94f3bd1163d4debded124d563eab110091790fdcd9b2efd8de691 not found: ID does not exist"
Jul 28 15:22:30.625524 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.625505    2561 scope.go:117] "RemoveContainer" containerID="4d999705456601911fe7a5b533b7467a6130e528de6c58ad05eddca059afa97a"
Jul 28 15:22:30.625707 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:22:30.625694    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d999705456601911fe7a5b533b7467a6130e528de6c58ad05eddca059afa97a\": container with ID starting with 4d999705456601911fe7a5b533b7467a6130e528de6c58ad05eddca059afa97a not found: ID does not exist" containerID="4d999705456601911fe7a5b533b7467a6130e528de6c58ad05eddca059afa97a"
Jul 28 15:22:30.625744 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.625710    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d999705456601911fe7a5b533b7467a6130e528de6c58ad05eddca059afa97a"} err="failed to get container status \"4d999705456601911fe7a5b533b7467a6130e528de6c58ad05eddca059afa97a\": rpc error: code = NotFound desc = could not find container \"4d999705456601911fe7a5b533b7467a6130e528de6c58ad05eddca059afa97a\": container with ID starting with 4d999705456601911fe7a5b533b7467a6130e528de6c58ad05eddca059afa97a not found: ID does not exist"
Jul 28 15:22:30.625744 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.625724    2561 scope.go:117] "RemoveContainer" containerID="2a9bd1a8305de74ea25f6c16e42b2124c50eb697e743a9ae1966f19ac95e9365"
Jul 28 15:22:30.626015 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:22:30.625979    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a9bd1a8305de74ea25f6c16e42b2124c50eb697e743a9ae1966f19ac95e9365\": container with ID starting with 2a9bd1a8305de74ea25f6c16e42b2124c50eb697e743a9ae1966f19ac95e9365 not found: ID does not exist" containerID="2a9bd1a8305de74ea25f6c16e42b2124c50eb697e743a9ae1966f19ac95e9365"
Jul 28 15:22:30.626083 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.626021    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a9bd1a8305de74ea25f6c16e42b2124c50eb697e743a9ae1966f19ac95e9365"} err="failed to get container status \"2a9bd1a8305de74ea25f6c16e42b2124c50eb697e743a9ae1966f19ac95e9365\": rpc error: code = NotFound desc = could not find container \"2a9bd1a8305de74ea25f6c16e42b2124c50eb697e743a9ae1966f19ac95e9365\": container with ID starting with 2a9bd1a8305de74ea25f6c16e42b2124c50eb697e743a9ae1966f19ac95e9365 not found: ID does not exist"
Jul 28 15:22:30.626083 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.626045    2561 scope.go:117] "RemoveContainer" containerID="403d55aae1fb044eed6a9495b2c14cd999c0fa00b98c072f367a94fcec216ff8"
Jul 28 15:22:30.626322 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.626300    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"403d55aae1fb044eed6a9495b2c14cd999c0fa00b98c072f367a94fcec216ff8"} err="failed to get container status \"403d55aae1fb044eed6a9495b2c14cd999c0fa00b98c072f367a94fcec216ff8\": rpc error: code = NotFound desc = could not find container \"403d55aae1fb044eed6a9495b2c14cd999c0fa00b98c072f367a94fcec216ff8\": container with ID starting with 403d55aae1fb044eed6a9495b2c14cd999c0fa00b98c072f367a94fcec216ff8 not found: ID does not exist"
Jul 28 15:22:30.626378 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.626326    2561 scope.go:117] "RemoveContainer" containerID="aba85f9118969356f27d477f1bbbe02697783106a8dc11194e14c8ff81ebe314"
Jul 28 15:22:30.626589 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.626568    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aba85f9118969356f27d477f1bbbe02697783106a8dc11194e14c8ff81ebe314"} err="failed to get container status \"aba85f9118969356f27d477f1bbbe02697783106a8dc11194e14c8ff81ebe314\": rpc error: code = NotFound desc = could not find container \"aba85f9118969356f27d477f1bbbe02697783106a8dc11194e14c8ff81ebe314\": container with ID starting with aba85f9118969356f27d477f1bbbe02697783106a8dc11194e14c8ff81ebe314 not found: ID does not exist"
Jul 28 15:22:30.626589 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.626587    2561 scope.go:117] "RemoveContainer" containerID="0ee7910d54b8646629c2092e09ef7b21d6cc6c8bfd9d93d865fc7efbbd4f9df3"
Jul 28 15:22:30.626862 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.626843    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ee7910d54b8646629c2092e09ef7b21d6cc6c8bfd9d93d865fc7efbbd4f9df3"} err="failed to get container status \"0ee7910d54b8646629c2092e09ef7b21d6cc6c8bfd9d93d865fc7efbbd4f9df3\": rpc error: code = NotFound desc = could not find container \"0ee7910d54b8646629c2092e09ef7b21d6cc6c8bfd9d93d865fc7efbbd4f9df3\": container with ID starting with 0ee7910d54b8646629c2092e09ef7b21d6cc6c8bfd9d93d865fc7efbbd4f9df3 not found: ID does not exist"
Jul 28 15:22:30.626862 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.626862    2561 scope.go:117] "RemoveContainer" containerID="3992e260b2a94f3bd1163d4debded124d563eab110091790fdcd9b2efd8de691"
Jul 28 15:22:30.627136 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.627111    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3992e260b2a94f3bd1163d4debded124d563eab110091790fdcd9b2efd8de691"} err="failed to get container status \"3992e260b2a94f3bd1163d4debded124d563eab110091790fdcd9b2efd8de691\": rpc error: code = NotFound desc = could not find container \"3992e260b2a94f3bd1163d4debded124d563eab110091790fdcd9b2efd8de691\": container with ID starting with 3992e260b2a94f3bd1163d4debded124d563eab110091790fdcd9b2efd8de691 not found: ID does not exist"
Jul 28 15:22:30.627136 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.627136    2561 scope.go:117] "RemoveContainer" containerID="4d999705456601911fe7a5b533b7467a6130e528de6c58ad05eddca059afa97a"
Jul 28 15:22:30.627415 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.627393    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d999705456601911fe7a5b533b7467a6130e528de6c58ad05eddca059afa97a"} err="failed to get container status \"4d999705456601911fe7a5b533b7467a6130e528de6c58ad05eddca059afa97a\": rpc error: code = NotFound desc = could not find container \"4d999705456601911fe7a5b533b7467a6130e528de6c58ad05eddca059afa97a\": container with ID starting with 4d999705456601911fe7a5b533b7467a6130e528de6c58ad05eddca059afa97a not found: ID does not exist"
Jul 28 15:22:30.627499 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.627416    2561 scope.go:117] "RemoveContainer" containerID="2a9bd1a8305de74ea25f6c16e42b2124c50eb697e743a9ae1966f19ac95e9365"
Jul 28 15:22:30.627686 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.627669    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a9bd1a8305de74ea25f6c16e42b2124c50eb697e743a9ae1966f19ac95e9365"} err="failed to get container status \"2a9bd1a8305de74ea25f6c16e42b2124c50eb697e743a9ae1966f19ac95e9365\": rpc error: code = NotFound desc = could not find container \"2a9bd1a8305de74ea25f6c16e42b2124c50eb697e743a9ae1966f19ac95e9365\": container with ID starting with 2a9bd1a8305de74ea25f6c16e42b2124c50eb697e743a9ae1966f19ac95e9365 not found: ID does not exist"
Jul 28 15:22:30.633885 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.633868    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr"]
Jul 28 15:22:30.639137 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.639119    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-55f4f9844b-nx4vr"]
Jul 28 15:22:30.662101 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.662081    2561 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/92201e19-d436-4ec9-a244-194e927a87b5-feast-data\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:22:30.662101 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.662098    2561 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/92201e19-d436-4ec9-a244-194e927a87b5-ui-tls\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:22:30.662220 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.662106    2561 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/92201e19-d436-4ec9-a244-194e927a87b5-offline-tls\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:22:30.662220 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.662115    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cczkf\" (UniqueName: \"kubernetes.io/projected/92201e19-d436-4ec9-a244-194e927a87b5-kube-api-access-cczkf\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:22:30.662220 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.662123    2561 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/92201e19-d436-4ec9-a244-194e927a87b5-online-tls\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:22:30.662220 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:30.662131    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/92201e19-d436-4ec9-a244-194e927a87b5-registry-tls\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:22:31.409573 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:22:31.409538    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92201e19-d436-4ec9-a244-194e927a87b5" path="/var/lib/kubelet/pods/92201e19-d436-4ec9-a244-194e927a87b5/volumes"
Jul 28 15:23:21.886278 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:21.886245    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss"]
Jul 28 15:23:21.886888 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:21.886648    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92201e19-d436-4ec9-a244-194e927a87b5" containerName="online"
Jul 28 15:23:21.886888 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:21.886664    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="92201e19-d436-4ec9-a244-194e927a87b5" containerName="online"
Jul 28 15:23:21.886888 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:21.886688    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92201e19-d436-4ec9-a244-194e927a87b5" containerName="feast-init"
Jul 28 15:23:21.886888 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:21.886695    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="92201e19-d436-4ec9-a244-194e927a87b5" containerName="feast-init"
Jul 28 15:23:21.886888 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:21.886712    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92201e19-d436-4ec9-a244-194e927a87b5" containerName="feast-apply"
Jul 28 15:23:21.886888 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:21.886721    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="92201e19-d436-4ec9-a244-194e927a87b5" containerName="feast-apply"
Jul 28 15:23:21.886888 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:21.886738    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92201e19-d436-4ec9-a244-194e927a87b5" containerName="ui"
Jul 28 15:23:21.886888 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:21.886746    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="92201e19-d436-4ec9-a244-194e927a87b5" containerName="ui"
Jul 28 15:23:21.886888 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:21.886763    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92201e19-d436-4ec9-a244-194e927a87b5" containerName="registry"
Jul 28 15:23:21.886888 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:21.886771    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="92201e19-d436-4ec9-a244-194e927a87b5" containerName="registry"
Jul 28 15:23:21.886888 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:21.886780    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92201e19-d436-4ec9-a244-194e927a87b5" containerName="offline"
Jul 28 15:23:21.886888 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:21.886788    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="92201e19-d436-4ec9-a244-194e927a87b5" containerName="offline"
Jul 28 15:23:21.887495 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:21.886904    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="92201e19-d436-4ec9-a244-194e927a87b5" containerName="offline"
Jul 28 15:23:21.887495 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:21.886919    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="92201e19-d436-4ec9-a244-194e927a87b5" containerName="registry"
Jul 28 15:23:21.887495 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:21.886926    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="92201e19-d436-4ec9-a244-194e927a87b5" containerName="online"
Jul 28 15:23:21.887495 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:21.886935    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="92201e19-d436-4ec9-a244-194e927a87b5" containerName="ui"
Jul 28 15:23:21.891502 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:21.891481    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss"
Jul 28 15:23:21.894871 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:21.894816    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Jul 28 15:23:21.894986 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:21.894873    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Jul 28 15:23:21.895235 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:21.895220    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Jul 28 15:23:21.895331 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:21.895244    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-intra-comm\""
Jul 28 15:23:21.895331 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:21.895299    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Jul 28 15:23:21.895619 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:21.895605    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Jul 28 15:23:21.895690 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:21.895637    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Jul 28 15:23:21.895743 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:21.895637    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-4cf9l\""
Jul 28 15:23:21.903020 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:21.903002    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss"]
Jul 28 15:23:21.937554 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:21.937520    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e2835d86-40fd-4a9b-941b-515a4e2c7d09-offline-tls\") pod \"feast-simple-feast-remote-setup-857f854cf6-dj5ss\" (UID: \"e2835d86-40fd-4a9b-941b-515a4e2c7d09\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss"
Jul 28 15:23:21.937554 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:21.937561    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/e2835d86-40fd-4a9b-941b-515a4e2c7d09-registry-tls\") pod \"feast-simple-feast-remote-setup-857f854cf6-dj5ss\" (UID: \"e2835d86-40fd-4a9b-941b-515a4e2c7d09\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss"
Jul 28 15:23:21.937747 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:21.937589    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e2835d86-40fd-4a9b-941b-515a4e2c7d09-feast-data\") pod \"feast-simple-feast-remote-setup-857f854cf6-dj5ss\" (UID: \"e2835d86-40fd-4a9b-941b-515a4e2c7d09\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss"
Jul 28 15:23:21.937747 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:21.937673    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e2835d86-40fd-4a9b-941b-515a4e2c7d09-ui-tls\") pod \"feast-simple-feast-remote-setup-857f854cf6-dj5ss\" (UID: \"e2835d86-40fd-4a9b-941b-515a4e2c7d09\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss"
Jul 28 15:23:21.937747 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:21.937699    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cp7bb\" (UniqueName: \"kubernetes.io/projected/e2835d86-40fd-4a9b-941b-515a4e2c7d09-kube-api-access-cp7bb\") pod \"feast-simple-feast-remote-setup-857f854cf6-dj5ss\" (UID: \"e2835d86-40fd-4a9b-941b-515a4e2c7d09\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss"
Jul 28 15:23:21.937747 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:21.937726    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e2835d86-40fd-4a9b-941b-515a4e2c7d09-online-tls\") pod \"feast-simple-feast-remote-setup-857f854cf6-dj5ss\" (UID: \"e2835d86-40fd-4a9b-941b-515a4e2c7d09\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss"
Jul 28 15:23:22.038382 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:22.038348    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cp7bb\" (UniqueName: \"kubernetes.io/projected/e2835d86-40fd-4a9b-941b-515a4e2c7d09-kube-api-access-cp7bb\") pod \"feast-simple-feast-remote-setup-857f854cf6-dj5ss\" (UID: \"e2835d86-40fd-4a9b-941b-515a4e2c7d09\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss"
Jul 28 15:23:22.038382 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:22.038386    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e2835d86-40fd-4a9b-941b-515a4e2c7d09-online-tls\") pod \"feast-simple-feast-remote-setup-857f854cf6-dj5ss\" (UID: \"e2835d86-40fd-4a9b-941b-515a4e2c7d09\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss"
Jul 28 15:23:22.038596 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:22.038436    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e2835d86-40fd-4a9b-941b-515a4e2c7d09-offline-tls\") pod \"feast-simple-feast-remote-setup-857f854cf6-dj5ss\" (UID: \"e2835d86-40fd-4a9b-941b-515a4e2c7d09\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss"
Jul 28 15:23:22.038596 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:23:22.038529    2561 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-offline-tls: secret "feast-simple-feast-remote-setup-offline-tls" not found
Jul 28 15:23:22.038596 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:23:22.038587    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2835d86-40fd-4a9b-941b-515a4e2c7d09-offline-tls podName:e2835d86-40fd-4a9b-941b-515a4e2c7d09 nodeName:}" failed. No retries permitted until 2026-07-28 15:23:22.538568484 +0000 UTC m=+563.588936569 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/e2835d86-40fd-4a9b-941b-515a4e2c7d09-offline-tls") pod "feast-simple-feast-remote-setup-857f854cf6-dj5ss" (UID: "e2835d86-40fd-4a9b-941b-515a4e2c7d09") : secret "feast-simple-feast-remote-setup-offline-tls" not found
Jul 28 15:23:22.038715 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:22.038605    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/e2835d86-40fd-4a9b-941b-515a4e2c7d09-registry-tls\") pod \"feast-simple-feast-remote-setup-857f854cf6-dj5ss\" (UID: \"e2835d86-40fd-4a9b-941b-515a4e2c7d09\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss"
Jul 28 15:23:22.038715 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:22.038659    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e2835d86-40fd-4a9b-941b-515a4e2c7d09-feast-data\") pod \"feast-simple-feast-remote-setup-857f854cf6-dj5ss\" (UID: \"e2835d86-40fd-4a9b-941b-515a4e2c7d09\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss"
Jul 28 15:23:22.038793 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:22.038715    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e2835d86-40fd-4a9b-941b-515a4e2c7d09-ui-tls\") pod \"feast-simple-feast-remote-setup-857f854cf6-dj5ss\" (UID: \"e2835d86-40fd-4a9b-941b-515a4e2c7d09\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss"
Jul 28 15:23:22.039078 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:22.039050    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e2835d86-40fd-4a9b-941b-515a4e2c7d09-feast-data\") pod \"feast-simple-feast-remote-setup-857f854cf6-dj5ss\" (UID: \"e2835d86-40fd-4a9b-941b-515a4e2c7d09\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss"
Jul 28 15:23:22.039308 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:22.039291    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/e2835d86-40fd-4a9b-941b-515a4e2c7d09-registry-tls\") pod \"feast-simple-feast-remote-setup-857f854cf6-dj5ss\" (UID: \"e2835d86-40fd-4a9b-941b-515a4e2c7d09\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss"
Jul 28 15:23:22.040916 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:22.040891    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e2835d86-40fd-4a9b-941b-515a4e2c7d09-online-tls\") pod \"feast-simple-feast-remote-setup-857f854cf6-dj5ss\" (UID: \"e2835d86-40fd-4a9b-941b-515a4e2c7d09\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss"
Jul 28 15:23:22.041007 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:22.040994    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e2835d86-40fd-4a9b-941b-515a4e2c7d09-ui-tls\") pod \"feast-simple-feast-remote-setup-857f854cf6-dj5ss\" (UID: \"e2835d86-40fd-4a9b-941b-515a4e2c7d09\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss"
Jul 28 15:23:22.052335 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:22.052315    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cp7bb\" (UniqueName: \"kubernetes.io/projected/e2835d86-40fd-4a9b-941b-515a4e2c7d09-kube-api-access-cp7bb\") pod \"feast-simple-feast-remote-setup-857f854cf6-dj5ss\" (UID: \"e2835d86-40fd-4a9b-941b-515a4e2c7d09\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss"
Jul 28 15:23:22.543099 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:22.543069    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e2835d86-40fd-4a9b-941b-515a4e2c7d09-offline-tls\") pod \"feast-simple-feast-remote-setup-857f854cf6-dj5ss\" (UID: \"e2835d86-40fd-4a9b-941b-515a4e2c7d09\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss"
Jul 28 15:23:22.545314 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:22.545280    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e2835d86-40fd-4a9b-941b-515a4e2c7d09-offline-tls\") pod \"feast-simple-feast-remote-setup-857f854cf6-dj5ss\" (UID: \"e2835d86-40fd-4a9b-941b-515a4e2c7d09\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss"
Jul 28 15:23:22.800976 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:22.800891    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss"
Jul 28 15:23:22.936640 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:22.936616    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss"]
Jul 28 15:23:22.937861 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:23:22.937819    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode2835d86_40fd_4a9b_941b_515a4e2c7d09.slice/crio-ed30314526ac298c5952aada14e9fa7635f0f05e275a632830f087c093c058c8 WatchSource:0}: Error finding container ed30314526ac298c5952aada14e9fa7635f0f05e275a632830f087c093c058c8: Status 404 returned error can't find the container with id ed30314526ac298c5952aada14e9fa7635f0f05e275a632830f087c093c058c8
Jul 28 15:23:23.780214 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:23.780173    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss" event={"ID":"e2835d86-40fd-4a9b-941b-515a4e2c7d09","Type":"ContainerStarted","Data":"3326a09f7abdba1227b387f1c9cee9a5c3c8b701d73841a44e0ca553b03ee200"}
Jul 28 15:23:23.780377 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:23.780231    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss" event={"ID":"e2835d86-40fd-4a9b-941b-515a4e2c7d09","Type":"ContainerStarted","Data":"ed30314526ac298c5952aada14e9fa7635f0f05e275a632830f087c093c058c8"}
Jul 28 15:23:27.797251 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:27.797220    2561 generic.go:356] "Generic (PLEG): container finished" podID="e2835d86-40fd-4a9b-941b-515a4e2c7d09" containerID="3326a09f7abdba1227b387f1c9cee9a5c3c8b701d73841a44e0ca553b03ee200" exitCode=0
Jul 28 15:23:27.797588 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:27.797279    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss" event={"ID":"e2835d86-40fd-4a9b-941b-515a4e2c7d09","Type":"ContainerDied","Data":"3326a09f7abdba1227b387f1c9cee9a5c3c8b701d73841a44e0ca553b03ee200"}
Jul 28 15:23:28.802664 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:28.802631    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss" event={"ID":"e2835d86-40fd-4a9b-941b-515a4e2c7d09","Type":"ContainerStarted","Data":"d46728d0f9bccd1a4b25c4621ab5cc4bdf15af0344c57997a210e3d076aa42d4"}
Jul 28 15:23:33.824892 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:33.824856    2561 generic.go:356] "Generic (PLEG): container finished" podID="e2835d86-40fd-4a9b-941b-515a4e2c7d09" containerID="d46728d0f9bccd1a4b25c4621ab5cc4bdf15af0344c57997a210e3d076aa42d4" exitCode=0
Jul 28 15:23:33.825266 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:33.824927    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss" event={"ID":"e2835d86-40fd-4a9b-941b-515a4e2c7d09","Type":"ContainerDied","Data":"d46728d0f9bccd1a4b25c4621ab5cc4bdf15af0344c57997a210e3d076aa42d4"}
Jul 28 15:23:34.834280 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:34.834239    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss" event={"ID":"e2835d86-40fd-4a9b-941b-515a4e2c7d09","Type":"ContainerStarted","Data":"72d6494f5f896f979f0d2627873682a1aa4352755f961ce06548857da13bb79b"}
Jul 28 15:23:34.834776 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:34.834296    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss" event={"ID":"e2835d86-40fd-4a9b-941b-515a4e2c7d09","Type":"ContainerStarted","Data":"4eb51aa2cedb2df1f8bc0626c21de4c2a8a926e98cfb7375c4862b160dbd5442"}
Jul 28 15:23:34.834776 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:34.834317    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss" event={"ID":"e2835d86-40fd-4a9b-941b-515a4e2c7d09","Type":"ContainerStarted","Data":"95f4a72aa93b831a286529979b684dd9e7fa77bbb1d7fd45dc814589f2fdbe8b"}
Jul 28 15:23:34.866304 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:34.866242    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss" podStartSLOduration=13.866223825 podStartE2EDuration="13.866223825s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:23:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:23:34.865050094 +0000 UTC m=+575.915418221" watchObservedRunningTime="2026-07-28 15:23:34.866223825 +0000 UTC m=+575.916591929"
Jul 28 15:23:37.801531 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:37.801490    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss"
Jul 28 15:23:37.801929 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:37.801553    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss"
Jul 28 15:23:37.801929 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:37.801573    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss"
Jul 28 15:23:37.803449 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:37.803407    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss" podUID="e2835d86-40fd-4a9b-941b-515a4e2c7d09" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.24:8816: connect: connection refused"
Jul 28 15:23:37.803584 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:37.803456    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss" podUID="e2835d86-40fd-4a9b-941b-515a4e2c7d09" containerName="online" probeResult="failure" output="Get \"https://10.133.0.24:6567/health\": dial tcp 10.133.0.24:6567: connect: connection refused"
Jul 28 15:23:37.803584 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:37.803418    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss" podUID="e2835d86-40fd-4a9b-941b-515a4e2c7d09" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.24:8443: connect: connection refused"
Jul 28 15:23:40.802001 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:40.801922    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss"
Jul 28 15:23:40.802432 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:40.802037    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss"
Jul 28 15:23:40.802432 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:40.802324    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss"
Jul 28 15:23:40.802432 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:40.802385    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss"
Jul 28 15:23:40.802689 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:40.802672    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss"
Jul 28 15:23:40.802779 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:40.802765    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss"
Jul 28 15:23:40.808385 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:40.808365    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss"
Jul 28 15:23:40.859680 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:40.859659    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss"
Jul 28 15:23:40.863789 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:23:40.863771    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss"
Jul 28 15:24:43.517186 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:24:43.517155    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss"]
Jul 28 15:24:43.517925 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:24:43.517371    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss" podUID="e2835d86-40fd-4a9b-941b-515a4e2c7d09" containerName="online" containerID="cri-o://95f4a72aa93b831a286529979b684dd9e7fa77bbb1d7fd45dc814589f2fdbe8b" gracePeriod=30
Jul 28 15:24:43.517925 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:24:43.517423    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss" podUID="e2835d86-40fd-4a9b-941b-515a4e2c7d09" containerName="offline" containerID="cri-o://4eb51aa2cedb2df1f8bc0626c21de4c2a8a926e98cfb7375c4862b160dbd5442" gracePeriod=30
Jul 28 15:24:43.517925 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:24:43.517415    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss" podUID="e2835d86-40fd-4a9b-941b-515a4e2c7d09" containerName="ui" containerID="cri-o://72d6494f5f896f979f0d2627873682a1aa4352755f961ce06548857da13bb79b" gracePeriod=30
Jul 28 15:24:43.761995 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:24:43.761963    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q"]
Jul 28 15:24:43.762223 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:24:43.762199    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q" podUID="3a2403cf-252e-4348-a79f-5f3de545d15e" containerName="registry" containerID="cri-o://9c35076389fda89afd0381f2cd00166f550979107f3429aa53b147f3b463bcf8" gracePeriod=30
Jul 28 15:24:43.762302 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:24:43.762249    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q" podUID="3a2403cf-252e-4348-a79f-5f3de545d15e" containerName="ui" containerID="cri-o://d975a38d07e3c8dd4b0b40036ad6e215d1191c0ff20453743f5fe6038d1171e9" gracePeriod=30
Jul 28 15:24:43.762302 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:24:43.762255    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q" podUID="3a2403cf-252e-4348-a79f-5f3de545d15e" containerName="online" containerID="cri-o://5408619a6c755b49c5696fdb356b5e179ed5499db3a02befe36028aa98e31400" gracePeriod=30
Jul 28 15:24:43.762404 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:24:43.762247    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q" podUID="3a2403cf-252e-4348-a79f-5f3de545d15e" containerName="offline" containerID="cri-o://9ddb4c9458e4e4f2a1d6d549789826827853c4f27d3e04717d434463ab14c483" gracePeriod=30
Jul 28 15:24:45.106211 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:24:45.106179    2561 generic.go:356] "Generic (PLEG): container finished" podID="3a2403cf-252e-4348-a79f-5f3de545d15e" containerID="d975a38d07e3c8dd4b0b40036ad6e215d1191c0ff20453743f5fe6038d1171e9" exitCode=0
Jul 28 15:24:45.106211 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:24:45.106202    2561 generic.go:356] "Generic (PLEG): container finished" podID="3a2403cf-252e-4348-a79f-5f3de545d15e" containerID="5408619a6c755b49c5696fdb356b5e179ed5499db3a02befe36028aa98e31400" exitCode=0
Jul 28 15:24:45.106671 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:24:45.106251    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q" event={"ID":"3a2403cf-252e-4348-a79f-5f3de545d15e","Type":"ContainerDied","Data":"d975a38d07e3c8dd4b0b40036ad6e215d1191c0ff20453743f5fe6038d1171e9"}
Jul 28 15:24:45.106671 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:24:45.106294    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q" event={"ID":"3a2403cf-252e-4348-a79f-5f3de545d15e","Type":"ContainerDied","Data":"5408619a6c755b49c5696fdb356b5e179ed5499db3a02befe36028aa98e31400"}
Jul 28 15:24:45.108684 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:24:45.108663    2561 generic.go:356] "Generic (PLEG): container finished" podID="e2835d86-40fd-4a9b-941b-515a4e2c7d09" containerID="72d6494f5f896f979f0d2627873682a1aa4352755f961ce06548857da13bb79b" exitCode=0
Jul 28 15:24:45.108684 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:24:45.108680    2561 generic.go:356] "Generic (PLEG): container finished" podID="e2835d86-40fd-4a9b-941b-515a4e2c7d09" containerID="95f4a72aa93b831a286529979b684dd9e7fa77bbb1d7fd45dc814589f2fdbe8b" exitCode=0
Jul 28 15:24:45.108843 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:24:45.108735    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss" event={"ID":"e2835d86-40fd-4a9b-941b-515a4e2c7d09","Type":"ContainerDied","Data":"72d6494f5f896f979f0d2627873682a1aa4352755f961ce06548857da13bb79b"}
Jul 28 15:24:45.108843 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:24:45.108766    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss" event={"ID":"e2835d86-40fd-4a9b-941b-515a4e2c7d09","Type":"ContainerDied","Data":"95f4a72aa93b831a286529979b684dd9e7fa77bbb1d7fd45dc814589f2fdbe8b"}
Jul 28 15:24:48.534328 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:24:48.534293    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q" podUID="3a2403cf-252e-4348-a79f-5f3de545d15e" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.23:8443: connect: connection refused"
Jul 28 15:24:48.534725 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:24:48.534327    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q" podUID="3a2403cf-252e-4348-a79f-5f3de545d15e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused"
Jul 28 15:24:50.803209 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:24:50.803163    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss" podUID="e2835d86-40fd-4a9b-941b-515a4e2c7d09" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.24:8443: connect: connection refused"
Jul 28 15:24:50.859811 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:24:50.859771    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss" podUID="e2835d86-40fd-4a9b-941b-515a4e2c7d09" containerName="online" probeResult="failure" output="Get \"https://10.133.0.24:6567/health\": dial tcp 10.133.0.24:6567: connect: connection refused"
Jul 28 15:24:58.534079 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:24:58.534025    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q" podUID="3a2403cf-252e-4348-a79f-5f3de545d15e" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.23:8443: connect: connection refused"
Jul 28 15:24:58.534502 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:24:58.534047    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q" podUID="3a2403cf-252e-4348-a79f-5f3de545d15e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused"
Jul 28 15:25:00.802864 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:00.802799    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss" podUID="e2835d86-40fd-4a9b-941b-515a4e2c7d09" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.24:8443: connect: connection refused"
Jul 28 15:25:00.859838 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:00.859790    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss" podUID="e2835d86-40fd-4a9b-941b-515a4e2c7d09" containerName="online" probeResult="failure" output="Get \"https://10.133.0.24:6567/health\": dial tcp 10.133.0.24:6567: connect: connection refused"
Jul 28 15:25:08.533714 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:08.533664    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q" podUID="3a2403cf-252e-4348-a79f-5f3de545d15e" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.23:8443: connect: connection refused"
Jul 28 15:25:08.533714 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:08.533709    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q" podUID="3a2403cf-252e-4348-a79f-5f3de545d15e" containerName="online" probeResult="failure" output="Get \"https://10.133.0.23:6567/health\": dial tcp 10.133.0.23:6567: connect: connection refused"
Jul 28 15:25:08.534263 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:08.533806    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q"
Jul 28 15:25:08.534263 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:08.533904    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q"
Jul 28 15:25:10.802903 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:10.802864    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss" podUID="e2835d86-40fd-4a9b-941b-515a4e2c7d09" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.24:8443: connect: connection refused"
Jul 28 15:25:10.803327 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:10.803010    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss"
Jul 28 15:25:10.860007 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:10.859951    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss" podUID="e2835d86-40fd-4a9b-941b-515a4e2c7d09" containerName="online" probeResult="failure" output="Get \"https://10.133.0.24:6567/health\": dial tcp 10.133.0.24:6567: connect: connection refused"
Jul 28 15:25:10.860165 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:10.860085    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss"
Jul 28 15:25:14.168045 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.168018    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss"
Jul 28 15:25:14.221328 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.221302    2561 generic.go:356] "Generic (PLEG): container finished" podID="3a2403cf-252e-4348-a79f-5f3de545d15e" containerID="9ddb4c9458e4e4f2a1d6d549789826827853c4f27d3e04717d434463ab14c483" exitCode=137
Jul 28 15:25:14.221328 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.221326    2561 generic.go:356] "Generic (PLEG): container finished" podID="3a2403cf-252e-4348-a79f-5f3de545d15e" containerID="9c35076389fda89afd0381f2cd00166f550979107f3429aa53b147f3b463bcf8" exitCode=137
Jul 28 15:25:14.221508 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.221368    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q" event={"ID":"3a2403cf-252e-4348-a79f-5f3de545d15e","Type":"ContainerDied","Data":"9ddb4c9458e4e4f2a1d6d549789826827853c4f27d3e04717d434463ab14c483"}
Jul 28 15:25:14.221508 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.221402    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q" event={"ID":"3a2403cf-252e-4348-a79f-5f3de545d15e","Type":"ContainerDied","Data":"9c35076389fda89afd0381f2cd00166f550979107f3429aa53b147f3b463bcf8"}
Jul 28 15:25:14.223735 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.223715    2561 generic.go:356] "Generic (PLEG): container finished" podID="e2835d86-40fd-4a9b-941b-515a4e2c7d09" containerID="4eb51aa2cedb2df1f8bc0626c21de4c2a8a926e98cfb7375c4862b160dbd5442" exitCode=137
Jul 28 15:25:14.223818 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.223755    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss" event={"ID":"e2835d86-40fd-4a9b-941b-515a4e2c7d09","Type":"ContainerDied","Data":"4eb51aa2cedb2df1f8bc0626c21de4c2a8a926e98cfb7375c4862b160dbd5442"}
Jul 28 15:25:14.223818 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.223774    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss"
Jul 28 15:25:14.223818 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.223778    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss" event={"ID":"e2835d86-40fd-4a9b-941b-515a4e2c7d09","Type":"ContainerDied","Data":"ed30314526ac298c5952aada14e9fa7635f0f05e275a632830f087c093c058c8"}
Jul 28 15:25:14.223818 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.223797    2561 scope.go:117] "RemoveContainer" containerID="72d6494f5f896f979f0d2627873682a1aa4352755f961ce06548857da13bb79b"
Jul 28 15:25:14.232203 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.232184    2561 scope.go:117] "RemoveContainer" containerID="4eb51aa2cedb2df1f8bc0626c21de4c2a8a926e98cfb7375c4862b160dbd5442"
Jul 28 15:25:14.239467 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.239452    2561 scope.go:117] "RemoveContainer" containerID="95f4a72aa93b831a286529979b684dd9e7fa77bbb1d7fd45dc814589f2fdbe8b"
Jul 28 15:25:14.246501 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.246488    2561 scope.go:117] "RemoveContainer" containerID="d46728d0f9bccd1a4b25c4621ab5cc4bdf15af0344c57997a210e3d076aa42d4"
Jul 28 15:25:14.253178 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.253162    2561 scope.go:117] "RemoveContainer" containerID="3326a09f7abdba1227b387f1c9cee9a5c3c8b701d73841a44e0ca553b03ee200"
Jul 28 15:25:14.259628 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.259610    2561 scope.go:117] "RemoveContainer" containerID="72d6494f5f896f979f0d2627873682a1aa4352755f961ce06548857da13bb79b"
Jul 28 15:25:14.259863 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:25:14.259845    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72d6494f5f896f979f0d2627873682a1aa4352755f961ce06548857da13bb79b\": container with ID starting with 72d6494f5f896f979f0d2627873682a1aa4352755f961ce06548857da13bb79b not found: ID does not exist" containerID="72d6494f5f896f979f0d2627873682a1aa4352755f961ce06548857da13bb79b"
Jul 28 15:25:14.259956 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.259877    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72d6494f5f896f979f0d2627873682a1aa4352755f961ce06548857da13bb79b"} err="failed to get container status \"72d6494f5f896f979f0d2627873682a1aa4352755f961ce06548857da13bb79b\": rpc error: code = NotFound desc = could not find container \"72d6494f5f896f979f0d2627873682a1aa4352755f961ce06548857da13bb79b\": container with ID starting with 72d6494f5f896f979f0d2627873682a1aa4352755f961ce06548857da13bb79b not found: ID does not exist"
Jul 28 15:25:14.259956 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.259900    2561 scope.go:117] "RemoveContainer" containerID="4eb51aa2cedb2df1f8bc0626c21de4c2a8a926e98cfb7375c4862b160dbd5442"
Jul 28 15:25:14.260185 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:25:14.260168    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4eb51aa2cedb2df1f8bc0626c21de4c2a8a926e98cfb7375c4862b160dbd5442\": container with ID starting with 4eb51aa2cedb2df1f8bc0626c21de4c2a8a926e98cfb7375c4862b160dbd5442 not found: ID does not exist" containerID="4eb51aa2cedb2df1f8bc0626c21de4c2a8a926e98cfb7375c4862b160dbd5442"
Jul 28 15:25:14.260223 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.260190    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4eb51aa2cedb2df1f8bc0626c21de4c2a8a926e98cfb7375c4862b160dbd5442"} err="failed to get container status \"4eb51aa2cedb2df1f8bc0626c21de4c2a8a926e98cfb7375c4862b160dbd5442\": rpc error: code = NotFound desc = could not find container \"4eb51aa2cedb2df1f8bc0626c21de4c2a8a926e98cfb7375c4862b160dbd5442\": container with ID starting with 4eb51aa2cedb2df1f8bc0626c21de4c2a8a926e98cfb7375c4862b160dbd5442 not found: ID does not exist"
Jul 28 15:25:14.260223 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.260204    2561 scope.go:117] "RemoveContainer" containerID="95f4a72aa93b831a286529979b684dd9e7fa77bbb1d7fd45dc814589f2fdbe8b"
Jul 28 15:25:14.260426 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:25:14.260413    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95f4a72aa93b831a286529979b684dd9e7fa77bbb1d7fd45dc814589f2fdbe8b\": container with ID starting with 95f4a72aa93b831a286529979b684dd9e7fa77bbb1d7fd45dc814589f2fdbe8b not found: ID does not exist" containerID="95f4a72aa93b831a286529979b684dd9e7fa77bbb1d7fd45dc814589f2fdbe8b"
Jul 28 15:25:14.260469 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.260429    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95f4a72aa93b831a286529979b684dd9e7fa77bbb1d7fd45dc814589f2fdbe8b"} err="failed to get container status \"95f4a72aa93b831a286529979b684dd9e7fa77bbb1d7fd45dc814589f2fdbe8b\": rpc error: code = NotFound desc = could not find container \"95f4a72aa93b831a286529979b684dd9e7fa77bbb1d7fd45dc814589f2fdbe8b\": container with ID starting with 95f4a72aa93b831a286529979b684dd9e7fa77bbb1d7fd45dc814589f2fdbe8b not found: ID does not exist"
Jul 28 15:25:14.260469 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.260441    2561 scope.go:117] "RemoveContainer" containerID="d46728d0f9bccd1a4b25c4621ab5cc4bdf15af0344c57997a210e3d076aa42d4"
Jul 28 15:25:14.260637 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:25:14.260620    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d46728d0f9bccd1a4b25c4621ab5cc4bdf15af0344c57997a210e3d076aa42d4\": container with ID starting with d46728d0f9bccd1a4b25c4621ab5cc4bdf15af0344c57997a210e3d076aa42d4 not found: ID does not exist" containerID="d46728d0f9bccd1a4b25c4621ab5cc4bdf15af0344c57997a210e3d076aa42d4"
Jul 28 15:25:14.260697 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.260644    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d46728d0f9bccd1a4b25c4621ab5cc4bdf15af0344c57997a210e3d076aa42d4"} err="failed to get container status \"d46728d0f9bccd1a4b25c4621ab5cc4bdf15af0344c57997a210e3d076aa42d4\": rpc error: code = NotFound desc = could not find container \"d46728d0f9bccd1a4b25c4621ab5cc4bdf15af0344c57997a210e3d076aa42d4\": container with ID starting with d46728d0f9bccd1a4b25c4621ab5cc4bdf15af0344c57997a210e3d076aa42d4 not found: ID does not exist"
Jul 28 15:25:14.260697 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.260666    2561 scope.go:117] "RemoveContainer" containerID="3326a09f7abdba1227b387f1c9cee9a5c3c8b701d73841a44e0ca553b03ee200"
Jul 28 15:25:14.260974 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:25:14.260956    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3326a09f7abdba1227b387f1c9cee9a5c3c8b701d73841a44e0ca553b03ee200\": container with ID starting with 3326a09f7abdba1227b387f1c9cee9a5c3c8b701d73841a44e0ca553b03ee200 not found: ID does not exist" containerID="3326a09f7abdba1227b387f1c9cee9a5c3c8b701d73841a44e0ca553b03ee200"
Jul 28 15:25:14.261035 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.260978    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3326a09f7abdba1227b387f1c9cee9a5c3c8b701d73841a44e0ca553b03ee200"} err="failed to get container status \"3326a09f7abdba1227b387f1c9cee9a5c3c8b701d73841a44e0ca553b03ee200\": rpc error: code = NotFound desc = could not find container \"3326a09f7abdba1227b387f1c9cee9a5c3c8b701d73841a44e0ca553b03ee200\": container with ID starting with 3326a09f7abdba1227b387f1c9cee9a5c3c8b701d73841a44e0ca553b03ee200 not found: ID does not exist"
Jul 28 15:25:14.301525 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.301463    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/e2835d86-40fd-4a9b-941b-515a4e2c7d09-registry-tls\") pod \"e2835d86-40fd-4a9b-941b-515a4e2c7d09\" (UID: \"e2835d86-40fd-4a9b-941b-515a4e2c7d09\") "
Jul 28 15:25:14.301525 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.301505    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e2835d86-40fd-4a9b-941b-515a4e2c7d09-feast-data\") pod \"e2835d86-40fd-4a9b-941b-515a4e2c7d09\" (UID: \"e2835d86-40fd-4a9b-941b-515a4e2c7d09\") "
Jul 28 15:25:14.301663 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.301532    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e2835d86-40fd-4a9b-941b-515a4e2c7d09-ui-tls\") pod \"e2835d86-40fd-4a9b-941b-515a4e2c7d09\" (UID: \"e2835d86-40fd-4a9b-941b-515a4e2c7d09\") "
Jul 28 15:25:14.301663 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.301641    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cp7bb\" (UniqueName: \"kubernetes.io/projected/e2835d86-40fd-4a9b-941b-515a4e2c7d09-kube-api-access-cp7bb\") pod \"e2835d86-40fd-4a9b-941b-515a4e2c7d09\" (UID: \"e2835d86-40fd-4a9b-941b-515a4e2c7d09\") "
Jul 28 15:25:14.301756 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.301697    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e2835d86-40fd-4a9b-941b-515a4e2c7d09-online-tls\") pod \"e2835d86-40fd-4a9b-941b-515a4e2c7d09\" (UID: \"e2835d86-40fd-4a9b-941b-515a4e2c7d09\") "
Jul 28 15:25:14.301810 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.301792    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e2835d86-40fd-4a9b-941b-515a4e2c7d09-offline-tls\") pod \"e2835d86-40fd-4a9b-941b-515a4e2c7d09\" (UID: \"e2835d86-40fd-4a9b-941b-515a4e2c7d09\") "
Jul 28 15:25:14.301881 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.301821    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2835d86-40fd-4a9b-941b-515a4e2c7d09-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e2835d86-40fd-4a9b-941b-515a4e2c7d09" (UID: "e2835d86-40fd-4a9b-941b-515a4e2c7d09"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 15:25:14.302041 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.302014    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2835d86-40fd-4a9b-941b-515a4e2c7d09-feast-data" (OuterVolumeSpecName: "feast-data") pod "e2835d86-40fd-4a9b-941b-515a4e2c7d09" (UID: "e2835d86-40fd-4a9b-941b-515a4e2c7d09"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 15:25:14.302123 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.302060    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/e2835d86-40fd-4a9b-941b-515a4e2c7d09-registry-tls\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:25:14.303757 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.303731    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2835d86-40fd-4a9b-941b-515a4e2c7d09-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "e2835d86-40fd-4a9b-941b-515a4e2c7d09" (UID: "e2835d86-40fd-4a9b-941b-515a4e2c7d09"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 15:25:14.303867 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.303807    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2835d86-40fd-4a9b-941b-515a4e2c7d09-kube-api-access-cp7bb" (OuterVolumeSpecName: "kube-api-access-cp7bb") pod "e2835d86-40fd-4a9b-941b-515a4e2c7d09" (UID: "e2835d86-40fd-4a9b-941b-515a4e2c7d09"). InnerVolumeSpecName "kube-api-access-cp7bb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 15:25:14.303867 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.303810    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2835d86-40fd-4a9b-941b-515a4e2c7d09-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "e2835d86-40fd-4a9b-941b-515a4e2c7d09" (UID: "e2835d86-40fd-4a9b-941b-515a4e2c7d09"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 15:25:14.304101 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.304076    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2835d86-40fd-4a9b-941b-515a4e2c7d09-online-tls" (OuterVolumeSpecName: "online-tls") pod "e2835d86-40fd-4a9b-941b-515a4e2c7d09" (UID: "e2835d86-40fd-4a9b-941b-515a4e2c7d09"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 15:25:14.397952 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.397922    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q"
Jul 28 15:25:14.402925 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.402904    2561 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/e2835d86-40fd-4a9b-941b-515a4e2c7d09-feast-data\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:25:14.402925 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.402927    2561 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/e2835d86-40fd-4a9b-941b-515a4e2c7d09-ui-tls\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:25:14.403054 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.402939    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cp7bb\" (UniqueName: \"kubernetes.io/projected/e2835d86-40fd-4a9b-941b-515a4e2c7d09-kube-api-access-cp7bb\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:25:14.403054 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.402976    2561 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/e2835d86-40fd-4a9b-941b-515a4e2c7d09-online-tls\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:25:14.403054 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.402989    2561 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/e2835d86-40fd-4a9b-941b-515a4e2c7d09-offline-tls\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:25:14.504008 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.503961    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r2m5j\" (UniqueName: \"kubernetes.io/projected/3a2403cf-252e-4348-a79f-5f3de545d15e-kube-api-access-r2m5j\") pod \"3a2403cf-252e-4348-a79f-5f3de545d15e\" (UID: \"3a2403cf-252e-4348-a79f-5f3de545d15e\") "
Jul 28 15:25:14.504194 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.504040    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3a2403cf-252e-4348-a79f-5f3de545d15e-offline-tls\") pod \"3a2403cf-252e-4348-a79f-5f3de545d15e\" (UID: \"3a2403cf-252e-4348-a79f-5f3de545d15e\") "
Jul 28 15:25:14.504194 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.504066    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3a2403cf-252e-4348-a79f-5f3de545d15e-feast-data\") pod \"3a2403cf-252e-4348-a79f-5f3de545d15e\" (UID: \"3a2403cf-252e-4348-a79f-5f3de545d15e\") "
Jul 28 15:25:14.504194 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.504120    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3a2403cf-252e-4348-a79f-5f3de545d15e-ui-tls\") pod \"3a2403cf-252e-4348-a79f-5f3de545d15e\" (UID: \"3a2403cf-252e-4348-a79f-5f3de545d15e\") "
Jul 28 15:25:14.504194 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.504158    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3a2403cf-252e-4348-a79f-5f3de545d15e-registry-tls\") pod \"3a2403cf-252e-4348-a79f-5f3de545d15e\" (UID: \"3a2403cf-252e-4348-a79f-5f3de545d15e\") "
Jul 28 15:25:14.504194 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.504182    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3a2403cf-252e-4348-a79f-5f3de545d15e-online-tls\") pod \"3a2403cf-252e-4348-a79f-5f3de545d15e\" (UID: \"3a2403cf-252e-4348-a79f-5f3de545d15e\") "
Jul 28 15:25:14.504932 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.504703    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a2403cf-252e-4348-a79f-5f3de545d15e-feast-data" (OuterVolumeSpecName: "feast-data") pod "3a2403cf-252e-4348-a79f-5f3de545d15e" (UID: "3a2403cf-252e-4348-a79f-5f3de545d15e"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 15:25:14.506206 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.506184    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a2403cf-252e-4348-a79f-5f3de545d15e-kube-api-access-r2m5j" (OuterVolumeSpecName: "kube-api-access-r2m5j") pod "3a2403cf-252e-4348-a79f-5f3de545d15e" (UID: "3a2403cf-252e-4348-a79f-5f3de545d15e"). InnerVolumeSpecName "kube-api-access-r2m5j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 15:25:14.506295 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.506270    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a2403cf-252e-4348-a79f-5f3de545d15e-online-tls" (OuterVolumeSpecName: "online-tls") pod "3a2403cf-252e-4348-a79f-5f3de545d15e" (UID: "3a2403cf-252e-4348-a79f-5f3de545d15e"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 15:25:14.506295 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.506275    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a2403cf-252e-4348-a79f-5f3de545d15e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "3a2403cf-252e-4348-a79f-5f3de545d15e" (UID: "3a2403cf-252e-4348-a79f-5f3de545d15e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 15:25:14.506582 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.506551    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a2403cf-252e-4348-a79f-5f3de545d15e-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "3a2403cf-252e-4348-a79f-5f3de545d15e" (UID: "3a2403cf-252e-4348-a79f-5f3de545d15e"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 15:25:14.506671 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.506560    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a2403cf-252e-4348-a79f-5f3de545d15e-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "3a2403cf-252e-4348-a79f-5f3de545d15e" (UID: "3a2403cf-252e-4348-a79f-5f3de545d15e"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 15:25:14.556308 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.556250    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss"]
Jul 28 15:25:14.561522 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.561496    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-857f854cf6-dj5ss"]
Jul 28 15:25:14.605340 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.605314    2561 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/3a2403cf-252e-4348-a79f-5f3de545d15e-ui-tls\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:25:14.605340 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.605336    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/3a2403cf-252e-4348-a79f-5f3de545d15e-registry-tls\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:25:14.605340 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.605345    2561 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/3a2403cf-252e-4348-a79f-5f3de545d15e-online-tls\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:25:14.605500 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.605353    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r2m5j\" (UniqueName: \"kubernetes.io/projected/3a2403cf-252e-4348-a79f-5f3de545d15e-kube-api-access-r2m5j\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:25:14.605500 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.605362    2561 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/3a2403cf-252e-4348-a79f-5f3de545d15e-offline-tls\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:25:14.605500 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:14.605371    2561 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/3a2403cf-252e-4348-a79f-5f3de545d15e-feast-data\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:25:15.230878 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:15.230850    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q" event={"ID":"3a2403cf-252e-4348-a79f-5f3de545d15e","Type":"ContainerDied","Data":"b69bbbc35a38115c6b830a6a6f7ab81308291eddeabfb5da9ac5e6dfa360e681"}
Jul 28 15:25:15.231299 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:15.230895    2561 scope.go:117] "RemoveContainer" containerID="d975a38d07e3c8dd4b0b40036ad6e215d1191c0ff20453743f5fe6038d1171e9"
Jul 28 15:25:15.231299 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:15.230856    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q"
Jul 28 15:25:15.239972 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:15.239954    2561 scope.go:117] "RemoveContainer" containerID="9ddb4c9458e4e4f2a1d6d549789826827853c4f27d3e04717d434463ab14c483"
Jul 28 15:25:15.246949 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:15.246931    2561 scope.go:117] "RemoveContainer" containerID="5408619a6c755b49c5696fdb356b5e179ed5499db3a02befe36028aa98e31400"
Jul 28 15:25:15.253784 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:15.253769    2561 scope.go:117] "RemoveContainer" containerID="9c35076389fda89afd0381f2cd00166f550979107f3429aa53b147f3b463bcf8"
Jul 28 15:25:15.260526 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:15.260502    2561 scope.go:117] "RemoveContainer" containerID="954428fc1abea41348708bbfbb34c13788ec413bd3d5795f3c1e4f0f7be2fba5"
Jul 28 15:25:15.263375 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:15.263355    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q"]
Jul 28 15:25:15.267456 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:15.267441    2561 scope.go:117] "RemoveContainer" containerID="0e584bec682081265a2e341e06f24ad369eee35c849bd46b19b6448d816b9499"
Jul 28 15:25:15.272617 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:15.272599    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-55f4f9844b-g5g9q"]
Jul 28 15:25:15.410532 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:15.410507    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a2403cf-252e-4348-a79f-5f3de545d15e" path="/var/lib/kubelet/pods/3a2403cf-252e-4348-a79f-5f3de545d15e/volumes"
Jul 28 15:25:15.411092 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:15.411080    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2835d86-40fd-4a9b-941b-515a4e2c7d09" path="/var/lib/kubelet/pods/e2835d86-40fd-4a9b-941b-515a4e2c7d09/volumes"
Jul 28 15:25:18.067214 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:18.067180    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/postgres-864846d4f5-2nkgr"]
Jul 28 15:25:18.067648 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:18.067555    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2835d86-40fd-4a9b-941b-515a4e2c7d09" containerName="offline"
Jul 28 15:25:18.067648 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:18.067571    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2835d86-40fd-4a9b-941b-515a4e2c7d09" containerName="offline"
Jul 28 15:25:18.067648 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:18.067583    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a2403cf-252e-4348-a79f-5f3de545d15e" containerName="feast-apply"
Jul 28 15:25:18.067648 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:18.067591    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a2403cf-252e-4348-a79f-5f3de545d15e" containerName="feast-apply"
Jul 28 15:25:18.067648 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:18.067611    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a2403cf-252e-4348-a79f-5f3de545d15e" containerName="registry"
Jul 28 15:25:18.067648 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:18.067619    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a2403cf-252e-4348-a79f-5f3de545d15e" containerName="registry"
Jul 28 15:25:18.067648 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:18.067627    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2835d86-40fd-4a9b-941b-515a4e2c7d09" containerName="feast-apply"
Jul 28 15:25:18.067648 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:18.067634    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2835d86-40fd-4a9b-941b-515a4e2c7d09" containerName="feast-apply"
Jul 28 15:25:18.067648 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:18.067647    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a2403cf-252e-4348-a79f-5f3de545d15e" containerName="online"
Jul 28 15:25:18.067648 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:18.067655    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a2403cf-252e-4348-a79f-5f3de545d15e" containerName="online"
Jul 28 15:25:18.068171 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:18.067663    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a2403cf-252e-4348-a79f-5f3de545d15e" containerName="offline"
Jul 28 15:25:18.068171 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:18.067670    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a2403cf-252e-4348-a79f-5f3de545d15e" containerName="offline"
Jul 28 15:25:18.068171 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:18.067679    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2835d86-40fd-4a9b-941b-515a4e2c7d09" containerName="ui"
Jul 28 15:25:18.068171 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:18.067687    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2835d86-40fd-4a9b-941b-515a4e2c7d09" containerName="ui"
Jul 28 15:25:18.068171 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:18.067700    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2835d86-40fd-4a9b-941b-515a4e2c7d09" containerName="online"
Jul 28 15:25:18.068171 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:18.067708    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2835d86-40fd-4a9b-941b-515a4e2c7d09" containerName="online"
Jul 28 15:25:18.068171 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:18.067715    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a2403cf-252e-4348-a79f-5f3de545d15e" containerName="ui"
Jul 28 15:25:18.068171 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:18.067722    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a2403cf-252e-4348-a79f-5f3de545d15e" containerName="ui"
Jul 28 15:25:18.068171 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:18.067737    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2835d86-40fd-4a9b-941b-515a4e2c7d09" containerName="feast-init"
Jul 28 15:25:18.068171 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:18.067745    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2835d86-40fd-4a9b-941b-515a4e2c7d09" containerName="feast-init"
Jul 28 15:25:18.068171 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:18.067754    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a2403cf-252e-4348-a79f-5f3de545d15e" containerName="feast-init"
Jul 28 15:25:18.068171 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:18.067761    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a2403cf-252e-4348-a79f-5f3de545d15e" containerName="feast-init"
Jul 28 15:25:18.068171 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:18.067853    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a2403cf-252e-4348-a79f-5f3de545d15e" containerName="online"
Jul 28 15:25:18.068171 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:18.067865    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a2403cf-252e-4348-a79f-5f3de545d15e" containerName="offline"
Jul 28 15:25:18.068171 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:18.067874    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2835d86-40fd-4a9b-941b-515a4e2c7d09" containerName="ui"
Jul 28 15:25:18.068171 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:18.067882    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a2403cf-252e-4348-a79f-5f3de545d15e" containerName="registry"
Jul 28 15:25:18.068171 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:18.067890    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2835d86-40fd-4a9b-941b-515a4e2c7d09" containerName="offline"
Jul 28 15:25:18.068171 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:18.067899    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2835d86-40fd-4a9b-941b-515a4e2c7d09" containerName="online"
Jul 28 15:25:18.068171 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:18.067906    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a2403cf-252e-4348-a79f-5f3de545d15e" containerName="ui"
Jul 28 15:25:18.072776 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:18.072757    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-2nkgr"
Jul 28 15:25:18.103315 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:18.103295    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"postgres-secret\""
Jul 28 15:25:18.104397 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:18.104379    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"default-dockercfg-qr7wm\""
Jul 28 15:25:18.104474 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:18.104430    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Jul 28 15:25:18.104534 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:18.104426    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Jul 28 15:25:18.104706 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:18.104684    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-2nkgr"]
Jul 28 15:25:18.230798 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:18.230759    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/a1469e29-3911-46da-82c8-394e15c3d7e6-postgresdata\") pod \"postgres-864846d4f5-2nkgr\" (UID: \"a1469e29-3911-46da-82c8-394e15c3d7e6\") " pod="test-ns-feast/postgres-864846d4f5-2nkgr"
Jul 28 15:25:18.230954 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:18.230856    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shbwp\" (UniqueName: \"kubernetes.io/projected/a1469e29-3911-46da-82c8-394e15c3d7e6-kube-api-access-shbwp\") pod \"postgres-864846d4f5-2nkgr\" (UID: \"a1469e29-3911-46da-82c8-394e15c3d7e6\") " pod="test-ns-feast/postgres-864846d4f5-2nkgr"
Jul 28 15:25:18.332182 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:18.332158    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shbwp\" (UniqueName: \"kubernetes.io/projected/a1469e29-3911-46da-82c8-394e15c3d7e6-kube-api-access-shbwp\") pod \"postgres-864846d4f5-2nkgr\" (UID: \"a1469e29-3911-46da-82c8-394e15c3d7e6\") " pod="test-ns-feast/postgres-864846d4f5-2nkgr"
Jul 28 15:25:18.332286 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:18.332195    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/a1469e29-3911-46da-82c8-394e15c3d7e6-postgresdata\") pod \"postgres-864846d4f5-2nkgr\" (UID: \"a1469e29-3911-46da-82c8-394e15c3d7e6\") " pod="test-ns-feast/postgres-864846d4f5-2nkgr"
Jul 28 15:25:18.332508 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:18.332495    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/a1469e29-3911-46da-82c8-394e15c3d7e6-postgresdata\") pod \"postgres-864846d4f5-2nkgr\" (UID: \"a1469e29-3911-46da-82c8-394e15c3d7e6\") " pod="test-ns-feast/postgres-864846d4f5-2nkgr"
Jul 28 15:25:18.342779 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:18.342761    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shbwp\" (UniqueName: \"kubernetes.io/projected/a1469e29-3911-46da-82c8-394e15c3d7e6-kube-api-access-shbwp\") pod \"postgres-864846d4f5-2nkgr\" (UID: \"a1469e29-3911-46da-82c8-394e15c3d7e6\") " pod="test-ns-feast/postgres-864846d4f5-2nkgr"
Jul 28 15:25:18.381215 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:18.381178    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-2nkgr"
Jul 28 15:25:18.520943 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:18.520911    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/postgres-864846d4f5-2nkgr"]
Jul 28 15:25:18.525244 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:25:18.525205    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda1469e29_3911_46da_82c8_394e15c3d7e6.slice/crio-4b0d42928bb977f9602c186a974e3db114ebb890c1c88a5e517cb243c7312305 WatchSource:0}: Error finding container 4b0d42928bb977f9602c186a974e3db114ebb890c1c88a5e517cb243c7312305: Status 404 returned error can't find the container with id 4b0d42928bb977f9602c186a974e3db114ebb890c1c88a5e517cb243c7312305
Jul 28 15:25:18.526964 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:18.526950    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 15:25:19.248684 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:19.248655    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-2nkgr" event={"ID":"a1469e29-3911-46da-82c8-394e15c3d7e6","Type":"ContainerStarted","Data":"4b0d42928bb977f9602c186a974e3db114ebb890c1c88a5e517cb243c7312305"}
Jul 28 15:25:24.271266 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:24.271191    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-2nkgr" event={"ID":"a1469e29-3911-46da-82c8-394e15c3d7e6","Type":"ContainerStarted","Data":"eaf2484a6e27ead8933f468c6ea52ec8d7c0199a7a1bc378e01b8e5af3e6583c"}
Jul 28 15:25:24.292562 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:24.292197    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/postgres-864846d4f5-2nkgr" podStartSLOduration=0.913890772 podStartE2EDuration="6.292180311s" totalImagesPullingTime="5.378289539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:25:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:25:24.292025504 +0000 UTC m=+685.342393609" watchObservedRunningTime="2026-07-28 15:25:24.292180311 +0000 UTC m=+685.342548416"
Jul 28 15:25:28.889761 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:28.889689    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-credit-scoring-7484c87669-69q7w"]
Jul 28 15:25:28.896313 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:28.896294    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w"
Jul 28 15:25:28.899360 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:28.899341    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-registry-tls\""
Jul 28 15:25:28.899610 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:28.899594    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-offline-tls\""
Jul 28 15:25:28.900599 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:28.900575    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-intra-comm\""
Jul 28 15:25:28.900599 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:28.900597    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-online-tls\""
Jul 28 15:25:28.900744 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:28.900574    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-credit-scoring-dockercfg-jp69g\""
Jul 28 15:25:28.906531 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:28.906513    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/512449cc-8106-41dd-ae15-e96a04523522-registry-tls\") pod \"feast-credit-scoring-7484c87669-69q7w\" (UID: \"512449cc-8106-41dd-ae15-e96a04523522\") " pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w"
Jul 28 15:25:28.906666 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:28.906569    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/512449cc-8106-41dd-ae15-e96a04523522-feast-data\") pod \"feast-credit-scoring-7484c87669-69q7w\" (UID: \"512449cc-8106-41dd-ae15-e96a04523522\") " pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w"
Jul 28 15:25:28.906733 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:28.906668    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/512449cc-8106-41dd-ae15-e96a04523522-online-tls\") pod \"feast-credit-scoring-7484c87669-69q7w\" (UID: \"512449cc-8106-41dd-ae15-e96a04523522\") " pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w"
Jul 28 15:25:28.906733 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:28.906722    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjwkq\" (UniqueName: \"kubernetes.io/projected/512449cc-8106-41dd-ae15-e96a04523522-kube-api-access-zjwkq\") pod \"feast-credit-scoring-7484c87669-69q7w\" (UID: \"512449cc-8106-41dd-ae15-e96a04523522\") " pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w"
Jul 28 15:25:28.906833 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:28.906758    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/512449cc-8106-41dd-ae15-e96a04523522-offline-tls\") pod \"feast-credit-scoring-7484c87669-69q7w\" (UID: \"512449cc-8106-41dd-ae15-e96a04523522\") " pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w"
Jul 28 15:25:28.908968 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:28.908945    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-7484c87669-69q7w"]
Jul 28 15:25:29.007996 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:29.007966    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/512449cc-8106-41dd-ae15-e96a04523522-registry-tls\") pod \"feast-credit-scoring-7484c87669-69q7w\" (UID: \"512449cc-8106-41dd-ae15-e96a04523522\") " pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w"
Jul 28 15:25:29.008127 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:29.008040    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/512449cc-8106-41dd-ae15-e96a04523522-feast-data\") pod \"feast-credit-scoring-7484c87669-69q7w\" (UID: \"512449cc-8106-41dd-ae15-e96a04523522\") " pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w"
Jul 28 15:25:29.008127 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:29.008074    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/512449cc-8106-41dd-ae15-e96a04523522-online-tls\") pod \"feast-credit-scoring-7484c87669-69q7w\" (UID: \"512449cc-8106-41dd-ae15-e96a04523522\") " pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w"
Jul 28 15:25:29.008127 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:29.008101    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjwkq\" (UniqueName: \"kubernetes.io/projected/512449cc-8106-41dd-ae15-e96a04523522-kube-api-access-zjwkq\") pod \"feast-credit-scoring-7484c87669-69q7w\" (UID: \"512449cc-8106-41dd-ae15-e96a04523522\") " pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w"
Jul 28 15:25:29.008274 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:29.008220    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/512449cc-8106-41dd-ae15-e96a04523522-offline-tls\") pod \"feast-credit-scoring-7484c87669-69q7w\" (UID: \"512449cc-8106-41dd-ae15-e96a04523522\") " pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w"
Jul 28 15:25:29.008506 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:29.008485    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/512449cc-8106-41dd-ae15-e96a04523522-feast-data\") pod \"feast-credit-scoring-7484c87669-69q7w\" (UID: \"512449cc-8106-41dd-ae15-e96a04523522\") " pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w"
Jul 28 15:25:29.010438 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:29.010418    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/512449cc-8106-41dd-ae15-e96a04523522-offline-tls\") pod \"feast-credit-scoring-7484c87669-69q7w\" (UID: \"512449cc-8106-41dd-ae15-e96a04523522\") " pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w"
Jul 28 15:25:29.010516 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:29.010452    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/512449cc-8106-41dd-ae15-e96a04523522-registry-tls\") pod \"feast-credit-scoring-7484c87669-69q7w\" (UID: \"512449cc-8106-41dd-ae15-e96a04523522\") " pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w"
Jul 28 15:25:29.010516 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:29.010452    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/512449cc-8106-41dd-ae15-e96a04523522-online-tls\") pod \"feast-credit-scoring-7484c87669-69q7w\" (UID: \"512449cc-8106-41dd-ae15-e96a04523522\") " pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w"
Jul 28 15:25:29.018388 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:29.018365    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjwkq\" (UniqueName: \"kubernetes.io/projected/512449cc-8106-41dd-ae15-e96a04523522-kube-api-access-zjwkq\") pod \"feast-credit-scoring-7484c87669-69q7w\" (UID: \"512449cc-8106-41dd-ae15-e96a04523522\") " pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w"
Jul 28 15:25:29.205531 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:29.205443    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w"
Jul 28 15:25:29.347773 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:29.347746    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-credit-scoring-7484c87669-69q7w"]
Jul 28 15:25:29.350341 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:25:29.350318    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod512449cc_8106_41dd_ae15_e96a04523522.slice/crio-62d042c8e1b6c2584d1317e1f6864068e3a34a650d06e8a4e0739af32c7eb609 WatchSource:0}: Error finding container 62d042c8e1b6c2584d1317e1f6864068e3a34a650d06e8a4e0739af32c7eb609: Status 404 returned error can't find the container with id 62d042c8e1b6c2584d1317e1f6864068e3a34a650d06e8a4e0739af32c7eb609
Jul 28 15:25:30.297514 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:30.297475    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w" event={"ID":"512449cc-8106-41dd-ae15-e96a04523522","Type":"ContainerStarted","Data":"c1896827b907be10ab37bb7053271edab655fcec00a7868c02046151974d1488"}
Jul 28 15:25:30.297938 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:30.297545    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w" event={"ID":"512449cc-8106-41dd-ae15-e96a04523522","Type":"ContainerStarted","Data":"62d042c8e1b6c2584d1317e1f6864068e3a34a650d06e8a4e0739af32c7eb609"}
Jul 28 15:25:31.303738 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:31.303702    2561 generic.go:356] "Generic (PLEG): container finished" podID="512449cc-8106-41dd-ae15-e96a04523522" containerID="c1896827b907be10ab37bb7053271edab655fcec00a7868c02046151974d1488" exitCode=0
Jul 28 15:25:31.304293 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:31.303752    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w" event={"ID":"512449cc-8106-41dd-ae15-e96a04523522","Type":"ContainerDied","Data":"c1896827b907be10ab37bb7053271edab655fcec00a7868c02046151974d1488"}
Jul 28 15:25:32.309362 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:32.309332    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w" event={"ID":"512449cc-8106-41dd-ae15-e96a04523522","Type":"ContainerStarted","Data":"44716555493b253aaf6a3860008d2b5d1550d7fdb2b52fa7311fa30edf77f140"}
Jul 28 15:25:38.340878 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:38.340819    2561 generic.go:356] "Generic (PLEG): container finished" podID="512449cc-8106-41dd-ae15-e96a04523522" containerID="44716555493b253aaf6a3860008d2b5d1550d7fdb2b52fa7311fa30edf77f140" exitCode=0
Jul 28 15:25:38.341241 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:38.340888    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w" event={"ID":"512449cc-8106-41dd-ae15-e96a04523522","Type":"ContainerDied","Data":"44716555493b253aaf6a3860008d2b5d1550d7fdb2b52fa7311fa30edf77f140"}
Jul 28 15:25:39.348871 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:39.348812    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w" event={"ID":"512449cc-8106-41dd-ae15-e96a04523522","Type":"ContainerStarted","Data":"ecca36598f6169f69c890e19ded82f956e1b39f41b4ea30adccbb9aab700b2eb"}
Jul 28 15:25:39.349347 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:39.348907    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w" event={"ID":"512449cc-8106-41dd-ae15-e96a04523522","Type":"ContainerStarted","Data":"9072b1e4c9b31d80899f1d2eace461b2448ab0ca737374aaff8f783c451ec288"}
Jul 28 15:25:39.349347 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:39.348935    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w" event={"ID":"512449cc-8106-41dd-ae15-e96a04523522","Type":"ContainerStarted","Data":"860a9387fd546f2c9a9c96dee7727df48f4d7559e7cea88f5184a478fea84572"}
Jul 28 15:25:39.380470 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:39.380416    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w" podStartSLOduration=11.380401337 podStartE2EDuration="11.380401337s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:25:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:25:39.378935529 +0000 UTC m=+700.429303634" watchObservedRunningTime="2026-07-28 15:25:39.380401337 +0000 UTC m=+700.430769441"
Jul 28 15:25:41.205905 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:41.205863    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w"
Jul 28 15:25:41.206426 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:41.205985    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w"
Jul 28 15:25:41.206426 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:41.206006    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w"
Jul 28 15:25:41.207800 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:41.207770    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w" podUID="512449cc-8106-41dd-ae15-e96a04523522" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.26:8816: connect: connection refused"
Jul 28 15:25:41.207800 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:41.207786    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w" podUID="512449cc-8106-41dd-ae15-e96a04523522" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused"
Jul 28 15:25:41.208046 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:41.207807    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w" podUID="512449cc-8106-41dd-ae15-e96a04523522" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.26:6571: connect: connection refused"
Jul 28 15:25:44.206345 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:44.206295    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w" podUID="512449cc-8106-41dd-ae15-e96a04523522" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.26:6571: connect: connection refused"
Jul 28 15:25:44.207458 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:44.207433    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w"
Jul 28 15:25:44.207969 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:44.207939    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w"
Jul 28 15:25:44.208468 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:44.208447    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w"
Jul 28 15:25:44.669594 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:44.669563    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w"
Jul 28 15:25:45.377756 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:45.377725    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w"
Jul 28 15:25:45.382310 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:45.382286    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w"
Jul 28 15:25:47.206279 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:47.206237    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w" podUID="512449cc-8106-41dd-ae15-e96a04523522" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.26:6571: connect: connection refused"
Jul 28 15:25:49.206016 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:49.205980    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w"
Jul 28 15:25:50.207087 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:50.207057    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w"
Jul 28 15:25:50.207833 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:25:50.207807    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w"
Jul 28 15:26:52.898906 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:26:52.898871    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-7484c87669-69q7w"]
Jul 28 15:26:52.899478 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:26:52.899116    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w" podUID="512449cc-8106-41dd-ae15-e96a04523522" containerName="registry" containerID="cri-o://860a9387fd546f2c9a9c96dee7727df48f4d7559e7cea88f5184a478fea84572" gracePeriod=30
Jul 28 15:26:52.899478 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:26:52.899199    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w" podUID="512449cc-8106-41dd-ae15-e96a04523522" containerName="offline" containerID="cri-o://ecca36598f6169f69c890e19ded82f956e1b39f41b4ea30adccbb9aab700b2eb" gracePeriod=30
Jul 28 15:26:52.899478 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:26:52.899325    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w" podUID="512449cc-8106-41dd-ae15-e96a04523522" containerName="online" containerID="cri-o://9072b1e4c9b31d80899f1d2eace461b2448ab0ca737374aaff8f783c451ec288" gracePeriod=30
Jul 28 15:26:52.932142 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:26:52.932119    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-2nkgr"]
Jul 28 15:26:52.932271 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:26:52.932256    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/postgres-864846d4f5-2nkgr" podUID="a1469e29-3911-46da-82c8-394e15c3d7e6" containerName="postgres" containerID="cri-o://eaf2484a6e27ead8933f468c6ea52ec8d7c0199a7a1bc378e01b8e5af3e6583c" gracePeriod=30
Jul 28 15:26:53.180249 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:26:53.180223    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-2nkgr"
Jul 28 15:26:53.283502 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:26:53.283463    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/a1469e29-3911-46da-82c8-394e15c3d7e6-postgresdata\") pod \"a1469e29-3911-46da-82c8-394e15c3d7e6\" (UID: \"a1469e29-3911-46da-82c8-394e15c3d7e6\") "
Jul 28 15:26:53.283671 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:26:53.283520    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shbwp\" (UniqueName: \"kubernetes.io/projected/a1469e29-3911-46da-82c8-394e15c3d7e6-kube-api-access-shbwp\") pod \"a1469e29-3911-46da-82c8-394e15c3d7e6\" (UID: \"a1469e29-3911-46da-82c8-394e15c3d7e6\") "
Jul 28 15:26:53.285613 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:26:53.285575    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1469e29-3911-46da-82c8-394e15c3d7e6-kube-api-access-shbwp" (OuterVolumeSpecName: "kube-api-access-shbwp") pod "a1469e29-3911-46da-82c8-394e15c3d7e6" (UID: "a1469e29-3911-46da-82c8-394e15c3d7e6"). InnerVolumeSpecName "kube-api-access-shbwp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 15:26:53.313688 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:26:53.313643    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a1469e29-3911-46da-82c8-394e15c3d7e6-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "a1469e29-3911-46da-82c8-394e15c3d7e6" (UID: "a1469e29-3911-46da-82c8-394e15c3d7e6"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 15:26:53.384233 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:26:53.384201    2561 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/a1469e29-3911-46da-82c8-394e15c3d7e6-postgresdata\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:26:53.384233 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:26:53.384229    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shbwp\" (UniqueName: \"kubernetes.io/projected/a1469e29-3911-46da-82c8-394e15c3d7e6-kube-api-access-shbwp\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:26:53.657542 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:26:53.657510    2561 generic.go:356] "Generic (PLEG): container finished" podID="a1469e29-3911-46da-82c8-394e15c3d7e6" containerID="eaf2484a6e27ead8933f468c6ea52ec8d7c0199a7a1bc378e01b8e5af3e6583c" exitCode=0
Jul 28 15:26:53.657673 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:26:53.657552    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/postgres-864846d4f5-2nkgr"
Jul 28 15:26:53.657673 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:26:53.657593    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-2nkgr" event={"ID":"a1469e29-3911-46da-82c8-394e15c3d7e6","Type":"ContainerDied","Data":"eaf2484a6e27ead8933f468c6ea52ec8d7c0199a7a1bc378e01b8e5af3e6583c"}
Jul 28 15:26:53.657673 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:26:53.657636    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/postgres-864846d4f5-2nkgr" event={"ID":"a1469e29-3911-46da-82c8-394e15c3d7e6","Type":"ContainerDied","Data":"4b0d42928bb977f9602c186a974e3db114ebb890c1c88a5e517cb243c7312305"}
Jul 28 15:26:53.657673 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:26:53.657657    2561 scope.go:117] "RemoveContainer" containerID="eaf2484a6e27ead8933f468c6ea52ec8d7c0199a7a1bc378e01b8e5af3e6583c"
Jul 28 15:26:53.660661 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:26:53.660637    2561 generic.go:356] "Generic (PLEG): container finished" podID="512449cc-8106-41dd-ae15-e96a04523522" containerID="9072b1e4c9b31d80899f1d2eace461b2448ab0ca737374aaff8f783c451ec288" exitCode=0
Jul 28 15:26:53.660771 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:26:53.660706    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w" event={"ID":"512449cc-8106-41dd-ae15-e96a04523522","Type":"ContainerDied","Data":"9072b1e4c9b31d80899f1d2eace461b2448ab0ca737374aaff8f783c451ec288"}
Jul 28 15:26:53.665440 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:26:53.665417    2561 scope.go:117] "RemoveContainer" containerID="eaf2484a6e27ead8933f468c6ea52ec8d7c0199a7a1bc378e01b8e5af3e6583c"
Jul 28 15:26:53.665701 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:26:53.665683    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eaf2484a6e27ead8933f468c6ea52ec8d7c0199a7a1bc378e01b8e5af3e6583c\": container with ID starting with eaf2484a6e27ead8933f468c6ea52ec8d7c0199a7a1bc378e01b8e5af3e6583c not found: ID does not exist" containerID="eaf2484a6e27ead8933f468c6ea52ec8d7c0199a7a1bc378e01b8e5af3e6583c"
Jul 28 15:26:53.665750 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:26:53.665708    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eaf2484a6e27ead8933f468c6ea52ec8d7c0199a7a1bc378e01b8e5af3e6583c"} err="failed to get container status \"eaf2484a6e27ead8933f468c6ea52ec8d7c0199a7a1bc378e01b8e5af3e6583c\": rpc error: code = NotFound desc = could not find container \"eaf2484a6e27ead8933f468c6ea52ec8d7c0199a7a1bc378e01b8e5af3e6583c\": container with ID starting with eaf2484a6e27ead8933f468c6ea52ec8d7c0199a7a1bc378e01b8e5af3e6583c not found: ID does not exist"
Jul 28 15:26:53.676975 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:26:53.676924    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/postgres-864846d4f5-2nkgr"]
Jul 28 15:26:53.688368 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:26:53.688337    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/postgres-864846d4f5-2nkgr"]
Jul 28 15:26:55.378837 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:26:55.378795    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w" podUID="512449cc-8106-41dd-ae15-e96a04523522" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused"
Jul 28 15:26:55.410478 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:26:55.410443    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1469e29-3911-46da-82c8-394e15c3d7e6" path="/var/lib/kubelet/pods/a1469e29-3911-46da-82c8-394e15c3d7e6/volumes"
Jul 28 15:27:05.378713 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:05.378675    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w" podUID="512449cc-8106-41dd-ae15-e96a04523522" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused"
Jul 28 15:27:15.377906 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:15.377863    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w" podUID="512449cc-8106-41dd-ae15-e96a04523522" containerName="online" probeResult="failure" output="Get \"https://10.133.0.26:6567/health\": dial tcp 10.133.0.26:6567: connect: connection refused"
Jul 28 15:27:15.378349 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:15.378006    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w"
Jul 28 15:27:23.549851 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:23.549811    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w"
Jul 28 15:27:23.720288 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:23.720207    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/512449cc-8106-41dd-ae15-e96a04523522-registry-tls\") pod \"512449cc-8106-41dd-ae15-e96a04523522\" (UID: \"512449cc-8106-41dd-ae15-e96a04523522\") "
Jul 28 15:27:23.720288 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:23.720237    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/512449cc-8106-41dd-ae15-e96a04523522-offline-tls\") pod \"512449cc-8106-41dd-ae15-e96a04523522\" (UID: \"512449cc-8106-41dd-ae15-e96a04523522\") "
Jul 28 15:27:23.720288 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:23.720262    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/512449cc-8106-41dd-ae15-e96a04523522-feast-data\") pod \"512449cc-8106-41dd-ae15-e96a04523522\" (UID: \"512449cc-8106-41dd-ae15-e96a04523522\") "
Jul 28 15:27:23.720288 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:23.720289    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zjwkq\" (UniqueName: \"kubernetes.io/projected/512449cc-8106-41dd-ae15-e96a04523522-kube-api-access-zjwkq\") pod \"512449cc-8106-41dd-ae15-e96a04523522\" (UID: \"512449cc-8106-41dd-ae15-e96a04523522\") "
Jul 28 15:27:23.720618 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:23.720334    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/512449cc-8106-41dd-ae15-e96a04523522-online-tls\") pod \"512449cc-8106-41dd-ae15-e96a04523522\" (UID: \"512449cc-8106-41dd-ae15-e96a04523522\") "
Jul 28 15:27:23.722339 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:23.722303    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/512449cc-8106-41dd-ae15-e96a04523522-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "512449cc-8106-41dd-ae15-e96a04523522" (UID: "512449cc-8106-41dd-ae15-e96a04523522"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 15:27:23.722512 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:23.722451    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/512449cc-8106-41dd-ae15-e96a04523522-kube-api-access-zjwkq" (OuterVolumeSpecName: "kube-api-access-zjwkq") pod "512449cc-8106-41dd-ae15-e96a04523522" (UID: "512449cc-8106-41dd-ae15-e96a04523522"). InnerVolumeSpecName "kube-api-access-zjwkq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 15:27:23.722692 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:23.722659    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/512449cc-8106-41dd-ae15-e96a04523522-online-tls" (OuterVolumeSpecName: "online-tls") pod "512449cc-8106-41dd-ae15-e96a04523522" (UID: "512449cc-8106-41dd-ae15-e96a04523522"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 15:27:23.722787 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:23.722741    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/512449cc-8106-41dd-ae15-e96a04523522-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "512449cc-8106-41dd-ae15-e96a04523522" (UID: "512449cc-8106-41dd-ae15-e96a04523522"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 15:27:23.727589 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:23.727568    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/512449cc-8106-41dd-ae15-e96a04523522-feast-data" (OuterVolumeSpecName: "feast-data") pod "512449cc-8106-41dd-ae15-e96a04523522" (UID: "512449cc-8106-41dd-ae15-e96a04523522"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 15:27:23.774615 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:23.774583    2561 generic.go:356] "Generic (PLEG): container finished" podID="512449cc-8106-41dd-ae15-e96a04523522" containerID="ecca36598f6169f69c890e19ded82f956e1b39f41b4ea30adccbb9aab700b2eb" exitCode=137
Jul 28 15:27:23.774615 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:23.774606    2561 generic.go:356] "Generic (PLEG): container finished" podID="512449cc-8106-41dd-ae15-e96a04523522" containerID="860a9387fd546f2c9a9c96dee7727df48f4d7559e7cea88f5184a478fea84572" exitCode=137
Jul 28 15:27:23.774784 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:23.774644    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w"
Jul 28 15:27:23.774784 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:23.774662    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w" event={"ID":"512449cc-8106-41dd-ae15-e96a04523522","Type":"ContainerDied","Data":"ecca36598f6169f69c890e19ded82f956e1b39f41b4ea30adccbb9aab700b2eb"}
Jul 28 15:27:23.774784 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:23.774716    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w" event={"ID":"512449cc-8106-41dd-ae15-e96a04523522","Type":"ContainerDied","Data":"860a9387fd546f2c9a9c96dee7727df48f4d7559e7cea88f5184a478fea84572"}
Jul 28 15:27:23.774784 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:23.774734    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-credit-scoring-7484c87669-69q7w" event={"ID":"512449cc-8106-41dd-ae15-e96a04523522","Type":"ContainerDied","Data":"62d042c8e1b6c2584d1317e1f6864068e3a34a650d06e8a4e0739af32c7eb609"}
Jul 28 15:27:23.774784 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:23.774755    2561 scope.go:117] "RemoveContainer" containerID="ecca36598f6169f69c890e19ded82f956e1b39f41b4ea30adccbb9aab700b2eb"
Jul 28 15:27:23.783102 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:23.783088    2561 scope.go:117] "RemoveContainer" containerID="9072b1e4c9b31d80899f1d2eace461b2448ab0ca737374aaff8f783c451ec288"
Jul 28 15:27:23.790171 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:23.790156    2561 scope.go:117] "RemoveContainer" containerID="860a9387fd546f2c9a9c96dee7727df48f4d7559e7cea88f5184a478fea84572"
Jul 28 15:27:23.797191 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:23.797176    2561 scope.go:117] "RemoveContainer" containerID="44716555493b253aaf6a3860008d2b5d1550d7fdb2b52fa7311fa30edf77f140"
Jul 28 15:27:23.802629 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:23.802598    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-credit-scoring-7484c87669-69q7w"]
Jul 28 15:27:23.804969 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:23.804952    2561 scope.go:117] "RemoveContainer" containerID="c1896827b907be10ab37bb7053271edab655fcec00a7868c02046151974d1488"
Jul 28 15:27:23.808848 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:23.808814    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-credit-scoring-7484c87669-69q7w"]
Jul 28 15:27:23.811977 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:23.811958    2561 scope.go:117] "RemoveContainer" containerID="ecca36598f6169f69c890e19ded82f956e1b39f41b4ea30adccbb9aab700b2eb"
Jul 28 15:27:23.812198 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:27:23.812181    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ecca36598f6169f69c890e19ded82f956e1b39f41b4ea30adccbb9aab700b2eb\": container with ID starting with ecca36598f6169f69c890e19ded82f956e1b39f41b4ea30adccbb9aab700b2eb not found: ID does not exist" containerID="ecca36598f6169f69c890e19ded82f956e1b39f41b4ea30adccbb9aab700b2eb"
Jul 28 15:27:23.812294 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:23.812208    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecca36598f6169f69c890e19ded82f956e1b39f41b4ea30adccbb9aab700b2eb"} err="failed to get container status \"ecca36598f6169f69c890e19ded82f956e1b39f41b4ea30adccbb9aab700b2eb\": rpc error: code = NotFound desc = could not find container \"ecca36598f6169f69c890e19ded82f956e1b39f41b4ea30adccbb9aab700b2eb\": container with ID starting with ecca36598f6169f69c890e19ded82f956e1b39f41b4ea30adccbb9aab700b2eb not found: ID does not exist"
Jul 28 15:27:23.812294 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:23.812228    2561 scope.go:117] "RemoveContainer" containerID="9072b1e4c9b31d80899f1d2eace461b2448ab0ca737374aaff8f783c451ec288"
Jul 28 15:27:23.812448 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:27:23.812431    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9072b1e4c9b31d80899f1d2eace461b2448ab0ca737374aaff8f783c451ec288\": container with ID starting with 9072b1e4c9b31d80899f1d2eace461b2448ab0ca737374aaff8f783c451ec288 not found: ID does not exist" containerID="9072b1e4c9b31d80899f1d2eace461b2448ab0ca737374aaff8f783c451ec288"
Jul 28 15:27:23.812491 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:23.812454    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9072b1e4c9b31d80899f1d2eace461b2448ab0ca737374aaff8f783c451ec288"} err="failed to get container status \"9072b1e4c9b31d80899f1d2eace461b2448ab0ca737374aaff8f783c451ec288\": rpc error: code = NotFound desc = could not find container \"9072b1e4c9b31d80899f1d2eace461b2448ab0ca737374aaff8f783c451ec288\": container with ID starting with 9072b1e4c9b31d80899f1d2eace461b2448ab0ca737374aaff8f783c451ec288 not found: ID does not exist"
Jul 28 15:27:23.812491 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:23.812470    2561 scope.go:117] "RemoveContainer" containerID="860a9387fd546f2c9a9c96dee7727df48f4d7559e7cea88f5184a478fea84572"
Jul 28 15:27:23.812688 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:27:23.812670    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"860a9387fd546f2c9a9c96dee7727df48f4d7559e7cea88f5184a478fea84572\": container with ID starting with 860a9387fd546f2c9a9c96dee7727df48f4d7559e7cea88f5184a478fea84572 not found: ID does not exist" containerID="860a9387fd546f2c9a9c96dee7727df48f4d7559e7cea88f5184a478fea84572"
Jul 28 15:27:23.812731 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:23.812697    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"860a9387fd546f2c9a9c96dee7727df48f4d7559e7cea88f5184a478fea84572"} err="failed to get container status \"860a9387fd546f2c9a9c96dee7727df48f4d7559e7cea88f5184a478fea84572\": rpc error: code = NotFound desc = could not find container \"860a9387fd546f2c9a9c96dee7727df48f4d7559e7cea88f5184a478fea84572\": container with ID starting with 860a9387fd546f2c9a9c96dee7727df48f4d7559e7cea88f5184a478fea84572 not found: ID does not exist"
Jul 28 15:27:23.812731 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:23.812715    2561 scope.go:117] "RemoveContainer" containerID="44716555493b253aaf6a3860008d2b5d1550d7fdb2b52fa7311fa30edf77f140"
Jul 28 15:27:23.812937 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:27:23.812921    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44716555493b253aaf6a3860008d2b5d1550d7fdb2b52fa7311fa30edf77f140\": container with ID starting with 44716555493b253aaf6a3860008d2b5d1550d7fdb2b52fa7311fa30edf77f140 not found: ID does not exist" containerID="44716555493b253aaf6a3860008d2b5d1550d7fdb2b52fa7311fa30edf77f140"
Jul 28 15:27:23.812988 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:23.812942    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44716555493b253aaf6a3860008d2b5d1550d7fdb2b52fa7311fa30edf77f140"} err="failed to get container status \"44716555493b253aaf6a3860008d2b5d1550d7fdb2b52fa7311fa30edf77f140\": rpc error: code = NotFound desc = could not find container \"44716555493b253aaf6a3860008d2b5d1550d7fdb2b52fa7311fa30edf77f140\": container with ID starting with 44716555493b253aaf6a3860008d2b5d1550d7fdb2b52fa7311fa30edf77f140 not found: ID does not exist"
Jul 28 15:27:23.812988 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:23.812954    2561 scope.go:117] "RemoveContainer" containerID="c1896827b907be10ab37bb7053271edab655fcec00a7868c02046151974d1488"
Jul 28 15:27:23.813216 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:27:23.813197    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1896827b907be10ab37bb7053271edab655fcec00a7868c02046151974d1488\": container with ID starting with c1896827b907be10ab37bb7053271edab655fcec00a7868c02046151974d1488 not found: ID does not exist" containerID="c1896827b907be10ab37bb7053271edab655fcec00a7868c02046151974d1488"
Jul 28 15:27:23.813299 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:23.813217    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1896827b907be10ab37bb7053271edab655fcec00a7868c02046151974d1488"} err="failed to get container status \"c1896827b907be10ab37bb7053271edab655fcec00a7868c02046151974d1488\": rpc error: code = NotFound desc = could not find container \"c1896827b907be10ab37bb7053271edab655fcec00a7868c02046151974d1488\": container with ID starting with c1896827b907be10ab37bb7053271edab655fcec00a7868c02046151974d1488 not found: ID does not exist"
Jul 28 15:27:23.813299 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:23.813230    2561 scope.go:117] "RemoveContainer" containerID="ecca36598f6169f69c890e19ded82f956e1b39f41b4ea30adccbb9aab700b2eb"
Jul 28 15:27:23.813443 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:23.813428    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ecca36598f6169f69c890e19ded82f956e1b39f41b4ea30adccbb9aab700b2eb"} err="failed to get container status \"ecca36598f6169f69c890e19ded82f956e1b39f41b4ea30adccbb9aab700b2eb\": rpc error: code = NotFound desc = could not find container \"ecca36598f6169f69c890e19ded82f956e1b39f41b4ea30adccbb9aab700b2eb\": container with ID starting with ecca36598f6169f69c890e19ded82f956e1b39f41b4ea30adccbb9aab700b2eb not found: ID does not exist"
Jul 28 15:27:23.813483 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:23.813444    2561 scope.go:117] "RemoveContainer" containerID="9072b1e4c9b31d80899f1d2eace461b2448ab0ca737374aaff8f783c451ec288"
Jul 28 15:27:23.813672 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:23.813656    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9072b1e4c9b31d80899f1d2eace461b2448ab0ca737374aaff8f783c451ec288"} err="failed to get container status \"9072b1e4c9b31d80899f1d2eace461b2448ab0ca737374aaff8f783c451ec288\": rpc error: code = NotFound desc = could not find container \"9072b1e4c9b31d80899f1d2eace461b2448ab0ca737374aaff8f783c451ec288\": container with ID starting with 9072b1e4c9b31d80899f1d2eace461b2448ab0ca737374aaff8f783c451ec288 not found: ID does not exist"
Jul 28 15:27:23.813714 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:23.813673    2561 scope.go:117] "RemoveContainer" containerID="860a9387fd546f2c9a9c96dee7727df48f4d7559e7cea88f5184a478fea84572"
Jul 28 15:27:23.813871 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:23.813854    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"860a9387fd546f2c9a9c96dee7727df48f4d7559e7cea88f5184a478fea84572"} err="failed to get container status \"860a9387fd546f2c9a9c96dee7727df48f4d7559e7cea88f5184a478fea84572\": rpc error: code = NotFound desc = could not find container \"860a9387fd546f2c9a9c96dee7727df48f4d7559e7cea88f5184a478fea84572\": container with ID starting with 860a9387fd546f2c9a9c96dee7727df48f4d7559e7cea88f5184a478fea84572 not found: ID does not exist"
Jul 28 15:27:23.813871 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:23.813871    2561 scope.go:117] "RemoveContainer" containerID="44716555493b253aaf6a3860008d2b5d1550d7fdb2b52fa7311fa30edf77f140"
Jul 28 15:27:23.814106 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:23.814072    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44716555493b253aaf6a3860008d2b5d1550d7fdb2b52fa7311fa30edf77f140"} err="failed to get container status \"44716555493b253aaf6a3860008d2b5d1550d7fdb2b52fa7311fa30edf77f140\": rpc error: code = NotFound desc = could not find container \"44716555493b253aaf6a3860008d2b5d1550d7fdb2b52fa7311fa30edf77f140\": container with ID starting with 44716555493b253aaf6a3860008d2b5d1550d7fdb2b52fa7311fa30edf77f140 not found: ID does not exist"
Jul 28 15:27:23.814106 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:23.814105    2561 scope.go:117] "RemoveContainer" containerID="c1896827b907be10ab37bb7053271edab655fcec00a7868c02046151974d1488"
Jul 28 15:27:23.814343 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:23.814327    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1896827b907be10ab37bb7053271edab655fcec00a7868c02046151974d1488"} err="failed to get container status \"c1896827b907be10ab37bb7053271edab655fcec00a7868c02046151974d1488\": rpc error: code = NotFound desc = could not find container \"c1896827b907be10ab37bb7053271edab655fcec00a7868c02046151974d1488\": container with ID starting with c1896827b907be10ab37bb7053271edab655fcec00a7868c02046151974d1488 not found: ID does not exist"
Jul 28 15:27:23.823986 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:23.822212    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zjwkq\" (UniqueName: \"kubernetes.io/projected/512449cc-8106-41dd-ae15-e96a04523522-kube-api-access-zjwkq\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:27:23.823986 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:23.822259    2561 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/512449cc-8106-41dd-ae15-e96a04523522-online-tls\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:27:23.823986 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:23.822282    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/512449cc-8106-41dd-ae15-e96a04523522-registry-tls\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:27:23.823986 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:23.822294    2561 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/512449cc-8106-41dd-ae15-e96a04523522-offline-tls\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:27:23.823986 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:23.822307    2561 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/512449cc-8106-41dd-ae15-e96a04523522-feast-data\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:27:25.409763 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:27:25.409728    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="512449cc-8106-41dd-ae15-e96a04523522" path="/var/lib/kubelet/pods/512449cc-8106-41dd-ae15-e96a04523522/volumes"
Jul 28 15:31:02.275600 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:02.275524    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-tqbts"]
Jul 28 15:31:02.278069 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:02.275963    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="512449cc-8106-41dd-ae15-e96a04523522" containerName="online"
Jul 28 15:31:02.278069 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:02.275989    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="512449cc-8106-41dd-ae15-e96a04523522" containerName="online"
Jul 28 15:31:02.278069 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:02.276017    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="512449cc-8106-41dd-ae15-e96a04523522" containerName="registry"
Jul 28 15:31:02.278069 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:02.276026    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="512449cc-8106-41dd-ae15-e96a04523522" containerName="registry"
Jul 28 15:31:02.278069 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:02.276038    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="512449cc-8106-41dd-ae15-e96a04523522" containerName="feast-apply"
Jul 28 15:31:02.278069 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:02.276047    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="512449cc-8106-41dd-ae15-e96a04523522" containerName="feast-apply"
Jul 28 15:31:02.278069 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:02.276060    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="512449cc-8106-41dd-ae15-e96a04523522" containerName="offline"
Jul 28 15:31:02.278069 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:02.276069    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="512449cc-8106-41dd-ae15-e96a04523522" containerName="offline"
Jul 28 15:31:02.278069 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:02.276080    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="512449cc-8106-41dd-ae15-e96a04523522" containerName="feast-init"
Jul 28 15:31:02.278069 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:02.276089    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="512449cc-8106-41dd-ae15-e96a04523522" containerName="feast-init"
Jul 28 15:31:02.278069 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:02.276102    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1469e29-3911-46da-82c8-394e15c3d7e6" containerName="postgres"
Jul 28 15:31:02.278069 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:02.276111    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1469e29-3911-46da-82c8-394e15c3d7e6" containerName="postgres"
Jul 28 15:31:02.278069 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:02.276181    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="512449cc-8106-41dd-ae15-e96a04523522" containerName="online"
Jul 28 15:31:02.278069 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:02.276193    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1469e29-3911-46da-82c8-394e15c3d7e6" containerName="postgres"
Jul 28 15:31:02.278069 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:02.276200    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="512449cc-8106-41dd-ae15-e96a04523522" containerName="offline"
Jul 28 15:31:02.278069 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:02.276211    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="512449cc-8106-41dd-ae15-e96a04523522" containerName="registry"
Jul 28 15:31:02.279112 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:02.279097    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-tqbts"
Jul 28 15:31:02.282317 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:02.282298    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"kube-root-ca.crt\""
Jul 28 15:31:02.283279 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:02.283248    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"default-dockercfg-ql27j\""
Jul 28 15:31:02.283368 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:02.283294    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"openshift-service-ca.crt\""
Jul 28 15:31:02.296345 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:02.296324    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-tqbts"]
Jul 28 15:31:02.323486 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:02.323456    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncghf\" (UniqueName: \"kubernetes.io/projected/d68aa55f-b735-46de-a1af-2c7d0c5ad0a9-kube-api-access-ncghf\") pod \"redis-69bbd798b6-tqbts\" (UID: \"d68aa55f-b735-46de-a1af-2c7d0c5ad0a9\") " pod="test-ns-feast-rest/redis-69bbd798b6-tqbts"
Jul 28 15:31:02.424021 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:02.423982    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncghf\" (UniqueName: \"kubernetes.io/projected/d68aa55f-b735-46de-a1af-2c7d0c5ad0a9-kube-api-access-ncghf\") pod \"redis-69bbd798b6-tqbts\" (UID: \"d68aa55f-b735-46de-a1af-2c7d0c5ad0a9\") " pod="test-ns-feast-rest/redis-69bbd798b6-tqbts"
Jul 28 15:31:02.434415 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:02.434392    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncghf\" (UniqueName: \"kubernetes.io/projected/d68aa55f-b735-46de-a1af-2c7d0c5ad0a9-kube-api-access-ncghf\") pod \"redis-69bbd798b6-tqbts\" (UID: \"d68aa55f-b735-46de-a1af-2c7d0c5ad0a9\") " pod="test-ns-feast-rest/redis-69bbd798b6-tqbts"
Jul 28 15:31:02.589982 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:02.589950    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-tqbts"
Jul 28 15:31:02.715294 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:02.715269    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-tqbts"]
Jul 28 15:31:02.717943 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:31:02.717918    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd68aa55f_b735_46de_a1af_2c7d0c5ad0a9.slice/crio-acb5a176a57c2694a336498804aa1588e04929214a442f3df021c76e07808676 WatchSource:0}: Error finding container acb5a176a57c2694a336498804aa1588e04929214a442f3df021c76e07808676: Status 404 returned error can't find the container with id acb5a176a57c2694a336498804aa1588e04929214a442f3df021c76e07808676
Jul 28 15:31:02.719651 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:02.719634    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 15:31:03.562057 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:03.562014    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-tqbts" event={"ID":"d68aa55f-b735-46de-a1af-2c7d0c5ad0a9","Type":"ContainerStarted","Data":"acb5a176a57c2694a336498804aa1588e04929214a442f3df021c76e07808676"}
Jul 28 15:31:04.567602 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:04.567564    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-tqbts" event={"ID":"d68aa55f-b735-46de-a1af-2c7d0c5ad0a9","Type":"ContainerStarted","Data":"07efe7147e9ef1460bdc36a865e11c0c02d8b334ca4b2b36584d5ce5b168cd01"}
Jul 28 15:31:04.586332 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:04.586288    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/redis-69bbd798b6-tqbts" podStartSLOduration=1.26921835 podStartE2EDuration="2.586273656s" totalImagesPullingTime="1.317055306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:31:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:31:04.585090247 +0000 UTC m=+1025.635458351" watchObservedRunningTime="2026-07-28 15:31:04.586273656 +0000 UTC m=+1025.636641761"
Jul 28 15:31:07.724566 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:07.724533    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-gs6p6"]
Jul 28 15:31:07.735101 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:07.735077    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-gs6p6"
Jul 28 15:31:07.736059 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:07.736032    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-gs6p6"]
Jul 28 15:31:07.738189 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:07.738170    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"postgres-secret\""
Jul 28 15:31:07.865033 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:07.865001    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6f9b2\" (UniqueName: \"kubernetes.io/projected/8a7ed55b-de78-4e61-bf09-dd84605068ef-kube-api-access-6f9b2\") pod \"postgres-864846d4f5-gs6p6\" (UID: \"8a7ed55b-de78-4e61-bf09-dd84605068ef\") " pod="test-ns-feast-rest/postgres-864846d4f5-gs6p6"
Jul 28 15:31:07.865033 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:07.865043    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/8a7ed55b-de78-4e61-bf09-dd84605068ef-postgresdata\") pod \"postgres-864846d4f5-gs6p6\" (UID: \"8a7ed55b-de78-4e61-bf09-dd84605068ef\") " pod="test-ns-feast-rest/postgres-864846d4f5-gs6p6"
Jul 28 15:31:07.965492 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:07.965462    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6f9b2\" (UniqueName: \"kubernetes.io/projected/8a7ed55b-de78-4e61-bf09-dd84605068ef-kube-api-access-6f9b2\") pod \"postgres-864846d4f5-gs6p6\" (UID: \"8a7ed55b-de78-4e61-bf09-dd84605068ef\") " pod="test-ns-feast-rest/postgres-864846d4f5-gs6p6"
Jul 28 15:31:07.965492 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:07.965495    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/8a7ed55b-de78-4e61-bf09-dd84605068ef-postgresdata\") pod \"postgres-864846d4f5-gs6p6\" (UID: \"8a7ed55b-de78-4e61-bf09-dd84605068ef\") " pod="test-ns-feast-rest/postgres-864846d4f5-gs6p6"
Jul 28 15:31:07.965808 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:07.965791    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/8a7ed55b-de78-4e61-bf09-dd84605068ef-postgresdata\") pod \"postgres-864846d4f5-gs6p6\" (UID: \"8a7ed55b-de78-4e61-bf09-dd84605068ef\") " pod="test-ns-feast-rest/postgres-864846d4f5-gs6p6"
Jul 28 15:31:07.975440 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:07.975381    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6f9b2\" (UniqueName: \"kubernetes.io/projected/8a7ed55b-de78-4e61-bf09-dd84605068ef-kube-api-access-6f9b2\") pod \"postgres-864846d4f5-gs6p6\" (UID: \"8a7ed55b-de78-4e61-bf09-dd84605068ef\") " pod="test-ns-feast-rest/postgres-864846d4f5-gs6p6"
Jul 28 15:31:08.045691 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:08.045668    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-gs6p6"
Jul 28 15:31:08.170605 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:08.170576    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-gs6p6"]
Jul 28 15:31:08.173022 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:31:08.172992    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a7ed55b_de78_4e61_bf09_dd84605068ef.slice/crio-11d3527a875aa82aa58b80a1128cf5ed520794309155d35d01b988c6f8633eb7 WatchSource:0}: Error finding container 11d3527a875aa82aa58b80a1128cf5ed520794309155d35d01b988c6f8633eb7: Status 404 returned error can't find the container with id 11d3527a875aa82aa58b80a1128cf5ed520794309155d35d01b988c6f8633eb7
Jul 28 15:31:08.584028 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:08.583986    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-gs6p6" event={"ID":"8a7ed55b-de78-4e61-bf09-dd84605068ef","Type":"ContainerStarted","Data":"b2357b35bedeca536f583f9515718bb24f2081fc6508f383427b1f0407758eae"}
Jul 28 15:31:08.584188 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:08.584050    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-gs6p6" event={"ID":"8a7ed55b-de78-4e61-bf09-dd84605068ef","Type":"ContainerStarted","Data":"11d3527a875aa82aa58b80a1128cf5ed520794309155d35d01b988c6f8633eb7"}
Jul 28 15:31:08.607254 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:08.607212    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/postgres-864846d4f5-gs6p6" podStartSLOduration=1.607195232 podStartE2EDuration="1.607195232s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:31:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:31:08.606979365 +0000 UTC m=+1029.657347470" watchObservedRunningTime="2026-07-28 15:31:08.607195232 +0000 UTC m=+1029.657563338"
Jul 28 15:31:13.321400 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:13.321369    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-55978c879c-zrp96"]
Jul 28 15:31:13.328070 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:13.328054    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-55978c879c-zrp96"
Jul 28 15:31:13.331010 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:13.330989    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-registry-tls\""
Jul 28 15:31:13.331775 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:13.331754    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-intra-comm\""
Jul 28 15:31:13.331934 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:13.331754    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-dockercfg-hc2pr\""
Jul 28 15:31:13.332009 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:13.331984    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-credit-scoring-online-tls\""
Jul 28 15:31:13.338045 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:13.338027    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-55978c879c-zrp96"]
Jul 28 15:31:13.408495 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:13.408462    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcvg4\" (UniqueName: \"kubernetes.io/projected/23ed641f-f1ec-4121-8e03-aa1633d49911-kube-api-access-jcvg4\") pod \"feast-credit-scoring-55978c879c-zrp96\" (UID: \"23ed641f-f1ec-4121-8e03-aa1633d49911\") " pod="test-ns-feast-rest/feast-credit-scoring-55978c879c-zrp96"
Jul 28 15:31:13.408662 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:13.408530    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/23ed641f-f1ec-4121-8e03-aa1633d49911-feast-data\") pod \"feast-credit-scoring-55978c879c-zrp96\" (UID: \"23ed641f-f1ec-4121-8e03-aa1633d49911\") " pod="test-ns-feast-rest/feast-credit-scoring-55978c879c-zrp96"
Jul 28 15:31:13.408662 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:13.408562    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/23ed641f-f1ec-4121-8e03-aa1633d49911-online-tls\") pod \"feast-credit-scoring-55978c879c-zrp96\" (UID: \"23ed641f-f1ec-4121-8e03-aa1633d49911\") " pod="test-ns-feast-rest/feast-credit-scoring-55978c879c-zrp96"
Jul 28 15:31:13.408662 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:13.408586    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/23ed641f-f1ec-4121-8e03-aa1633d49911-registry-tls\") pod \"feast-credit-scoring-55978c879c-zrp96\" (UID: \"23ed641f-f1ec-4121-8e03-aa1633d49911\") " pod="test-ns-feast-rest/feast-credit-scoring-55978c879c-zrp96"
Jul 28 15:31:13.509774 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:13.509741    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/23ed641f-f1ec-4121-8e03-aa1633d49911-feast-data\") pod \"feast-credit-scoring-55978c879c-zrp96\" (UID: \"23ed641f-f1ec-4121-8e03-aa1633d49911\") " pod="test-ns-feast-rest/feast-credit-scoring-55978c879c-zrp96"
Jul 28 15:31:13.509774 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:13.509777    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/23ed641f-f1ec-4121-8e03-aa1633d49911-online-tls\") pod \"feast-credit-scoring-55978c879c-zrp96\" (UID: \"23ed641f-f1ec-4121-8e03-aa1633d49911\") " pod="test-ns-feast-rest/feast-credit-scoring-55978c879c-zrp96"
Jul 28 15:31:13.510051 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:13.509802    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/23ed641f-f1ec-4121-8e03-aa1633d49911-registry-tls\") pod \"feast-credit-scoring-55978c879c-zrp96\" (UID: \"23ed641f-f1ec-4121-8e03-aa1633d49911\") " pod="test-ns-feast-rest/feast-credit-scoring-55978c879c-zrp96"
Jul 28 15:31:13.510051 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:13.509820    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcvg4\" (UniqueName: \"kubernetes.io/projected/23ed641f-f1ec-4121-8e03-aa1633d49911-kube-api-access-jcvg4\") pod \"feast-credit-scoring-55978c879c-zrp96\" (UID: \"23ed641f-f1ec-4121-8e03-aa1633d49911\") " pod="test-ns-feast-rest/feast-credit-scoring-55978c879c-zrp96"
Jul 28 15:31:13.510242 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:13.510221    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/23ed641f-f1ec-4121-8e03-aa1633d49911-feast-data\") pod \"feast-credit-scoring-55978c879c-zrp96\" (UID: \"23ed641f-f1ec-4121-8e03-aa1633d49911\") " pod="test-ns-feast-rest/feast-credit-scoring-55978c879c-zrp96"
Jul 28 15:31:13.512344 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:13.512318    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/23ed641f-f1ec-4121-8e03-aa1633d49911-online-tls\") pod \"feast-credit-scoring-55978c879c-zrp96\" (UID: \"23ed641f-f1ec-4121-8e03-aa1633d49911\") " pod="test-ns-feast-rest/feast-credit-scoring-55978c879c-zrp96"
Jul 28 15:31:13.512440 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:13.512366    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/23ed641f-f1ec-4121-8e03-aa1633d49911-registry-tls\") pod \"feast-credit-scoring-55978c879c-zrp96\" (UID: \"23ed641f-f1ec-4121-8e03-aa1633d49911\") " pod="test-ns-feast-rest/feast-credit-scoring-55978c879c-zrp96"
Jul 28 15:31:13.519554 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:13.519528    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcvg4\" (UniqueName: \"kubernetes.io/projected/23ed641f-f1ec-4121-8e03-aa1633d49911-kube-api-access-jcvg4\") pod \"feast-credit-scoring-55978c879c-zrp96\" (UID: \"23ed641f-f1ec-4121-8e03-aa1633d49911\") " pod="test-ns-feast-rest/feast-credit-scoring-55978c879c-zrp96"
Jul 28 15:31:13.638228 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:13.638197    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-55978c879c-zrp96"
Jul 28 15:31:13.779898 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:13.779859    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-55978c879c-zrp96"]
Jul 28 15:31:13.783481 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:31:13.783453    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23ed641f_f1ec_4121_8e03_aa1633d49911.slice/crio-dea57eb7a38644b2261b0237d944a30cbe641ed0a822a78a934ac39fc26301d3 WatchSource:0}: Error finding container dea57eb7a38644b2261b0237d944a30cbe641ed0a822a78a934ac39fc26301d3: Status 404 returned error can't find the container with id dea57eb7a38644b2261b0237d944a30cbe641ed0a822a78a934ac39fc26301d3
Jul 28 15:31:14.609931 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:14.609895    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-55978c879c-zrp96" event={"ID":"23ed641f-f1ec-4121-8e03-aa1633d49911","Type":"ContainerStarted","Data":"eb083108fc0a5831bf20759dfcd405bdc2c94789cf0cbf06ce933fe928dec30c"}
Jul 28 15:31:14.610329 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:14.609943    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-55978c879c-zrp96" event={"ID":"23ed641f-f1ec-4121-8e03-aa1633d49911","Type":"ContainerStarted","Data":"dea57eb7a38644b2261b0237d944a30cbe641ed0a822a78a934ac39fc26301d3"}
Jul 28 15:31:15.615266 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:15.615227    2561 generic.go:356] "Generic (PLEG): container finished" podID="23ed641f-f1ec-4121-8e03-aa1633d49911" containerID="eb083108fc0a5831bf20759dfcd405bdc2c94789cf0cbf06ce933fe928dec30c" exitCode=0
Jul 28 15:31:15.615653 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:15.615300    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-55978c879c-zrp96" event={"ID":"23ed641f-f1ec-4121-8e03-aa1633d49911","Type":"ContainerDied","Data":"eb083108fc0a5831bf20759dfcd405bdc2c94789cf0cbf06ce933fe928dec30c"}
Jul 28 15:31:16.621118 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:16.621083    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-55978c879c-zrp96" event={"ID":"23ed641f-f1ec-4121-8e03-aa1633d49911","Type":"ContainerStarted","Data":"8538cdd3670f461ecfe31594a8e17723144ae860659db11dd67bea8c0d1e7810"}
Jul 28 15:31:22.645943 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:22.645909    2561 generic.go:356] "Generic (PLEG): container finished" podID="23ed641f-f1ec-4121-8e03-aa1633d49911" containerID="8538cdd3670f461ecfe31594a8e17723144ae860659db11dd67bea8c0d1e7810" exitCode=0
Jul 28 15:31:22.646311 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:22.645982    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-55978c879c-zrp96" event={"ID":"23ed641f-f1ec-4121-8e03-aa1633d49911","Type":"ContainerDied","Data":"8538cdd3670f461ecfe31594a8e17723144ae860659db11dd67bea8c0d1e7810"}
Jul 28 15:31:23.653701 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:23.653666    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-55978c879c-zrp96" event={"ID":"23ed641f-f1ec-4121-8e03-aa1633d49911","Type":"ContainerStarted","Data":"2d45facf92cd91aaaa661662c35f71c483fd65d959c6b7ace6a7467065383abd"}
Jul 28 15:31:23.654217 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:23.653715    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-55978c879c-zrp96" event={"ID":"23ed641f-f1ec-4121-8e03-aa1633d49911","Type":"ContainerStarted","Data":"55c7531dd6b5e1b9a36f19d415d3470746653116c4c0ae4c03ff032c52821b66"}
Jul 28 15:31:23.682144 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:23.682084    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-credit-scoring-55978c879c-zrp96" podStartSLOduration=10.682064822 podStartE2EDuration="10.682064822s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:31:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:31:23.679229458 +0000 UTC m=+1044.729597576" watchObservedRunningTime="2026-07-28 15:31:23.682064822 +0000 UTC m=+1044.732432928"
Jul 28 15:31:25.639101 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:25.639052    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-55978c879c-zrp96"
Jul 28 15:31:25.639605 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:25.639120    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-credit-scoring-55978c879c-zrp96"
Jul 28 15:31:25.640604 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:25.640568    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-55978c879c-zrp96" podUID="23ed641f-f1ec-4121-8e03-aa1633d49911" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.29:6571: connect: connection refused"
Jul 28 15:31:25.640725 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:25.640618    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-55978c879c-zrp96" podUID="23ed641f-f1ec-4121-8e03-aa1633d49911" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused"
Jul 28 15:31:28.638756 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:28.638694    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-55978c879c-zrp96" podUID="23ed641f-f1ec-4121-8e03-aa1633d49911" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.29:6571: connect: connection refused"
Jul 28 15:31:28.892425 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:28.892348    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-55978c879c-zrp96"
Jul 28 15:31:28.892843 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:28.892795    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-55978c879c-zrp96"
Jul 28 15:31:28.896847 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:28.896813    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-55978c879c-zrp96"
Jul 28 15:31:31.639358 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:31.639306    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-credit-scoring-55978c879c-zrp96" podUID="23ed641f-f1ec-4121-8e03-aa1633d49911" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.29:6571: connect: connection refused"
Jul 28 15:31:33.639428 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:33.639396    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-55978c879c-zrp96"
Jul 28 15:31:34.639359 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:34.639329    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-credit-scoring-55978c879c-zrp96"
Jul 28 15:31:34.639981 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:34.639963    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-credit-scoring-55978c879c-zrp96"
Jul 28 15:31:39.193352 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:39.193313    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5fd7598c98-h5bgr"]
Jul 28 15:31:39.196964 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:39.196949    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-5fd7598c98-h5bgr"
Jul 28 15:31:39.199679 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:39.199653    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-online-tls\""
Jul 28 15:31:39.199807 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:39.199756    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-registry-tls\""
Jul 28 15:31:39.199807 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:39.199790    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-dockercfg-fq5v9\""
Jul 28 15:31:39.199953 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:39.199923    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast-rest\"/\"feast-driver-ranking-intra-comm\""
Jul 28 15:31:39.209036 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:39.209016    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5fd7598c98-h5bgr"]
Jul 28 15:31:39.324101 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:39.324070    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gwbj\" (UniqueName: \"kubernetes.io/projected/922c1d44-7344-4a0c-b650-e78bdb21325c-kube-api-access-8gwbj\") pod \"feast-driver-ranking-5fd7598c98-h5bgr\" (UID: \"922c1d44-7344-4a0c-b650-e78bdb21325c\") " pod="test-ns-feast-rest/feast-driver-ranking-5fd7598c98-h5bgr"
Jul 28 15:31:39.324266 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:39.324110    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/922c1d44-7344-4a0c-b650-e78bdb21325c-registry-tls\") pod \"feast-driver-ranking-5fd7598c98-h5bgr\" (UID: \"922c1d44-7344-4a0c-b650-e78bdb21325c\") " pod="test-ns-feast-rest/feast-driver-ranking-5fd7598c98-h5bgr"
Jul 28 15:31:39.324266 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:39.324134    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/922c1d44-7344-4a0c-b650-e78bdb21325c-feast-data\") pod \"feast-driver-ranking-5fd7598c98-h5bgr\" (UID: \"922c1d44-7344-4a0c-b650-e78bdb21325c\") " pod="test-ns-feast-rest/feast-driver-ranking-5fd7598c98-h5bgr"
Jul 28 15:31:39.324266 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:39.324232    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/922c1d44-7344-4a0c-b650-e78bdb21325c-online-tls\") pod \"feast-driver-ranking-5fd7598c98-h5bgr\" (UID: \"922c1d44-7344-4a0c-b650-e78bdb21325c\") " pod="test-ns-feast-rest/feast-driver-ranking-5fd7598c98-h5bgr"
Jul 28 15:31:39.425551 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:39.425519    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gwbj\" (UniqueName: \"kubernetes.io/projected/922c1d44-7344-4a0c-b650-e78bdb21325c-kube-api-access-8gwbj\") pod \"feast-driver-ranking-5fd7598c98-h5bgr\" (UID: \"922c1d44-7344-4a0c-b650-e78bdb21325c\") " pod="test-ns-feast-rest/feast-driver-ranking-5fd7598c98-h5bgr"
Jul 28 15:31:39.425551 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:39.425558    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/922c1d44-7344-4a0c-b650-e78bdb21325c-registry-tls\") pod \"feast-driver-ranking-5fd7598c98-h5bgr\" (UID: \"922c1d44-7344-4a0c-b650-e78bdb21325c\") " pod="test-ns-feast-rest/feast-driver-ranking-5fd7598c98-h5bgr"
Jul 28 15:31:39.425768 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:39.425583    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/922c1d44-7344-4a0c-b650-e78bdb21325c-feast-data\") pod \"feast-driver-ranking-5fd7598c98-h5bgr\" (UID: \"922c1d44-7344-4a0c-b650-e78bdb21325c\") " pod="test-ns-feast-rest/feast-driver-ranking-5fd7598c98-h5bgr"
Jul 28 15:31:39.425768 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:39.425622    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/922c1d44-7344-4a0c-b650-e78bdb21325c-online-tls\") pod \"feast-driver-ranking-5fd7598c98-h5bgr\" (UID: \"922c1d44-7344-4a0c-b650-e78bdb21325c\") " pod="test-ns-feast-rest/feast-driver-ranking-5fd7598c98-h5bgr"
Jul 28 15:31:39.426068 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:39.426044    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/922c1d44-7344-4a0c-b650-e78bdb21325c-feast-data\") pod \"feast-driver-ranking-5fd7598c98-h5bgr\" (UID: \"922c1d44-7344-4a0c-b650-e78bdb21325c\") " pod="test-ns-feast-rest/feast-driver-ranking-5fd7598c98-h5bgr"
Jul 28 15:31:39.427915 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:39.427891    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/922c1d44-7344-4a0c-b650-e78bdb21325c-registry-tls\") pod \"feast-driver-ranking-5fd7598c98-h5bgr\" (UID: \"922c1d44-7344-4a0c-b650-e78bdb21325c\") " pod="test-ns-feast-rest/feast-driver-ranking-5fd7598c98-h5bgr"
Jul 28 15:31:39.428014 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:39.427998    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/922c1d44-7344-4a0c-b650-e78bdb21325c-online-tls\") pod \"feast-driver-ranking-5fd7598c98-h5bgr\" (UID: \"922c1d44-7344-4a0c-b650-e78bdb21325c\") " pod="test-ns-feast-rest/feast-driver-ranking-5fd7598c98-h5bgr"
Jul 28 15:31:39.434155 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:39.434132    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gwbj\" (UniqueName: \"kubernetes.io/projected/922c1d44-7344-4a0c-b650-e78bdb21325c-kube-api-access-8gwbj\") pod \"feast-driver-ranking-5fd7598c98-h5bgr\" (UID: \"922c1d44-7344-4a0c-b650-e78bdb21325c\") " pod="test-ns-feast-rest/feast-driver-ranking-5fd7598c98-h5bgr"
Jul 28 15:31:39.506553 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:39.506489    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-5fd7598c98-h5bgr"
Jul 28 15:31:39.642017 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:39.641996    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5fd7598c98-h5bgr"]
Jul 28 15:31:39.643772 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:31:39.643739    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod922c1d44_7344_4a0c_b650_e78bdb21325c.slice/crio-b57aec7c422c281c144b0a2fe65d4fedc1bebdca6e7036796956d1b37203d023 WatchSource:0}: Error finding container b57aec7c422c281c144b0a2fe65d4fedc1bebdca6e7036796956d1b37203d023: Status 404 returned error can't find the container with id b57aec7c422c281c144b0a2fe65d4fedc1bebdca6e7036796956d1b37203d023
Jul 28 15:31:39.721749 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:39.721715    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5fd7598c98-h5bgr" event={"ID":"922c1d44-7344-4a0c-b650-e78bdb21325c","Type":"ContainerStarted","Data":"77dd8306e205f587790c8a174978e39fb9156b34bc7f4dfb4a23b10acda22820"}
Jul 28 15:31:39.721905 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:39.721772    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5fd7598c98-h5bgr" event={"ID":"922c1d44-7344-4a0c-b650-e78bdb21325c","Type":"ContainerStarted","Data":"b57aec7c422c281c144b0a2fe65d4fedc1bebdca6e7036796956d1b37203d023"}
Jul 28 15:31:44.743759 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:44.743670    2561 generic.go:356] "Generic (PLEG): container finished" podID="922c1d44-7344-4a0c-b650-e78bdb21325c" containerID="77dd8306e205f587790c8a174978e39fb9156b34bc7f4dfb4a23b10acda22820" exitCode=0
Jul 28 15:31:44.743759 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:44.743723    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5fd7598c98-h5bgr" event={"ID":"922c1d44-7344-4a0c-b650-e78bdb21325c","Type":"ContainerDied","Data":"77dd8306e205f587790c8a174978e39fb9156b34bc7f4dfb4a23b10acda22820"}
Jul 28 15:31:45.749304 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:45.749269    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5fd7598c98-h5bgr" event={"ID":"922c1d44-7344-4a0c-b650-e78bdb21325c","Type":"ContainerStarted","Data":"c93e8c9139e48e1574e17522a7cec6a380dc03c5e3fb058433b8263886790068"}
Jul 28 15:31:51.775360 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:51.775280    2561 generic.go:356] "Generic (PLEG): container finished" podID="922c1d44-7344-4a0c-b650-e78bdb21325c" containerID="c93e8c9139e48e1574e17522a7cec6a380dc03c5e3fb058433b8263886790068" exitCode=0
Jul 28 15:31:51.775360 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:51.775341    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5fd7598c98-h5bgr" event={"ID":"922c1d44-7344-4a0c-b650-e78bdb21325c","Type":"ContainerDied","Data":"c93e8c9139e48e1574e17522a7cec6a380dc03c5e3fb058433b8263886790068"}
Jul 28 15:31:52.782479 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:52.782431    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5fd7598c98-h5bgr" event={"ID":"922c1d44-7344-4a0c-b650-e78bdb21325c","Type":"ContainerStarted","Data":"a2e8278e1010f6f72fa4509acacd5399d7f8a7cb196852c4479dd8822e4a78a6"}
Jul 28 15:31:52.782479 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:52.782483    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5fd7598c98-h5bgr" event={"ID":"922c1d44-7344-4a0c-b650-e78bdb21325c","Type":"ContainerStarted","Data":"579ec048d76e7156f1f945a1d15daa13d7429078a0b0b899c6ecaf847522e654"}
Jul 28 15:31:52.825474 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:52.825417    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast-rest/feast-driver-ranking-5fd7598c98-h5bgr" podStartSLOduration=13.825394528 podStartE2EDuration="13.825394528s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:31:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:31:52.825245759 +0000 UTC m=+1073.875613864" watchObservedRunningTime="2026-07-28 15:31:52.825394528 +0000 UTC m=+1073.875762633"
Jul 28 15:31:54.506976 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:54.506937    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-5fd7598c98-h5bgr"
Jul 28 15:31:54.507385 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:54.507002    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast-rest/feast-driver-ranking-5fd7598c98-h5bgr"
Jul 28 15:31:54.508623 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:54.508595    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-5fd7598c98-h5bgr" podUID="922c1d44-7344-4a0c-b650-e78bdb21325c" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.30:6571: connect: connection refused"
Jul 28 15:31:54.508716 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:54.508631    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-5fd7598c98-h5bgr" podUID="922c1d44-7344-4a0c-b650-e78bdb21325c" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused"
Jul 28 15:31:57.507575 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:57.507527    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-5fd7598c98-h5bgr" podUID="922c1d44-7344-4a0c-b650-e78bdb21325c" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.30:6571: connect: connection refused"
Jul 28 15:31:57.970410 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:57.970376    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-5fd7598c98-h5bgr"
Jul 28 15:31:57.970860 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:57.970809    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-5fd7598c98-h5bgr"
Jul 28 15:31:57.973801 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:57.973779    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-5fd7598c98-h5bgr"
Jul 28 15:31:59.507462 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:31:59.507421    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-5fd7598c98-h5bgr"
Jul 28 15:32:00.507655 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:32:00.507619    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast-rest/feast-driver-ranking-5fd7598c98-h5bgr" podUID="922c1d44-7344-4a0c-b650-e78bdb21325c" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.30:6571: connect: connection refused"
Jul 28 15:32:03.508093 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:32:03.508060    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast-rest/feast-driver-ranking-5fd7598c98-h5bgr"
Jul 28 15:32:03.508792 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:32:03.508771    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast-rest/feast-driver-ranking-5fd7598c98-h5bgr"
Jul 28 15:33:18.971630 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:18.971598    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-79645955c-jzfj2"]
Jul 28 15:33:18.972126 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:18.971788    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="feast-operator-system/feast-operator-controller-manager-79645955c-jzfj2" podUID="65de8a0c-4de4-4fcd-9e81-eb44b3b543ce" containerName="manager" containerID="cri-o://cad52e7d78b3c62f97332d2ef6e5c127960c743fe08ecef29be60f7dff956e86" gracePeriod=10
Jul 28 15:33:19.147009 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:19.146979    2561 generic.go:356] "Generic (PLEG): container finished" podID="65de8a0c-4de4-4fcd-9e81-eb44b3b543ce" containerID="cad52e7d78b3c62f97332d2ef6e5c127960c743fe08ecef29be60f7dff956e86" exitCode=0
Jul 28 15:33:19.147166 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:19.147058    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-79645955c-jzfj2" event={"ID":"65de8a0c-4de4-4fcd-9e81-eb44b3b543ce","Type":"ContainerDied","Data":"cad52e7d78b3c62f97332d2ef6e5c127960c743fe08ecef29be60f7dff956e86"}
Jul 28 15:33:19.245524 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:19.245494    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-79645955c-jzfj2"
Jul 28 15:33:19.344512 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:19.344480    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-55978c879c-zrp96"]
Jul 28 15:33:19.344743 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:19.344689    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-55978c879c-zrp96" podUID="23ed641f-f1ec-4121-8e03-aa1633d49911" containerName="registry" containerID="cri-o://55c7531dd6b5e1b9a36f19d415d3470746653116c4c0ae4c03ff032c52821b66" gracePeriod=30
Jul 28 15:33:19.344924 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:19.344739    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-credit-scoring-55978c879c-zrp96" podUID="23ed641f-f1ec-4121-8e03-aa1633d49911" containerName="online" containerID="cri-o://2d45facf92cd91aaaa661662c35f71c483fd65d959c6b7ace6a7467065383abd" gracePeriod=30
Jul 28 15:33:19.357776 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:19.357753    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5fd7598c98-h5bgr"]
Jul 28 15:33:19.358006 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:19.357985    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-5fd7598c98-h5bgr" podUID="922c1d44-7344-4a0c-b650-e78bdb21325c" containerName="registry" containerID="cri-o://579ec048d76e7156f1f945a1d15daa13d7429078a0b0b899c6ecaf847522e654" gracePeriod=30
Jul 28 15:33:19.358099 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:19.358017    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/feast-driver-ranking-5fd7598c98-h5bgr" podUID="922c1d44-7344-4a0c-b650-e78bdb21325c" containerName="online" containerID="cri-o://a2e8278e1010f6f72fa4509acacd5399d7f8a7cb196852c4479dd8822e4a78a6" gracePeriod=30
Jul 28 15:33:19.378606 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:19.378580    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kgthg\" (UniqueName: \"kubernetes.io/projected/65de8a0c-4de4-4fcd-9e81-eb44b3b543ce-kube-api-access-kgthg\") pod \"65de8a0c-4de4-4fcd-9e81-eb44b3b543ce\" (UID: \"65de8a0c-4de4-4fcd-9e81-eb44b3b543ce\") "
Jul 28 15:33:19.380557 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:19.380537    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65de8a0c-4de4-4fcd-9e81-eb44b3b543ce-kube-api-access-kgthg" (OuterVolumeSpecName: "kube-api-access-kgthg") pod "65de8a0c-4de4-4fcd-9e81-eb44b3b543ce" (UID: "65de8a0c-4de4-4fcd-9e81-eb44b3b543ce"). InnerVolumeSpecName "kube-api-access-kgthg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 15:33:19.479657 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:19.479598    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgthg\" (UniqueName: \"kubernetes.io/projected/65de8a0c-4de4-4fcd-9e81-eb44b3b543ce-kube-api-access-kgthg\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:33:20.060772 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:33:20.060725    2561 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod922c1d44_7344_4a0c_b650_e78bdb21325c.slice/crio-conmon-a2e8278e1010f6f72fa4509acacd5399d7f8a7cb196852c4479dd8822e4a78a6.scope\": RecentStats: unable to find data in memory cache]"
Jul 28 15:33:20.152422 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:20.152397    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="feast-operator-system/feast-operator-controller-manager-79645955c-jzfj2"
Jul 28 15:33:20.152550 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:20.152421    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="feast-operator-system/feast-operator-controller-manager-79645955c-jzfj2" event={"ID":"65de8a0c-4de4-4fcd-9e81-eb44b3b543ce","Type":"ContainerDied","Data":"b962d8d5277356fff7e90ef531e0ce99a67f815c71634b045407dab250a7e0e9"}
Jul 28 15:33:20.152550 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:20.152489    2561 scope.go:117] "RemoveContainer" containerID="cad52e7d78b3c62f97332d2ef6e5c127960c743fe08ecef29be60f7dff956e86"
Jul 28 15:33:20.155254 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:20.155230    2561 generic.go:356] "Generic (PLEG): container finished" podID="922c1d44-7344-4a0c-b650-e78bdb21325c" containerID="a2e8278e1010f6f72fa4509acacd5399d7f8a7cb196852c4479dd8822e4a78a6" exitCode=0
Jul 28 15:33:20.155351 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:20.155289    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5fd7598c98-h5bgr" event={"ID":"922c1d44-7344-4a0c-b650-e78bdb21325c","Type":"ContainerDied","Data":"a2e8278e1010f6f72fa4509acacd5399d7f8a7cb196852c4479dd8822e4a78a6"}
Jul 28 15:33:20.171306 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:20.171283    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-79645955c-jzfj2"]
Jul 28 15:33:20.175874 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:20.175814    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["feast-operator-system/feast-operator-controller-manager-79645955c-jzfj2"]
Jul 28 15:33:20.415319 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:20.415285    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-gs6p6"]
Jul 28 15:33:20.415514 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:20.415490    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/postgres-864846d4f5-gs6p6" podUID="8a7ed55b-de78-4e61-bf09-dd84605068ef" containerName="postgres" containerID="cri-o://b2357b35bedeca536f583f9515718bb24f2081fc6508f383427b1f0407758eae" gracePeriod=30
Jul 28 15:33:20.423053 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:20.422527    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-tqbts"]
Jul 28 15:33:20.423053 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:20.422706    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast-rest/redis-69bbd798b6-tqbts" podUID="d68aa55f-b735-46de-a1af-2c7d0c5ad0a9" containerName="redis" containerID="cri-o://07efe7147e9ef1460bdc36a865e11c0c02d8b334ca4b2b36584d5ce5b168cd01" gracePeriod=30
Jul 28 15:33:20.673296 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:20.673269    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-gs6p6"
Jul 28 15:33:20.680499 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:20.680479    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-tqbts"
Jul 28 15:33:20.789400 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:20.789370    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/8a7ed55b-de78-4e61-bf09-dd84605068ef-postgresdata\") pod \"8a7ed55b-de78-4e61-bf09-dd84605068ef\" (UID: \"8a7ed55b-de78-4e61-bf09-dd84605068ef\") "
Jul 28 15:33:20.789589 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:20.789447    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ncghf\" (UniqueName: \"kubernetes.io/projected/d68aa55f-b735-46de-a1af-2c7d0c5ad0a9-kube-api-access-ncghf\") pod \"d68aa55f-b735-46de-a1af-2c7d0c5ad0a9\" (UID: \"d68aa55f-b735-46de-a1af-2c7d0c5ad0a9\") "
Jul 28 15:33:20.789589 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:20.789485    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6f9b2\" (UniqueName: \"kubernetes.io/projected/8a7ed55b-de78-4e61-bf09-dd84605068ef-kube-api-access-6f9b2\") pod \"8a7ed55b-de78-4e61-bf09-dd84605068ef\" (UID: \"8a7ed55b-de78-4e61-bf09-dd84605068ef\") "
Jul 28 15:33:20.791609 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:20.791578    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d68aa55f-b735-46de-a1af-2c7d0c5ad0a9-kube-api-access-ncghf" (OuterVolumeSpecName: "kube-api-access-ncghf") pod "d68aa55f-b735-46de-a1af-2c7d0c5ad0a9" (UID: "d68aa55f-b735-46de-a1af-2c7d0c5ad0a9"). InnerVolumeSpecName "kube-api-access-ncghf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 15:33:20.791721 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:20.791612    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8a7ed55b-de78-4e61-bf09-dd84605068ef-kube-api-access-6f9b2" (OuterVolumeSpecName: "kube-api-access-6f9b2") pod "8a7ed55b-de78-4e61-bf09-dd84605068ef" (UID: "8a7ed55b-de78-4e61-bf09-dd84605068ef"). InnerVolumeSpecName "kube-api-access-6f9b2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 15:33:20.818464 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:20.818437    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8a7ed55b-de78-4e61-bf09-dd84605068ef-postgresdata" (OuterVolumeSpecName: "postgresdata") pod "8a7ed55b-de78-4e61-bf09-dd84605068ef" (UID: "8a7ed55b-de78-4e61-bf09-dd84605068ef"). InnerVolumeSpecName "postgresdata". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 15:33:20.890964 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:20.890939    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ncghf\" (UniqueName: \"kubernetes.io/projected/d68aa55f-b735-46de-a1af-2c7d0c5ad0a9-kube-api-access-ncghf\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:33:20.890964 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:20.890963    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6f9b2\" (UniqueName: \"kubernetes.io/projected/8a7ed55b-de78-4e61-bf09-dd84605068ef-kube-api-access-6f9b2\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:33:20.891107 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:20.890973    2561 reconciler_common.go:299] "Volume detached for volume \"postgresdata\" (UniqueName: \"kubernetes.io/empty-dir/8a7ed55b-de78-4e61-bf09-dd84605068ef-postgresdata\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:33:21.161052 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:21.161025    2561 generic.go:356] "Generic (PLEG): container finished" podID="d68aa55f-b735-46de-a1af-2c7d0c5ad0a9" containerID="07efe7147e9ef1460bdc36a865e11c0c02d8b334ca4b2b36584d5ce5b168cd01" exitCode=0
Jul 28 15:33:21.161472 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:21.161065    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/redis-69bbd798b6-tqbts"
Jul 28 15:33:21.161472 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:21.161100    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-tqbts" event={"ID":"d68aa55f-b735-46de-a1af-2c7d0c5ad0a9","Type":"ContainerDied","Data":"07efe7147e9ef1460bdc36a865e11c0c02d8b334ca4b2b36584d5ce5b168cd01"}
Jul 28 15:33:21.161472 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:21.161133    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/redis-69bbd798b6-tqbts" event={"ID":"d68aa55f-b735-46de-a1af-2c7d0c5ad0a9","Type":"ContainerDied","Data":"acb5a176a57c2694a336498804aa1588e04929214a442f3df021c76e07808676"}
Jul 28 15:33:21.161472 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:21.161150    2561 scope.go:117] "RemoveContainer" containerID="07efe7147e9ef1460bdc36a865e11c0c02d8b334ca4b2b36584d5ce5b168cd01"
Jul 28 15:33:21.163571 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:21.163550    2561 generic.go:356] "Generic (PLEG): container finished" podID="23ed641f-f1ec-4121-8e03-aa1633d49911" containerID="2d45facf92cd91aaaa661662c35f71c483fd65d959c6b7ace6a7467065383abd" exitCode=0
Jul 28 15:33:21.163681 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:21.163621    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-55978c879c-zrp96" event={"ID":"23ed641f-f1ec-4121-8e03-aa1633d49911","Type":"ContainerDied","Data":"2d45facf92cd91aaaa661662c35f71c483fd65d959c6b7ace6a7467065383abd"}
Jul 28 15:33:21.164879 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:21.164859    2561 generic.go:356] "Generic (PLEG): container finished" podID="8a7ed55b-de78-4e61-bf09-dd84605068ef" containerID="b2357b35bedeca536f583f9515718bb24f2081fc6508f383427b1f0407758eae" exitCode=0
Jul 28 15:33:21.164979 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:21.164893    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/postgres-864846d4f5-gs6p6"
Jul 28 15:33:21.164979 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:21.164895    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-gs6p6" event={"ID":"8a7ed55b-de78-4e61-bf09-dd84605068ef","Type":"ContainerDied","Data":"b2357b35bedeca536f583f9515718bb24f2081fc6508f383427b1f0407758eae"}
Jul 28 15:33:21.164979 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:21.164922    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/postgres-864846d4f5-gs6p6" event={"ID":"8a7ed55b-de78-4e61-bf09-dd84605068ef","Type":"ContainerDied","Data":"11d3527a875aa82aa58b80a1128cf5ed520794309155d35d01b988c6f8633eb7"}
Jul 28 15:33:21.170380 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:21.170227    2561 scope.go:117] "RemoveContainer" containerID="07efe7147e9ef1460bdc36a865e11c0c02d8b334ca4b2b36584d5ce5b168cd01"
Jul 28 15:33:21.170633 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:33:21.170604    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"07efe7147e9ef1460bdc36a865e11c0c02d8b334ca4b2b36584d5ce5b168cd01\": container with ID starting with 07efe7147e9ef1460bdc36a865e11c0c02d8b334ca4b2b36584d5ce5b168cd01 not found: ID does not exist" containerID="07efe7147e9ef1460bdc36a865e11c0c02d8b334ca4b2b36584d5ce5b168cd01"
Jul 28 15:33:21.170737 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:21.170642    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"07efe7147e9ef1460bdc36a865e11c0c02d8b334ca4b2b36584d5ce5b168cd01"} err="failed to get container status \"07efe7147e9ef1460bdc36a865e11c0c02d8b334ca4b2b36584d5ce5b168cd01\": rpc error: code = NotFound desc = could not find container \"07efe7147e9ef1460bdc36a865e11c0c02d8b334ca4b2b36584d5ce5b168cd01\": container with ID starting with 07efe7147e9ef1460bdc36a865e11c0c02d8b334ca4b2b36584d5ce5b168cd01 not found: ID does not exist"
Jul 28 15:33:21.170737 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:21.170665    2561 scope.go:117] "RemoveContainer" containerID="b2357b35bedeca536f583f9515718bb24f2081fc6508f383427b1f0407758eae"
Jul 28 15:33:21.178227 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:21.178213    2561 scope.go:117] "RemoveContainer" containerID="b2357b35bedeca536f583f9515718bb24f2081fc6508f383427b1f0407758eae"
Jul 28 15:33:21.178446 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:33:21.178429    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b2357b35bedeca536f583f9515718bb24f2081fc6508f383427b1f0407758eae\": container with ID starting with b2357b35bedeca536f583f9515718bb24f2081fc6508f383427b1f0407758eae not found: ID does not exist" containerID="b2357b35bedeca536f583f9515718bb24f2081fc6508f383427b1f0407758eae"
Jul 28 15:33:21.178541 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:21.178451    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b2357b35bedeca536f583f9515718bb24f2081fc6508f383427b1f0407758eae"} err="failed to get container status \"b2357b35bedeca536f583f9515718bb24f2081fc6508f383427b1f0407758eae\": rpc error: code = NotFound desc = could not find container \"b2357b35bedeca536f583f9515718bb24f2081fc6508f383427b1f0407758eae\": container with ID starting with b2357b35bedeca536f583f9515718bb24f2081fc6508f383427b1f0407758eae not found: ID does not exist"
Jul 28 15:33:21.186980 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:21.186959    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-tqbts"]
Jul 28 15:33:21.194081 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:21.194059    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/redis-69bbd798b6-tqbts"]
Jul 28 15:33:21.208093 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:21.208070    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-gs6p6"]
Jul 28 15:33:21.212934 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:21.212916    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/postgres-864846d4f5-gs6p6"]
Jul 28 15:33:21.410692 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:21.410661    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65de8a0c-4de4-4fcd-9e81-eb44b3b543ce" path="/var/lib/kubelet/pods/65de8a0c-4de4-4fcd-9e81-eb44b3b543ce/volumes"
Jul 28 15:33:21.411011 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:21.410997    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8a7ed55b-de78-4e61-bf09-dd84605068ef" path="/var/lib/kubelet/pods/8a7ed55b-de78-4e61-bf09-dd84605068ef/volumes"
Jul 28 15:33:21.411263 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:21.411253    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d68aa55f-b735-46de-a1af-2c7d0c5ad0a9" path="/var/lib/kubelet/pods/d68aa55f-b735-46de-a1af-2c7d0c5ad0a9/volumes"
Jul 28 15:33:27.971045 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:27.971007    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-5fd7598c98-h5bgr" podUID="922c1d44-7344-4a0c-b650-e78bdb21325c" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused"
Jul 28 15:33:28.893691 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:28.893649    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-55978c879c-zrp96" podUID="23ed641f-f1ec-4121-8e03-aa1633d49911" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused"
Jul 28 15:33:37.971485 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:37.971437    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-5fd7598c98-h5bgr" podUID="922c1d44-7344-4a0c-b650-e78bdb21325c" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused"
Jul 28 15:33:38.893473 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:38.893433    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-55978c879c-zrp96" podUID="23ed641f-f1ec-4121-8e03-aa1633d49911" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused"
Jul 28 15:33:47.971003 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:47.970963    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-driver-ranking-5fd7598c98-h5bgr" podUID="922c1d44-7344-4a0c-b650-e78bdb21325c" containerName="online" probeResult="failure" output="Get \"https://10.133.0.30:6567/health\": dial tcp 10.133.0.30:6567: connect: connection refused"
Jul 28 15:33:47.971490 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:47.971098    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-driver-ranking-5fd7598c98-h5bgr"
Jul 28 15:33:48.893309 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:48.893270    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast-rest/feast-credit-scoring-55978c879c-zrp96" podUID="23ed641f-f1ec-4121-8e03-aa1633d49911" containerName="online" probeResult="failure" output="Get \"https://10.133.0.29:6567/health\": dial tcp 10.133.0.29:6567: connect: connection refused"
Jul 28 15:33:48.893479 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:48.893404    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast-rest/feast-credit-scoring-55978c879c-zrp96"
Jul 28 15:33:50.014862 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.014836    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-55978c879c-zrp96"
Jul 28 15:33:50.017450 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.017430    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-5fd7598c98-h5bgr"
Jul 28 15:33:50.074630 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.074612    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/922c1d44-7344-4a0c-b650-e78bdb21325c-feast-data\") pod \"922c1d44-7344-4a0c-b650-e78bdb21325c\" (UID: \"922c1d44-7344-4a0c-b650-e78bdb21325c\") "
Jul 28 15:33:50.074766 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.074642    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/23ed641f-f1ec-4121-8e03-aa1633d49911-online-tls\") pod \"23ed641f-f1ec-4121-8e03-aa1633d49911\" (UID: \"23ed641f-f1ec-4121-8e03-aa1633d49911\") "
Jul 28 15:33:50.074766 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.074670    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/23ed641f-f1ec-4121-8e03-aa1633d49911-registry-tls\") pod \"23ed641f-f1ec-4121-8e03-aa1633d49911\" (UID: \"23ed641f-f1ec-4121-8e03-aa1633d49911\") "
Jul 28 15:33:50.074766 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.074685    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/922c1d44-7344-4a0c-b650-e78bdb21325c-registry-tls\") pod \"922c1d44-7344-4a0c-b650-e78bdb21325c\" (UID: \"922c1d44-7344-4a0c-b650-e78bdb21325c\") "
Jul 28 15:33:50.074766 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.074717    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jcvg4\" (UniqueName: \"kubernetes.io/projected/23ed641f-f1ec-4121-8e03-aa1633d49911-kube-api-access-jcvg4\") pod \"23ed641f-f1ec-4121-8e03-aa1633d49911\" (UID: \"23ed641f-f1ec-4121-8e03-aa1633d49911\") "
Jul 28 15:33:50.074766 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.074748    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/23ed641f-f1ec-4121-8e03-aa1633d49911-feast-data\") pod \"23ed641f-f1ec-4121-8e03-aa1633d49911\" (UID: \"23ed641f-f1ec-4121-8e03-aa1633d49911\") "
Jul 28 15:33:50.075076 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.074771    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/922c1d44-7344-4a0c-b650-e78bdb21325c-online-tls\") pod \"922c1d44-7344-4a0c-b650-e78bdb21325c\" (UID: \"922c1d44-7344-4a0c-b650-e78bdb21325c\") "
Jul 28 15:33:50.075076 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.074796    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8gwbj\" (UniqueName: \"kubernetes.io/projected/922c1d44-7344-4a0c-b650-e78bdb21325c-kube-api-access-8gwbj\") pod \"922c1d44-7344-4a0c-b650-e78bdb21325c\" (UID: \"922c1d44-7344-4a0c-b650-e78bdb21325c\") "
Jul 28 15:33:50.076203 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.076149    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/922c1d44-7344-4a0c-b650-e78bdb21325c-feast-data" (OuterVolumeSpecName: "feast-data") pod "922c1d44-7344-4a0c-b650-e78bdb21325c" (UID: "922c1d44-7344-4a0c-b650-e78bdb21325c"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 15:33:50.077477 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.077450    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23ed641f-f1ec-4121-8e03-aa1633d49911-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "23ed641f-f1ec-4121-8e03-aa1633d49911" (UID: "23ed641f-f1ec-4121-8e03-aa1633d49911"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 15:33:50.077583 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.077533    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23ed641f-f1ec-4121-8e03-aa1633d49911-online-tls" (OuterVolumeSpecName: "online-tls") pod "23ed641f-f1ec-4121-8e03-aa1633d49911" (UID: "23ed641f-f1ec-4121-8e03-aa1633d49911"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 15:33:50.078356 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.078319    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/922c1d44-7344-4a0c-b650-e78bdb21325c-online-tls" (OuterVolumeSpecName: "online-tls") pod "922c1d44-7344-4a0c-b650-e78bdb21325c" (UID: "922c1d44-7344-4a0c-b650-e78bdb21325c"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 15:33:50.078466 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.078363    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/922c1d44-7344-4a0c-b650-e78bdb21325c-kube-api-access-8gwbj" (OuterVolumeSpecName: "kube-api-access-8gwbj") pod "922c1d44-7344-4a0c-b650-e78bdb21325c" (UID: "922c1d44-7344-4a0c-b650-e78bdb21325c"). InnerVolumeSpecName "kube-api-access-8gwbj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 15:33:50.079273 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.079251    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23ed641f-f1ec-4121-8e03-aa1633d49911-kube-api-access-jcvg4" (OuterVolumeSpecName: "kube-api-access-jcvg4") pod "23ed641f-f1ec-4121-8e03-aa1633d49911" (UID: "23ed641f-f1ec-4121-8e03-aa1633d49911"). InnerVolumeSpecName "kube-api-access-jcvg4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 15:33:50.079726 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.079708    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/922c1d44-7344-4a0c-b650-e78bdb21325c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "922c1d44-7344-4a0c-b650-e78bdb21325c" (UID: "922c1d44-7344-4a0c-b650-e78bdb21325c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 15:33:50.086067 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.086042    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23ed641f-f1ec-4121-8e03-aa1633d49911-feast-data" (OuterVolumeSpecName: "feast-data") pod "23ed641f-f1ec-4121-8e03-aa1633d49911" (UID: "23ed641f-f1ec-4121-8e03-aa1633d49911"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 15:33:50.175500 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.175436    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jcvg4\" (UniqueName: \"kubernetes.io/projected/23ed641f-f1ec-4121-8e03-aa1633d49911-kube-api-access-jcvg4\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:33:50.175500 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.175461    2561 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/23ed641f-f1ec-4121-8e03-aa1633d49911-feast-data\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:33:50.175500 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.175473    2561 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/922c1d44-7344-4a0c-b650-e78bdb21325c-online-tls\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:33:50.175500 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.175484    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8gwbj\" (UniqueName: \"kubernetes.io/projected/922c1d44-7344-4a0c-b650-e78bdb21325c-kube-api-access-8gwbj\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:33:50.175500 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.175496    2561 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/922c1d44-7344-4a0c-b650-e78bdb21325c-feast-data\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:33:50.175716 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.175509    2561 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/23ed641f-f1ec-4121-8e03-aa1633d49911-online-tls\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:33:50.175716 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.175520    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/23ed641f-f1ec-4121-8e03-aa1633d49911-registry-tls\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:33:50.175716 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.175530    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/922c1d44-7344-4a0c-b650-e78bdb21325c-registry-tls\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:33:50.286735 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.286710    2561 generic.go:356] "Generic (PLEG): container finished" podID="23ed641f-f1ec-4121-8e03-aa1633d49911" containerID="55c7531dd6b5e1b9a36f19d415d3470746653116c4c0ae4c03ff032c52821b66" exitCode=137
Jul 28 15:33:50.286876 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.286772    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-credit-scoring-55978c879c-zrp96"
Jul 28 15:33:50.286876 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.286785    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-55978c879c-zrp96" event={"ID":"23ed641f-f1ec-4121-8e03-aa1633d49911","Type":"ContainerDied","Data":"55c7531dd6b5e1b9a36f19d415d3470746653116c4c0ae4c03ff032c52821b66"}
Jul 28 15:33:50.286876 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.286855    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-credit-scoring-55978c879c-zrp96" event={"ID":"23ed641f-f1ec-4121-8e03-aa1633d49911","Type":"ContainerDied","Data":"dea57eb7a38644b2261b0237d944a30cbe641ed0a822a78a934ac39fc26301d3"}
Jul 28 15:33:50.287051 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.286883    2561 scope.go:117] "RemoveContainer" containerID="2d45facf92cd91aaaa661662c35f71c483fd65d959c6b7ace6a7467065383abd"
Jul 28 15:33:50.289233 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.289209    2561 generic.go:356] "Generic (PLEG): container finished" podID="922c1d44-7344-4a0c-b650-e78bdb21325c" containerID="579ec048d76e7156f1f945a1d15daa13d7429078a0b0b899c6ecaf847522e654" exitCode=137
Jul 28 15:33:50.289332 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.289258    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast-rest/feast-driver-ranking-5fd7598c98-h5bgr"
Jul 28 15:33:50.289332 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.289286    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5fd7598c98-h5bgr" event={"ID":"922c1d44-7344-4a0c-b650-e78bdb21325c","Type":"ContainerDied","Data":"579ec048d76e7156f1f945a1d15daa13d7429078a0b0b899c6ecaf847522e654"}
Jul 28 15:33:50.289332 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.289327    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast-rest/feast-driver-ranking-5fd7598c98-h5bgr" event={"ID":"922c1d44-7344-4a0c-b650-e78bdb21325c","Type":"ContainerDied","Data":"b57aec7c422c281c144b0a2fe65d4fedc1bebdca6e7036796956d1b37203d023"}
Jul 28 15:33:50.296600 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.296565    2561 scope.go:117] "RemoveContainer" containerID="55c7531dd6b5e1b9a36f19d415d3470746653116c4c0ae4c03ff032c52821b66"
Jul 28 15:33:50.305067 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.305053    2561 scope.go:117] "RemoveContainer" containerID="8538cdd3670f461ecfe31594a8e17723144ae860659db11dd67bea8c0d1e7810"
Jul 28 15:33:50.311667 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.311651    2561 scope.go:117] "RemoveContainer" containerID="eb083108fc0a5831bf20759dfcd405bdc2c94789cf0cbf06ce933fe928dec30c"
Jul 28 15:33:50.314678 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.314653    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5fd7598c98-h5bgr"]
Jul 28 15:33:50.319567 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.319510    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-driver-ranking-5fd7598c98-h5bgr"]
Jul 28 15:33:50.319621 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.319593    2561 scope.go:117] "RemoveContainer" containerID="2d45facf92cd91aaaa661662c35f71c483fd65d959c6b7ace6a7467065383abd"
Jul 28 15:33:50.319863 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:33:50.319817    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d45facf92cd91aaaa661662c35f71c483fd65d959c6b7ace6a7467065383abd\": container with ID starting with 2d45facf92cd91aaaa661662c35f71c483fd65d959c6b7ace6a7467065383abd not found: ID does not exist" containerID="2d45facf92cd91aaaa661662c35f71c483fd65d959c6b7ace6a7467065383abd"
Jul 28 15:33:50.319930 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.319878    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d45facf92cd91aaaa661662c35f71c483fd65d959c6b7ace6a7467065383abd"} err="failed to get container status \"2d45facf92cd91aaaa661662c35f71c483fd65d959c6b7ace6a7467065383abd\": rpc error: code = NotFound desc = could not find container \"2d45facf92cd91aaaa661662c35f71c483fd65d959c6b7ace6a7467065383abd\": container with ID starting with 2d45facf92cd91aaaa661662c35f71c483fd65d959c6b7ace6a7467065383abd not found: ID does not exist"
Jul 28 15:33:50.319930 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.319895    2561 scope.go:117] "RemoveContainer" containerID="55c7531dd6b5e1b9a36f19d415d3470746653116c4c0ae4c03ff032c52821b66"
Jul 28 15:33:50.320132 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:33:50.320117    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55c7531dd6b5e1b9a36f19d415d3470746653116c4c0ae4c03ff032c52821b66\": container with ID starting with 55c7531dd6b5e1b9a36f19d415d3470746653116c4c0ae4c03ff032c52821b66 not found: ID does not exist" containerID="55c7531dd6b5e1b9a36f19d415d3470746653116c4c0ae4c03ff032c52821b66"
Jul 28 15:33:50.320183 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.320135    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55c7531dd6b5e1b9a36f19d415d3470746653116c4c0ae4c03ff032c52821b66"} err="failed to get container status \"55c7531dd6b5e1b9a36f19d415d3470746653116c4c0ae4c03ff032c52821b66\": rpc error: code = NotFound desc = could not find container \"55c7531dd6b5e1b9a36f19d415d3470746653116c4c0ae4c03ff032c52821b66\": container with ID starting with 55c7531dd6b5e1b9a36f19d415d3470746653116c4c0ae4c03ff032c52821b66 not found: ID does not exist"
Jul 28 15:33:50.320183 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.320148    2561 scope.go:117] "RemoveContainer" containerID="8538cdd3670f461ecfe31594a8e17723144ae860659db11dd67bea8c0d1e7810"
Jul 28 15:33:50.320362 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:33:50.320348    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8538cdd3670f461ecfe31594a8e17723144ae860659db11dd67bea8c0d1e7810\": container with ID starting with 8538cdd3670f461ecfe31594a8e17723144ae860659db11dd67bea8c0d1e7810 not found: ID does not exist" containerID="8538cdd3670f461ecfe31594a8e17723144ae860659db11dd67bea8c0d1e7810"
Jul 28 15:33:50.320407 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.320365    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8538cdd3670f461ecfe31594a8e17723144ae860659db11dd67bea8c0d1e7810"} err="failed to get container status \"8538cdd3670f461ecfe31594a8e17723144ae860659db11dd67bea8c0d1e7810\": rpc error: code = NotFound desc = could not find container \"8538cdd3670f461ecfe31594a8e17723144ae860659db11dd67bea8c0d1e7810\": container with ID starting with 8538cdd3670f461ecfe31594a8e17723144ae860659db11dd67bea8c0d1e7810 not found: ID does not exist"
Jul 28 15:33:50.320407 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.320377    2561 scope.go:117] "RemoveContainer" containerID="eb083108fc0a5831bf20759dfcd405bdc2c94789cf0cbf06ce933fe928dec30c"
Jul 28 15:33:50.320606 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:33:50.320590    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb083108fc0a5831bf20759dfcd405bdc2c94789cf0cbf06ce933fe928dec30c\": container with ID starting with eb083108fc0a5831bf20759dfcd405bdc2c94789cf0cbf06ce933fe928dec30c not found: ID does not exist" containerID="eb083108fc0a5831bf20759dfcd405bdc2c94789cf0cbf06ce933fe928dec30c"
Jul 28 15:33:50.320651 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.320611    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb083108fc0a5831bf20759dfcd405bdc2c94789cf0cbf06ce933fe928dec30c"} err="failed to get container status \"eb083108fc0a5831bf20759dfcd405bdc2c94789cf0cbf06ce933fe928dec30c\": rpc error: code = NotFound desc = could not find container \"eb083108fc0a5831bf20759dfcd405bdc2c94789cf0cbf06ce933fe928dec30c\": container with ID starting with eb083108fc0a5831bf20759dfcd405bdc2c94789cf0cbf06ce933fe928dec30c not found: ID does not exist"
Jul 28 15:33:50.320651 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.320625    2561 scope.go:117] "RemoveContainer" containerID="a2e8278e1010f6f72fa4509acacd5399d7f8a7cb196852c4479dd8822e4a78a6"
Jul 28 15:33:50.327505 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.327489    2561 scope.go:117] "RemoveContainer" containerID="579ec048d76e7156f1f945a1d15daa13d7429078a0b0b899c6ecaf847522e654"
Jul 28 15:33:50.334354 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.334337    2561 scope.go:117] "RemoveContainer" containerID="c93e8c9139e48e1574e17522a7cec6a380dc03c5e3fb058433b8263886790068"
Jul 28 15:33:50.336818 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.336802    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-55978c879c-zrp96"]
Jul 28 15:33:50.341242 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.341160    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast-rest/feast-credit-scoring-55978c879c-zrp96"]
Jul 28 15:33:50.341289 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.341260    2561 scope.go:117] "RemoveContainer" containerID="77dd8306e205f587790c8a174978e39fb9156b34bc7f4dfb4a23b10acda22820"
Jul 28 15:33:50.349805 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.349684    2561 scope.go:117] "RemoveContainer" containerID="a2e8278e1010f6f72fa4509acacd5399d7f8a7cb196852c4479dd8822e4a78a6"
Jul 28 15:33:50.350015 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:33:50.349995    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2e8278e1010f6f72fa4509acacd5399d7f8a7cb196852c4479dd8822e4a78a6\": container with ID starting with a2e8278e1010f6f72fa4509acacd5399d7f8a7cb196852c4479dd8822e4a78a6 not found: ID does not exist" containerID="a2e8278e1010f6f72fa4509acacd5399d7f8a7cb196852c4479dd8822e4a78a6"
Jul 28 15:33:50.350064 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.350022    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2e8278e1010f6f72fa4509acacd5399d7f8a7cb196852c4479dd8822e4a78a6"} err="failed to get container status \"a2e8278e1010f6f72fa4509acacd5399d7f8a7cb196852c4479dd8822e4a78a6\": rpc error: code = NotFound desc = could not find container \"a2e8278e1010f6f72fa4509acacd5399d7f8a7cb196852c4479dd8822e4a78a6\": container with ID starting with a2e8278e1010f6f72fa4509acacd5399d7f8a7cb196852c4479dd8822e4a78a6 not found: ID does not exist"
Jul 28 15:33:50.350064 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.350041    2561 scope.go:117] "RemoveContainer" containerID="579ec048d76e7156f1f945a1d15daa13d7429078a0b0b899c6ecaf847522e654"
Jul 28 15:33:50.350294 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:33:50.350277    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"579ec048d76e7156f1f945a1d15daa13d7429078a0b0b899c6ecaf847522e654\": container with ID starting with 579ec048d76e7156f1f945a1d15daa13d7429078a0b0b899c6ecaf847522e654 not found: ID does not exist" containerID="579ec048d76e7156f1f945a1d15daa13d7429078a0b0b899c6ecaf847522e654"
Jul 28 15:33:50.350348 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.350300    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"579ec048d76e7156f1f945a1d15daa13d7429078a0b0b899c6ecaf847522e654"} err="failed to get container status \"579ec048d76e7156f1f945a1d15daa13d7429078a0b0b899c6ecaf847522e654\": rpc error: code = NotFound desc = could not find container \"579ec048d76e7156f1f945a1d15daa13d7429078a0b0b899c6ecaf847522e654\": container with ID starting with 579ec048d76e7156f1f945a1d15daa13d7429078a0b0b899c6ecaf847522e654 not found: ID does not exist"
Jul 28 15:33:50.350348 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.350317    2561 scope.go:117] "RemoveContainer" containerID="c93e8c9139e48e1574e17522a7cec6a380dc03c5e3fb058433b8263886790068"
Jul 28 15:33:50.350534 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:33:50.350514    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c93e8c9139e48e1574e17522a7cec6a380dc03c5e3fb058433b8263886790068\": container with ID starting with c93e8c9139e48e1574e17522a7cec6a380dc03c5e3fb058433b8263886790068 not found: ID does not exist" containerID="c93e8c9139e48e1574e17522a7cec6a380dc03c5e3fb058433b8263886790068"
Jul 28 15:33:50.350613 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.350536    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c93e8c9139e48e1574e17522a7cec6a380dc03c5e3fb058433b8263886790068"} err="failed to get container status \"c93e8c9139e48e1574e17522a7cec6a380dc03c5e3fb058433b8263886790068\": rpc error: code = NotFound desc = could not find container \"c93e8c9139e48e1574e17522a7cec6a380dc03c5e3fb058433b8263886790068\": container with ID starting with c93e8c9139e48e1574e17522a7cec6a380dc03c5e3fb058433b8263886790068 not found: ID does not exist"
Jul 28 15:33:50.350613 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.350548    2561 scope.go:117] "RemoveContainer" containerID="77dd8306e205f587790c8a174978e39fb9156b34bc7f4dfb4a23b10acda22820"
Jul 28 15:33:50.350789 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:33:50.350757    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"77dd8306e205f587790c8a174978e39fb9156b34bc7f4dfb4a23b10acda22820\": container with ID starting with 77dd8306e205f587790c8a174978e39fb9156b34bc7f4dfb4a23b10acda22820 not found: ID does not exist" containerID="77dd8306e205f587790c8a174978e39fb9156b34bc7f4dfb4a23b10acda22820"
Jul 28 15:33:50.351099 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:50.350797    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"77dd8306e205f587790c8a174978e39fb9156b34bc7f4dfb4a23b10acda22820"} err="failed to get container status \"77dd8306e205f587790c8a174978e39fb9156b34bc7f4dfb4a23b10acda22820\": rpc error: code = NotFound desc = could not find container \"77dd8306e205f587790c8a174978e39fb9156b34bc7f4dfb4a23b10acda22820\": container with ID starting with 77dd8306e205f587790c8a174978e39fb9156b34bc7f4dfb4a23b10acda22820 not found: ID does not exist"
Jul 28 15:33:51.409794 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:51.409756    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23ed641f-f1ec-4121-8e03-aa1633d49911" path="/var/lib/kubelet/pods/23ed641f-f1ec-4121-8e03-aa1633d49911/volumes"
Jul 28 15:33:51.410469 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:51.410447    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="922c1d44-7344-4a0c-b650-e78bdb21325c" path="/var/lib/kubelet/pods/922c1d44-7344-4a0c-b650-e78bdb21325c/volumes"
Jul 28 15:33:57.181311 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.181275    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd"]
Jul 28 15:33:57.181749 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.181557    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8a7ed55b-de78-4e61-bf09-dd84605068ef" containerName="postgres"
Jul 28 15:33:57.181749 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.181568    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8a7ed55b-de78-4e61-bf09-dd84605068ef" containerName="postgres"
Jul 28 15:33:57.181749 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.181579    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23ed641f-f1ec-4121-8e03-aa1633d49911" containerName="online"
Jul 28 15:33:57.181749 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.181584    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="23ed641f-f1ec-4121-8e03-aa1633d49911" containerName="online"
Jul 28 15:33:57.181749 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.181591    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="922c1d44-7344-4a0c-b650-e78bdb21325c" containerName="online"
Jul 28 15:33:57.181749 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.181597    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="922c1d44-7344-4a0c-b650-e78bdb21325c" containerName="online"
Jul 28 15:33:57.181749 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.181605    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65de8a0c-4de4-4fcd-9e81-eb44b3b543ce" containerName="manager"
Jul 28 15:33:57.181749 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.181610    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="65de8a0c-4de4-4fcd-9e81-eb44b3b543ce" containerName="manager"
Jul 28 15:33:57.181749 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.181616    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="922c1d44-7344-4a0c-b650-e78bdb21325c" containerName="feast-init"
Jul 28 15:33:57.181749 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.181623    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="922c1d44-7344-4a0c-b650-e78bdb21325c" containerName="feast-init"
Jul 28 15:33:57.181749 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.181630    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23ed641f-f1ec-4121-8e03-aa1633d49911" containerName="feast-apply"
Jul 28 15:33:57.181749 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.181635    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="23ed641f-f1ec-4121-8e03-aa1633d49911" containerName="feast-apply"
Jul 28 15:33:57.181749 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.181643    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="922c1d44-7344-4a0c-b650-e78bdb21325c" containerName="feast-apply"
Jul 28 15:33:57.181749 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.181648    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="922c1d44-7344-4a0c-b650-e78bdb21325c" containerName="feast-apply"
Jul 28 15:33:57.181749 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.181655    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d68aa55f-b735-46de-a1af-2c7d0c5ad0a9" containerName="redis"
Jul 28 15:33:57.181749 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.181660    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d68aa55f-b735-46de-a1af-2c7d0c5ad0a9" containerName="redis"
Jul 28 15:33:57.181749 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.181668    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23ed641f-f1ec-4121-8e03-aa1633d49911" containerName="registry"
Jul 28 15:33:57.181749 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.181673    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="23ed641f-f1ec-4121-8e03-aa1633d49911" containerName="registry"
Jul 28 15:33:57.181749 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.181680    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="922c1d44-7344-4a0c-b650-e78bdb21325c" containerName="registry"
Jul 28 15:33:57.181749 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.181684    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="922c1d44-7344-4a0c-b650-e78bdb21325c" containerName="registry"
Jul 28 15:33:57.181749 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.181690    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23ed641f-f1ec-4121-8e03-aa1633d49911" containerName="feast-init"
Jul 28 15:33:57.181749 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.181695    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="23ed641f-f1ec-4121-8e03-aa1633d49911" containerName="feast-init"
Jul 28 15:33:57.181749 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.181738    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="23ed641f-f1ec-4121-8e03-aa1633d49911" containerName="online"
Jul 28 15:33:57.181749 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.181744    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="65de8a0c-4de4-4fcd-9e81-eb44b3b543ce" containerName="manager"
Jul 28 15:33:57.181749 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.181751    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="23ed641f-f1ec-4121-8e03-aa1633d49911" containerName="registry"
Jul 28 15:33:57.181749 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.181758    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="922c1d44-7344-4a0c-b650-e78bdb21325c" containerName="online"
Jul 28 15:33:57.181749 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.181765    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d68aa55f-b735-46de-a1af-2c7d0c5ad0a9" containerName="redis"
Jul 28 15:33:57.182573 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.181769    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="8a7ed55b-de78-4e61-bf09-dd84605068ef" containerName="postgres"
Jul 28 15:33:57.182573 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.181774    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="922c1d44-7344-4a0c-b650-e78bdb21325c" containerName="registry"
Jul 28 15:33:57.185197 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.185172    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd"
Jul 28 15:33:57.188664 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.188645    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Jul 28 15:33:57.188799 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.188645    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Jul 28 15:33:57.188799 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.188646    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Jul 28 15:33:57.188982 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.188969    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Jul 28 15:33:57.189434 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.189417    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Jul 28 15:33:57.189961 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.189945    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-rv2qd\""
Jul 28 15:33:57.190088 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.189981    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Jul 28 15:33:57.203657 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.203635    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd"]
Jul 28 15:33:57.219749 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.219726    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2e360916-4933-482f-aa0d-c95637d44272-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-svxfd\" (UID: \"2e360916-4933-482f-aa0d-c95637d44272\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd"
Jul 28 15:33:57.219867 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.219759    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2e360916-4933-482f-aa0d-c95637d44272-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-svxfd\" (UID: \"2e360916-4933-482f-aa0d-c95637d44272\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd"
Jul 28 15:33:57.219867 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.219781    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2e360916-4933-482f-aa0d-c95637d44272-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-svxfd\" (UID: \"2e360916-4933-482f-aa0d-c95637d44272\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd"
Jul 28 15:33:57.219867 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.219806    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2e360916-4933-482f-aa0d-c95637d44272-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-svxfd\" (UID: \"2e360916-4933-482f-aa0d-c95637d44272\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd"
Jul 28 15:33:57.219996 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.219899    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2e360916-4933-482f-aa0d-c95637d44272-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-svxfd\" (UID: \"2e360916-4933-482f-aa0d-c95637d44272\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd"
Jul 28 15:33:57.219996 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.219928    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhh5s\" (UniqueName: \"kubernetes.io/projected/2e360916-4933-482f-aa0d-c95637d44272-kube-api-access-bhh5s\") pod \"feast-simple-feast-setup-777d6cc998-svxfd\" (UID: \"2e360916-4933-482f-aa0d-c95637d44272\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd"
Jul 28 15:33:57.320801 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.320782    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2e360916-4933-482f-aa0d-c95637d44272-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-svxfd\" (UID: \"2e360916-4933-482f-aa0d-c95637d44272\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd"
Jul 28 15:33:57.320915 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.320808    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2e360916-4933-482f-aa0d-c95637d44272-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-svxfd\" (UID: \"2e360916-4933-482f-aa0d-c95637d44272\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd"
Jul 28 15:33:57.320915 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.320842    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2e360916-4933-482f-aa0d-c95637d44272-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-svxfd\" (UID: \"2e360916-4933-482f-aa0d-c95637d44272\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd"
Jul 28 15:33:57.320988 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:33:57.320921    2561 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
Jul 28 15:33:57.320988 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:33:57.320977    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e360916-4933-482f-aa0d-c95637d44272-registry-tls podName:2e360916-4933-482f-aa0d-c95637d44272 nodeName:}" failed. No retries permitted until 2026-07-28 15:33:57.820962501 +0000 UTC m=+1198.871330585 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/2e360916-4933-482f-aa0d-c95637d44272-registry-tls") pod "feast-simple-feast-setup-777d6cc998-svxfd" (UID: "2e360916-4933-482f-aa0d-c95637d44272") : secret "feast-simple-feast-setup-registry-tls" not found
Jul 28 15:33:57.321090 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:33:57.320984    2561 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Jul 28 15:33:57.321090 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.321046    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhh5s\" (UniqueName: \"kubernetes.io/projected/2e360916-4933-482f-aa0d-c95637d44272-kube-api-access-bhh5s\") pod \"feast-simple-feast-setup-777d6cc998-svxfd\" (UID: \"2e360916-4933-482f-aa0d-c95637d44272\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd"
Jul 28 15:33:57.321090 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:33:57.321061    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e360916-4933-482f-aa0d-c95637d44272-ui-tls podName:2e360916-4933-482f-aa0d-c95637d44272 nodeName:}" failed. No retries permitted until 2026-07-28 15:33:57.821042392 +0000 UTC m=+1198.871410476 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/2e360916-4933-482f-aa0d-c95637d44272-ui-tls") pod "feast-simple-feast-setup-777d6cc998-svxfd" (UID: "2e360916-4933-482f-aa0d-c95637d44272") : secret "feast-simple-feast-setup-ui-tls" not found
Jul 28 15:33:57.321212 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.321150    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2e360916-4933-482f-aa0d-c95637d44272-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-svxfd\" (UID: \"2e360916-4933-482f-aa0d-c95637d44272\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd"
Jul 28 15:33:57.321212 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.321193    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2e360916-4933-482f-aa0d-c95637d44272-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-svxfd\" (UID: \"2e360916-4933-482f-aa0d-c95637d44272\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd"
Jul 28 15:33:57.321300 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:33:57.321282    2561 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found
Jul 28 15:33:57.321355 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:33:57.321343    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e360916-4933-482f-aa0d-c95637d44272-offline-tls podName:2e360916-4933-482f-aa0d-c95637d44272 nodeName:}" failed. No retries permitted until 2026-07-28 15:33:57.821329003 +0000 UTC m=+1198.871697093 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/2e360916-4933-482f-aa0d-c95637d44272-offline-tls") pod "feast-simple-feast-setup-777d6cc998-svxfd" (UID: "2e360916-4933-482f-aa0d-c95637d44272") : secret "feast-simple-feast-setup-offline-tls" not found
Jul 28 15:33:57.321519 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.321504    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2e360916-4933-482f-aa0d-c95637d44272-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-svxfd\" (UID: \"2e360916-4933-482f-aa0d-c95637d44272\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd"
Jul 28 15:33:57.323165 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.323149    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2e360916-4933-482f-aa0d-c95637d44272-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-svxfd\" (UID: \"2e360916-4933-482f-aa0d-c95637d44272\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd"
Jul 28 15:33:57.336598 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.336581    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhh5s\" (UniqueName: \"kubernetes.io/projected/2e360916-4933-482f-aa0d-c95637d44272-kube-api-access-bhh5s\") pod \"feast-simple-feast-setup-777d6cc998-svxfd\" (UID: \"2e360916-4933-482f-aa0d-c95637d44272\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd"
Jul 28 15:33:57.824198 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.824152    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2e360916-4933-482f-aa0d-c95637d44272-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-svxfd\" (UID: \"2e360916-4933-482f-aa0d-c95637d44272\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd"
Jul 28 15:33:57.824407 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.824221    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2e360916-4933-482f-aa0d-c95637d44272-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-svxfd\" (UID: \"2e360916-4933-482f-aa0d-c95637d44272\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd"
Jul 28 15:33:57.824407 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.824389    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2e360916-4933-482f-aa0d-c95637d44272-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-svxfd\" (UID: \"2e360916-4933-482f-aa0d-c95637d44272\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd"
Jul 28 15:33:57.826461 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.826430    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2e360916-4933-482f-aa0d-c95637d44272-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-svxfd\" (UID: \"2e360916-4933-482f-aa0d-c95637d44272\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd"
Jul 28 15:33:57.826559 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.826483    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2e360916-4933-482f-aa0d-c95637d44272-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-svxfd\" (UID: \"2e360916-4933-482f-aa0d-c95637d44272\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd"
Jul 28 15:33:57.826559 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:57.826520    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2e360916-4933-482f-aa0d-c95637d44272-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-svxfd\" (UID: \"2e360916-4933-482f-aa0d-c95637d44272\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd"
Jul 28 15:33:58.094927 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:58.094897    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd"
Jul 28 15:33:58.236013 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:33:58.235986    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2e360916_4933_482f_aa0d_c95637d44272.slice/crio-40fe14c8b35cf766dd256ce6878a82587b16cea52b4a8c3ee2a1e14bc5d17b86 WatchSource:0}: Error finding container 40fe14c8b35cf766dd256ce6878a82587b16cea52b4a8c3ee2a1e14bc5d17b86: Status 404 returned error can't find the container with id 40fe14c8b35cf766dd256ce6878a82587b16cea52b4a8c3ee2a1e14bc5d17b86
Jul 28 15:33:58.236464 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:58.236438    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd"]
Jul 28 15:33:58.325698 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:33:58.325668    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd" event={"ID":"2e360916-4933-482f-aa0d-c95637d44272","Type":"ContainerStarted","Data":"40fe14c8b35cf766dd256ce6878a82587b16cea52b4a8c3ee2a1e14bc5d17b86"}
Jul 28 15:34:13.392283 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:34:13.392250    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd" event={"ID":"2e360916-4933-482f-aa0d-c95637d44272","Type":"ContainerStarted","Data":"30b0d1b48795f2af77368d5c1d04d8f361a532c23360c419957b371c30d477bf"}
Jul 28 15:34:18.413795 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:34:18.413765    2561 generic.go:356] "Generic (PLEG): container finished" podID="2e360916-4933-482f-aa0d-c95637d44272" containerID="30b0d1b48795f2af77368d5c1d04d8f361a532c23360c419957b371c30d477bf" exitCode=0
Jul 28 15:34:18.414183 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:34:18.413811    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd" event={"ID":"2e360916-4933-482f-aa0d-c95637d44272","Type":"ContainerDied","Data":"30b0d1b48795f2af77368d5c1d04d8f361a532c23360c419957b371c30d477bf"}
Jul 28 15:34:19.420053 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:34:19.420018    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd" event={"ID":"2e360916-4933-482f-aa0d-c95637d44272","Type":"ContainerStarted","Data":"c433bbc69b44a9c4b3d184464e268c556e274f07fdee96fe6c66567725046f5e"}
Jul 28 15:34:24.439401 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:34:24.439366    2561 generic.go:356] "Generic (PLEG): container finished" podID="2e360916-4933-482f-aa0d-c95637d44272" containerID="c433bbc69b44a9c4b3d184464e268c556e274f07fdee96fe6c66567725046f5e" exitCode=0
Jul 28 15:34:24.439761 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:34:24.439417    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd" event={"ID":"2e360916-4933-482f-aa0d-c95637d44272","Type":"ContainerDied","Data":"c433bbc69b44a9c4b3d184464e268c556e274f07fdee96fe6c66567725046f5e"}
Jul 28 15:34:25.449034 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:34:25.448994    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd" event={"ID":"2e360916-4933-482f-aa0d-c95637d44272","Type":"ContainerStarted","Data":"ccc6596e8c3f63869f315bda4f9cc51843dbc1b06fb395b4f7192224b9d9eff0"}
Jul 28 15:34:25.449513 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:34:25.449052    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd" event={"ID":"2e360916-4933-482f-aa0d-c95637d44272","Type":"ContainerStarted","Data":"180eba51e8df66c8d92cd5ac93dad65435ab7e7249c9c6533221047380ddb661"}
Jul 28 15:34:25.449513 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:34:25.449072    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd" event={"ID":"2e360916-4933-482f-aa0d-c95637d44272","Type":"ContainerStarted","Data":"1949d9cdc9191b59a942ed6a7ff4b666d6b6bf236f474b3890c942391ab6349b"}
Jul 28 15:34:25.449513 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:34:25.449089    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd" event={"ID":"2e360916-4933-482f-aa0d-c95637d44272","Type":"ContainerStarted","Data":"42facab541ec92305bd278c581dcb6a1503b54682457ad570ef564adbbb67538"}
Jul 28 15:34:25.478114 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:34:25.478049    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd" podStartSLOduration=13.994337732 podStartE2EDuration="28.47802549s" totalImagesPullingTime="14.483687758s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:33:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:34:25.475694546 +0000 UTC m=+1226.526062651" watchObservedRunningTime="2026-07-28 15:34:25.47802549 +0000 UTC m=+1226.528393595"
Jul 28 15:34:28.095877 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:34:28.095837    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd"
Jul 28 15:34:28.096379 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:34:28.095904    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd"
Jul 28 15:34:28.096379 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:34:28.095941    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd"
Jul 28 15:34:28.096379 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:34:28.095956    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd"
Jul 28 15:34:28.096379 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:34:28.095974    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd"
Jul 28 15:34:28.096379 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:34:28.095990    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd"
Jul 28 15:34:28.096379 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:34:28.096006    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd"
Jul 28 15:34:28.096379 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:34:28.096024    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd"
Jul 28 15:34:28.098092 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:34:28.098046    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd" podUID="2e360916-4933-482f-aa0d-c95637d44272" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.31:8443: connect: connection refused"
Jul 28 15:34:28.098092 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:34:28.098070    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd" podUID="2e360916-4933-482f-aa0d-c95637d44272" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.31:6571: connect: connection refused"
Jul 28 15:34:28.098276 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:34:28.098160    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd" podUID="2e360916-4933-482f-aa0d-c95637d44272" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.31:8816: connect: connection refused"
Jul 28 15:34:28.098276 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:34:28.098226    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd" podUID="2e360916-4933-482f-aa0d-c95637d44272" containerName="online" probeResult="failure" output="Get \"https://10.133.0.31:6567/health\": dial tcp 10.133.0.31:6567: connect: connection refused"
Jul 28 15:34:31.096978 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:34:31.096948    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd"
Jul 28 15:34:31.097377 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:34:31.097118    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd"
Jul 28 15:34:31.097377 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:34:31.097338    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd"
Jul 28 15:34:31.097889 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:34:31.097865    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd"
Jul 28 15:34:31.098026 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:34:31.097988    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd"
Jul 28 15:34:31.098191 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:34:31.098171    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd"
Jul 28 15:34:31.101958 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:34:31.101939    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd"
Jul 28 15:34:31.479941 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:34:31.479851    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd"
Jul 28 15:35:32.706244 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:32.706206    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd"]
Jul 28 15:35:32.706749 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:32.706545    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd" podUID="2e360916-4933-482f-aa0d-c95637d44272" containerName="offline" containerID="cri-o://180eba51e8df66c8d92cd5ac93dad65435ab7e7249c9c6533221047380ddb661" gracePeriod=30
Jul 28 15:35:32.706749 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:32.706504    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd" podUID="2e360916-4933-482f-aa0d-c95637d44272" containerName="registry" containerID="cri-o://42facab541ec92305bd278c581dcb6a1503b54682457ad570ef564adbbb67538" gracePeriod=30
Jul 28 15:35:32.706749 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:32.706552    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd" podUID="2e360916-4933-482f-aa0d-c95637d44272" containerName="ui" containerID="cri-o://ccc6596e8c3f63869f315bda4f9cc51843dbc1b06fb395b4f7192224b9d9eff0" gracePeriod=30
Jul 28 15:35:32.706749 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:32.706557    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd" podUID="2e360916-4933-482f-aa0d-c95637d44272" containerName="online" containerID="cri-o://1949d9cdc9191b59a942ed6a7ff4b666d6b6bf236f474b3890c942391ab6349b" gracePeriod=30
Jul 28 15:35:32.981138 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:32.981058    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc"]
Jul 28 15:35:32.984855 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:32.984818    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc"
Jul 28 15:35:32.987549 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:32.987526    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-bmx5x\""
Jul 28 15:35:32.997755 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:32.997732    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc"]
Jul 28 15:35:33.066681 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:33.066641    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/07736af3-fb5a-48f7-9d8a-9383d288d994-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-kxchc\" (UID: \"07736af3-fb5a-48f7-9d8a-9383d288d994\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc"
Jul 28 15:35:33.066902 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:33.066711    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqmxr\" (UniqueName: \"kubernetes.io/projected/07736af3-fb5a-48f7-9d8a-9383d288d994-kube-api-access-qqmxr\") pod \"feast-simple-feast-setup-777d6cc998-kxchc\" (UID: \"07736af3-fb5a-48f7-9d8a-9383d288d994\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc"
Jul 28 15:35:33.066902 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:33.066743    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/07736af3-fb5a-48f7-9d8a-9383d288d994-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-kxchc\" (UID: \"07736af3-fb5a-48f7-9d8a-9383d288d994\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc"
Jul 28 15:35:33.066902 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:33.066767    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/07736af3-fb5a-48f7-9d8a-9383d288d994-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-kxchc\" (UID: \"07736af3-fb5a-48f7-9d8a-9383d288d994\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc"
Jul 28 15:35:33.066902 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:33.066800    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/07736af3-fb5a-48f7-9d8a-9383d288d994-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-kxchc\" (UID: \"07736af3-fb5a-48f7-9d8a-9383d288d994\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc"
Jul 28 15:35:33.067094 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:33.066935    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/07736af3-fb5a-48f7-9d8a-9383d288d994-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-kxchc\" (UID: \"07736af3-fb5a-48f7-9d8a-9383d288d994\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc"
Jul 28 15:35:33.167448 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:33.167404    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/07736af3-fb5a-48f7-9d8a-9383d288d994-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-kxchc\" (UID: \"07736af3-fb5a-48f7-9d8a-9383d288d994\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc"
Jul 28 15:35:33.167631 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:33.167457    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/07736af3-fb5a-48f7-9d8a-9383d288d994-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-kxchc\" (UID: \"07736af3-fb5a-48f7-9d8a-9383d288d994\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc"
Jul 28 15:35:33.167631 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:33.167523    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqmxr\" (UniqueName: \"kubernetes.io/projected/07736af3-fb5a-48f7-9d8a-9383d288d994-kube-api-access-qqmxr\") pod \"feast-simple-feast-setup-777d6cc998-kxchc\" (UID: \"07736af3-fb5a-48f7-9d8a-9383d288d994\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc"
Jul 28 15:35:33.167631 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:33.167560    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/07736af3-fb5a-48f7-9d8a-9383d288d994-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-kxchc\" (UID: \"07736af3-fb5a-48f7-9d8a-9383d288d994\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc"
Jul 28 15:35:33.167631 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:33.167584    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/07736af3-fb5a-48f7-9d8a-9383d288d994-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-kxchc\" (UID: \"07736af3-fb5a-48f7-9d8a-9383d288d994\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc"
Jul 28 15:35:33.167631 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:33.167606    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/07736af3-fb5a-48f7-9d8a-9383d288d994-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-kxchc\" (UID: \"07736af3-fb5a-48f7-9d8a-9383d288d994\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc"
Jul 28 15:35:33.167950 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:35:33.167713    2561 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-online-tls: secret "feast-simple-feast-setup-online-tls" not found
Jul 28 15:35:33.167950 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:35:33.167773    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/07736af3-fb5a-48f7-9d8a-9383d288d994-online-tls podName:07736af3-fb5a-48f7-9d8a-9383d288d994 nodeName:}" failed. No retries permitted until 2026-07-28 15:35:33.667751355 +0000 UTC m=+1294.718119457 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/07736af3-fb5a-48f7-9d8a-9383d288d994-online-tls") pod "feast-simple-feast-setup-777d6cc998-kxchc" (UID: "07736af3-fb5a-48f7-9d8a-9383d288d994") : secret "feast-simple-feast-setup-online-tls" not found
Jul 28 15:35:33.167950 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:33.167891    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/07736af3-fb5a-48f7-9d8a-9383d288d994-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-kxchc\" (UID: \"07736af3-fb5a-48f7-9d8a-9383d288d994\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc"
Jul 28 15:35:33.170286 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:33.170261    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/07736af3-fb5a-48f7-9d8a-9383d288d994-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-kxchc\" (UID: \"07736af3-fb5a-48f7-9d8a-9383d288d994\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc"
Jul 28 15:35:33.170428 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:33.170394    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/07736af3-fb5a-48f7-9d8a-9383d288d994-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-kxchc\" (UID: \"07736af3-fb5a-48f7-9d8a-9383d288d994\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc"
Jul 28 15:35:33.170711 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:33.170688    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/07736af3-fb5a-48f7-9d8a-9383d288d994-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-kxchc\" (UID: \"07736af3-fb5a-48f7-9d8a-9383d288d994\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc"
Jul 28 15:35:33.180373 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:33.180348    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqmxr\" (UniqueName: \"kubernetes.io/projected/07736af3-fb5a-48f7-9d8a-9383d288d994-kube-api-access-qqmxr\") pod \"feast-simple-feast-setup-777d6cc998-kxchc\" (UID: \"07736af3-fb5a-48f7-9d8a-9383d288d994\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc"
Jul 28 15:35:33.671680 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:33.671599    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/07736af3-fb5a-48f7-9d8a-9383d288d994-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-kxchc\" (UID: \"07736af3-fb5a-48f7-9d8a-9383d288d994\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc"
Jul 28 15:35:33.673889 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:33.673870    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/07736af3-fb5a-48f7-9d8a-9383d288d994-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-kxchc\" (UID: \"07736af3-fb5a-48f7-9d8a-9383d288d994\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc"
Jul 28 15:35:33.707913 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:33.707887    2561 generic.go:356] "Generic (PLEG): container finished" podID="2e360916-4933-482f-aa0d-c95637d44272" containerID="ccc6596e8c3f63869f315bda4f9cc51843dbc1b06fb395b4f7192224b9d9eff0" exitCode=0
Jul 28 15:35:33.707913 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:33.707908    2561 generic.go:356] "Generic (PLEG): container finished" podID="2e360916-4933-482f-aa0d-c95637d44272" containerID="1949d9cdc9191b59a942ed6a7ff4b666d6b6bf236f474b3890c942391ab6349b" exitCode=0
Jul 28 15:35:33.708296 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:33.707964    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd" event={"ID":"2e360916-4933-482f-aa0d-c95637d44272","Type":"ContainerDied","Data":"ccc6596e8c3f63869f315bda4f9cc51843dbc1b06fb395b4f7192224b9d9eff0"}
Jul 28 15:35:33.708296 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:33.708005    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd" event={"ID":"2e360916-4933-482f-aa0d-c95637d44272","Type":"ContainerDied","Data":"1949d9cdc9191b59a942ed6a7ff4b666d6b6bf236f474b3890c942391ab6349b"}
Jul 28 15:35:33.893722 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:33.893689    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc"
Jul 28 15:35:34.036950 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:34.033175    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc"]
Jul 28 15:35:34.038664 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:35:34.038638    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod07736af3_fb5a_48f7_9d8a_9383d288d994.slice/crio-d85e9699256939936fccfafe0b0bf1df3a86759fd3dd6a7f1db8806924c2d82c WatchSource:0}: Error finding container d85e9699256939936fccfafe0b0bf1df3a86759fd3dd6a7f1db8806924c2d82c: Status 404 returned error can't find the container with id d85e9699256939936fccfafe0b0bf1df3a86759fd3dd6a7f1db8806924c2d82c
Jul 28 15:35:34.714104 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:34.714069    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc" event={"ID":"07736af3-fb5a-48f7-9d8a-9383d288d994","Type":"ContainerStarted","Data":"f80e1ead51a730daab57d409bd1526dc3372a0bcec6387f8ec1082416946a093"}
Jul 28 15:35:34.714483 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:34.714116    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc" event={"ID":"07736af3-fb5a-48f7-9d8a-9383d288d994","Type":"ContainerStarted","Data":"d85e9699256939936fccfafe0b0bf1df3a86759fd3dd6a7f1db8806924c2d82c"}
Jul 28 15:35:39.733981 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:39.733948    2561 generic.go:356] "Generic (PLEG): container finished" podID="07736af3-fb5a-48f7-9d8a-9383d288d994" containerID="f80e1ead51a730daab57d409bd1526dc3372a0bcec6387f8ec1082416946a093" exitCode=0
Jul 28 15:35:39.734409 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:39.733988    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc" event={"ID":"07736af3-fb5a-48f7-9d8a-9383d288d994","Type":"ContainerDied","Data":"f80e1ead51a730daab57d409bd1526dc3372a0bcec6387f8ec1082416946a093"}
Jul 28 15:35:40.739914 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:40.739865    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc" event={"ID":"07736af3-fb5a-48f7-9d8a-9383d288d994","Type":"ContainerStarted","Data":"9ef236037a8c839c211fc090fd0508889e84f0c692b681df01ccd746618bc45e"}
Jul 28 15:35:41.098662 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:41.098620    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd" podUID="2e360916-4933-482f-aa0d-c95637d44272" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.31:8443: connect: connection refused"
Jul 28 15:35:41.477309 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:41.477221    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd" podUID="2e360916-4933-482f-aa0d-c95637d44272" containerName="online" probeResult="failure" output="Get \"https://10.133.0.31:6567/health\": dial tcp 10.133.0.31:6567: connect: connection refused"
Jul 28 15:35:45.768066 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:45.768034    2561 generic.go:356] "Generic (PLEG): container finished" podID="07736af3-fb5a-48f7-9d8a-9383d288d994" containerID="9ef236037a8c839c211fc090fd0508889e84f0c692b681df01ccd746618bc45e" exitCode=0
Jul 28 15:35:45.768518 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:45.768108    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc" event={"ID":"07736af3-fb5a-48f7-9d8a-9383d288d994","Type":"ContainerDied","Data":"9ef236037a8c839c211fc090fd0508889e84f0c692b681df01ccd746618bc45e"}
Jul 28 15:35:46.778766 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:46.778722    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc" event={"ID":"07736af3-fb5a-48f7-9d8a-9383d288d994","Type":"ContainerStarted","Data":"c2cfb1df91c72fadcc2ff1da94e7374f6866956112355eb6529a59a8031741a0"}
Jul 28 15:35:46.779269 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:46.778792    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc" event={"ID":"07736af3-fb5a-48f7-9d8a-9383d288d994","Type":"ContainerStarted","Data":"5c5960e9a38cb4bf992d6f689b85694d71ed184c01791742264e94133c172d7b"}
Jul 28 15:35:46.779269 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:46.778813    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc" event={"ID":"07736af3-fb5a-48f7-9d8a-9383d288d994","Type":"ContainerStarted","Data":"4632412ece563def67e84cf541e03311eb16517ee41e21b19db87179dd0dfd20"}
Jul 28 15:35:46.779269 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:46.778852    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc" event={"ID":"07736af3-fb5a-48f7-9d8a-9383d288d994","Type":"ContainerStarted","Data":"777ec417ee411a4ebad9943b34161f19dd8950f14f4960c605b45ef770fbff70"}
Jul 28 15:35:48.894230 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:48.894187    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc"
Jul 28 15:35:48.894840 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:48.894806    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc"
Jul 28 15:35:48.894973 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:48.894861    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc"
Jul 28 15:35:48.894973 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:48.894882    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc"
Jul 28 15:35:48.896525 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:48.896396    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc" podUID="07736af3-fb5a-48f7-9d8a-9383d288d994" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.32:6571: connect: connection refused"
Jul 28 15:35:48.896525 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:48.896438    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc" podUID="07736af3-fb5a-48f7-9d8a-9383d288d994" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.32:8816: connect: connection refused"
Jul 28 15:35:48.896525 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:48.896486    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc" podUID="07736af3-fb5a-48f7-9d8a-9383d288d994" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.32:8443: connect: connection refused"
Jul 28 15:35:48.896768 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:48.896439    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc" podUID="07736af3-fb5a-48f7-9d8a-9383d288d994" containerName="online" probeResult="failure" output="Get \"https://10.133.0.32:6567/health\": dial tcp 10.133.0.32:6567: connect: connection refused"
Jul 28 15:35:51.098386 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:51.098311    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd" podUID="2e360916-4933-482f-aa0d-c95637d44272" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.31:8443: connect: connection refused"
Jul 28 15:35:51.477757 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:51.477659    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd" podUID="2e360916-4933-482f-aa0d-c95637d44272" containerName="online" probeResult="failure" output="Get \"https://10.133.0.31:6567/health\": dial tcp 10.133.0.31:6567: connect: connection refused"
Jul 28 15:35:51.894247 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:51.894203    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc" podUID="07736af3-fb5a-48f7-9d8a-9383d288d994" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.32:8443: connect: connection refused"
Jul 28 15:35:51.894763 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:51.894737    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc"
Jul 28 15:35:51.895379 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:51.895353    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc"
Jul 28 15:35:51.895483 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:51.895396    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc"
Jul 28 15:35:51.895990 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:51.895970    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc"
Jul 28 15:35:51.900179 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:51.900158    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc"
Jul 28 15:35:51.920475 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:51.920412    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc" podStartSLOduration=19.920394619 podStartE2EDuration="19.920394619s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:35:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:35:46.804289123 +0000 UTC m=+1307.854657239" watchObservedRunningTime="2026-07-28 15:35:51.920394619 +0000 UTC m=+1312.970762728"
Jul 28 15:35:52.809981 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:52.809950    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc"
Jul 28 15:35:52.810433 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:52.810010    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc"
Jul 28 15:35:52.810592 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:52.810572    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc"
Jul 28 15:35:52.813284 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:52.813264    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc"
Jul 28 15:35:53.893991 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:53.893953    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc"
Jul 28 15:35:54.895083 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:54.895047    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc"
Jul 28 15:35:55.822109 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:35:55.822084    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc"
Jul 28 15:36:01.098155 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:01.098109    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd" podUID="2e360916-4933-482f-aa0d-c95637d44272" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.31:8443: connect: connection refused"
Jul 28 15:36:01.098630 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:01.098266    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd"
Jul 28 15:36:01.477460 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:01.477372    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd" podUID="2e360916-4933-482f-aa0d-c95637d44272" containerName="online" probeResult="failure" output="Get \"https://10.133.0.31:6567/health\": dial tcp 10.133.0.31:6567: connect: connection refused"
Jul 28 15:36:01.477619 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:01.477476    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd"
Jul 28 15:36:02.849001 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:02.848962    2561 generic.go:356] "Generic (PLEG): container finished" podID="2e360916-4933-482f-aa0d-c95637d44272" containerID="180eba51e8df66c8d92cd5ac93dad65435ab7e7249c9c6533221047380ddb661" exitCode=137
Jul 28 15:36:02.849001 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:02.848988    2561 generic.go:356] "Generic (PLEG): container finished" podID="2e360916-4933-482f-aa0d-c95637d44272" containerID="42facab541ec92305bd278c581dcb6a1503b54682457ad570ef564adbbb67538" exitCode=137
Jul 28 15:36:02.849450 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:02.849034    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd" event={"ID":"2e360916-4933-482f-aa0d-c95637d44272","Type":"ContainerDied","Data":"180eba51e8df66c8d92cd5ac93dad65435ab7e7249c9c6533221047380ddb661"}
Jul 28 15:36:02.849450 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:02.849087    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd" event={"ID":"2e360916-4933-482f-aa0d-c95637d44272","Type":"ContainerDied","Data":"42facab541ec92305bd278c581dcb6a1503b54682457ad570ef564adbbb67538"}
Jul 28 15:36:03.352244 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:03.352220    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd"
Jul 28 15:36:03.512936 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:03.512848    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2e360916-4933-482f-aa0d-c95637d44272-offline-tls\") pod \"2e360916-4933-482f-aa0d-c95637d44272\" (UID: \"2e360916-4933-482f-aa0d-c95637d44272\") "
Jul 28 15:36:03.512936 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:03.512912    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2e360916-4933-482f-aa0d-c95637d44272-feast-data\") pod \"2e360916-4933-482f-aa0d-c95637d44272\" (UID: \"2e360916-4933-482f-aa0d-c95637d44272\") "
Jul 28 15:36:03.513179 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:03.512959    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2e360916-4933-482f-aa0d-c95637d44272-ui-tls\") pod \"2e360916-4933-482f-aa0d-c95637d44272\" (UID: \"2e360916-4933-482f-aa0d-c95637d44272\") "
Jul 28 15:36:03.513179 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:03.512987    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhh5s\" (UniqueName: \"kubernetes.io/projected/2e360916-4933-482f-aa0d-c95637d44272-kube-api-access-bhh5s\") pod \"2e360916-4933-482f-aa0d-c95637d44272\" (UID: \"2e360916-4933-482f-aa0d-c95637d44272\") "
Jul 28 15:36:03.513179 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:03.513010    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2e360916-4933-482f-aa0d-c95637d44272-registry-tls\") pod \"2e360916-4933-482f-aa0d-c95637d44272\" (UID: \"2e360916-4933-482f-aa0d-c95637d44272\") "
Jul 28 15:36:03.513179 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:03.513045    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2e360916-4933-482f-aa0d-c95637d44272-online-tls\") pod \"2e360916-4933-482f-aa0d-c95637d44272\" (UID: \"2e360916-4933-482f-aa0d-c95637d44272\") "
Jul 28 15:36:03.513475 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:03.513443    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e360916-4933-482f-aa0d-c95637d44272-feast-data" (OuterVolumeSpecName: "feast-data") pod "2e360916-4933-482f-aa0d-c95637d44272" (UID: "2e360916-4933-482f-aa0d-c95637d44272"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 15:36:03.515307 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:03.515272    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e360916-4933-482f-aa0d-c95637d44272-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "2e360916-4933-482f-aa0d-c95637d44272" (UID: "2e360916-4933-482f-aa0d-c95637d44272"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 15:36:03.515414 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:03.515316    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e360916-4933-482f-aa0d-c95637d44272-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "2e360916-4933-482f-aa0d-c95637d44272" (UID: "2e360916-4933-482f-aa0d-c95637d44272"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 15:36:03.515414 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:03.515342    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e360916-4933-482f-aa0d-c95637d44272-online-tls" (OuterVolumeSpecName: "online-tls") pod "2e360916-4933-482f-aa0d-c95637d44272" (UID: "2e360916-4933-482f-aa0d-c95637d44272"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 15:36:03.515496 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:03.515466    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e360916-4933-482f-aa0d-c95637d44272-kube-api-access-bhh5s" (OuterVolumeSpecName: "kube-api-access-bhh5s") pod "2e360916-4933-482f-aa0d-c95637d44272" (UID: "2e360916-4933-482f-aa0d-c95637d44272"). InnerVolumeSpecName "kube-api-access-bhh5s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 15:36:03.515496 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:03.515474    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e360916-4933-482f-aa0d-c95637d44272-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2e360916-4933-482f-aa0d-c95637d44272" (UID: "2e360916-4933-482f-aa0d-c95637d44272"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 15:36:03.614053 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:03.614020    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhh5s\" (UniqueName: \"kubernetes.io/projected/2e360916-4933-482f-aa0d-c95637d44272-kube-api-access-bhh5s\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:36:03.614053 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:03.614049    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/2e360916-4933-482f-aa0d-c95637d44272-registry-tls\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:36:03.614252 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:03.614079    2561 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/2e360916-4933-482f-aa0d-c95637d44272-online-tls\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:36:03.614252 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:03.614089    2561 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/2e360916-4933-482f-aa0d-c95637d44272-offline-tls\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:36:03.614252 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:03.614097    2561 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/2e360916-4933-482f-aa0d-c95637d44272-feast-data\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:36:03.614252 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:03.614106    2561 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/2e360916-4933-482f-aa0d-c95637d44272-ui-tls\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:36:03.855292 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:03.855266    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd"
Jul 28 15:36:03.855728 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:03.855267    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd" event={"ID":"2e360916-4933-482f-aa0d-c95637d44272","Type":"ContainerDied","Data":"40fe14c8b35cf766dd256ce6878a82587b16cea52b4a8c3ee2a1e14bc5d17b86"}
Jul 28 15:36:03.855728 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:03.855387    2561 scope.go:117] "RemoveContainer" containerID="ccc6596e8c3f63869f315bda4f9cc51843dbc1b06fb395b4f7192224b9d9eff0"
Jul 28 15:36:03.865056 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:03.865039    2561 scope.go:117] "RemoveContainer" containerID="180eba51e8df66c8d92cd5ac93dad65435ab7e7249c9c6533221047380ddb661"
Jul 28 15:36:03.872269 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:03.872251    2561 scope.go:117] "RemoveContainer" containerID="1949d9cdc9191b59a942ed6a7ff4b666d6b6bf236f474b3890c942391ab6349b"
Jul 28 15:36:03.877690 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:03.877666    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd"]
Jul 28 15:36:03.880296 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:03.880280    2561 scope.go:117] "RemoveContainer" containerID="42facab541ec92305bd278c581dcb6a1503b54682457ad570ef564adbbb67538"
Jul 28 15:36:03.883948 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:03.883928    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-svxfd"]
Jul 28 15:36:03.887989 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:03.887973    2561 scope.go:117] "RemoveContainer" containerID="c433bbc69b44a9c4b3d184464e268c556e274f07fdee96fe6c66567725046f5e"
Jul 28 15:36:03.896570 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:03.896553    2561 scope.go:117] "RemoveContainer" containerID="30b0d1b48795f2af77368d5c1d04d8f361a532c23360c419957b371c30d477bf"
Jul 28 15:36:05.409984 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:05.409954    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e360916-4933-482f-aa0d-c95637d44272" path="/var/lib/kubelet/pods/2e360916-4933-482f-aa0d-c95637d44272/volumes"
Jul 28 15:36:58.832750 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:58.832666    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96"]
Jul 28 15:36:58.833333 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:58.833074    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e360916-4933-482f-aa0d-c95637d44272" containerName="feast-apply"
Jul 28 15:36:58.833333 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:58.833093    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e360916-4933-482f-aa0d-c95637d44272" containerName="feast-apply"
Jul 28 15:36:58.833333 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:58.833119    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e360916-4933-482f-aa0d-c95637d44272" containerName="feast-init"
Jul 28 15:36:58.833333 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:58.833127    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e360916-4933-482f-aa0d-c95637d44272" containerName="feast-init"
Jul 28 15:36:58.833333 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:58.833142    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e360916-4933-482f-aa0d-c95637d44272" containerName="online"
Jul 28 15:36:58.833333 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:58.833151    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e360916-4933-482f-aa0d-c95637d44272" containerName="online"
Jul 28 15:36:58.833333 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:58.833167    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e360916-4933-482f-aa0d-c95637d44272" containerName="registry"
Jul 28 15:36:58.833333 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:58.833175    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e360916-4933-482f-aa0d-c95637d44272" containerName="registry"
Jul 28 15:36:58.833333 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:58.833183    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e360916-4933-482f-aa0d-c95637d44272" containerName="offline"
Jul 28 15:36:58.833333 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:58.833192    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e360916-4933-482f-aa0d-c95637d44272" containerName="offline"
Jul 28 15:36:58.833333 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:58.833207    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e360916-4933-482f-aa0d-c95637d44272" containerName="ui"
Jul 28 15:36:58.833333 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:58.833215    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e360916-4933-482f-aa0d-c95637d44272" containerName="ui"
Jul 28 15:36:58.833333 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:58.833295    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e360916-4933-482f-aa0d-c95637d44272" containerName="registry"
Jul 28 15:36:58.833333 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:58.833306    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e360916-4933-482f-aa0d-c95637d44272" containerName="online"
Jul 28 15:36:58.833333 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:58.833317    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e360916-4933-482f-aa0d-c95637d44272" containerName="ui"
Jul 28 15:36:58.833333 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:58.833325    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e360916-4933-482f-aa0d-c95637d44272" containerName="offline"
Jul 28 15:36:58.836840 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:58.836805    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96"
Jul 28 15:36:58.839872 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:58.839843    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-jvw5j\""
Jul 28 15:36:58.840014 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:58.839995    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Jul 28 15:36:58.840098 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:58.839877    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Jul 28 15:36:58.840098 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:58.839887    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Jul 28 15:36:58.840098 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:58.839925    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Jul 28 15:36:58.840098 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:58.839905    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Jul 28 15:36:58.840904 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:58.840890    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Jul 28 15:36:58.849561 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:58.849543    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96"]
Jul 28 15:36:58.919833 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:58.919808    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-cvg96\" (UID: \"97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96"
Jul 28 15:36:58.919944 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:58.919870    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-cvg96\" (UID: \"97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96"
Jul 28 15:36:58.919944 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:58.919897    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flj8t\" (UniqueName: \"kubernetes.io/projected/97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7-kube-api-access-flj8t\") pod \"feast-simple-feast-remote-setup-db6955c6c-cvg96\" (UID: \"97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96"
Jul 28 15:36:58.919944 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:58.919924    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-cvg96\" (UID: \"97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96"
Jul 28 15:36:58.920058 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:58.920016    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-cvg96\" (UID: \"97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96"
Jul 28 15:36:58.920093 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:58.920059    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-cvg96\" (UID: \"97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96"
Jul 28 15:36:59.021177 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:59.021148    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-cvg96\" (UID: \"97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96"
Jul 28 15:36:59.021312 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:59.021186    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-cvg96\" (UID: \"97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96"
Jul 28 15:36:59.021312 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:59.021208    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-cvg96\" (UID: \"97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96"
Jul 28 15:36:59.021312 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:59.021224    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-cvg96\" (UID: \"97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96"
Jul 28 15:36:59.021312 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:59.021241    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flj8t\" (UniqueName: \"kubernetes.io/projected/97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7-kube-api-access-flj8t\") pod \"feast-simple-feast-remote-setup-db6955c6c-cvg96\" (UID: \"97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96"
Jul 28 15:36:59.021312 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:59.021271    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-cvg96\" (UID: \"97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96"
Jul 28 15:36:59.021572 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:36:59.021322    2561 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-online-tls: secret "feast-simple-feast-remote-setup-online-tls" not found
Jul 28 15:36:59.021572 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:36:59.021404    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7-online-tls podName:97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7 nodeName:}" failed. No retries permitted until 2026-07-28 15:36:59.52138283 +0000 UTC m=+1380.571750918 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "online-tls" (UniqueName: "kubernetes.io/secret/97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7-online-tls") pod "feast-simple-feast-remote-setup-db6955c6c-cvg96" (UID: "97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7") : secret "feast-simple-feast-remote-setup-online-tls" not found
Jul 28 15:36:59.021572 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:59.021566    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-cvg96\" (UID: \"97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96"
Jul 28 15:36:59.021946 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:59.021930    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-cvg96\" (UID: \"97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96"
Jul 28 15:36:59.023910 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:59.023880    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-cvg96\" (UID: \"97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96"
Jul 28 15:36:59.024001 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:59.023880    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-cvg96\" (UID: \"97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96"
Jul 28 15:36:59.029488 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:59.029468    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flj8t\" (UniqueName: \"kubernetes.io/projected/97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7-kube-api-access-flj8t\") pod \"feast-simple-feast-remote-setup-db6955c6c-cvg96\" (UID: \"97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96"
Jul 28 15:36:59.525895 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:59.525855    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-cvg96\" (UID: \"97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96"
Jul 28 15:36:59.528139 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:59.528118    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-cvg96\" (UID: \"97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96"
Jul 28 15:36:59.749171 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:59.749097    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-jvw5j\""
Jul 28 15:36:59.756923 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:59.756900    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96"
Jul 28 15:36:59.891355 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:36:59.891301    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96"]
Jul 28 15:36:59.894124 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:36:59.894095    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod97e8a0d3_ef7d_4c66_ad08_cc7ff74fc0e7.slice/crio-f5d3344530d21973ceffe8a4e54c74645c71e69fdaa4ace857398f4c1ad13f2a WatchSource:0}: Error finding container f5d3344530d21973ceffe8a4e54c74645c71e69fdaa4ace857398f4c1ad13f2a: Status 404 returned error can't find the container with id f5d3344530d21973ceffe8a4e54c74645c71e69fdaa4ace857398f4c1ad13f2a
Jul 28 15:37:00.065934 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:37:00.065858    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96" event={"ID":"97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7","Type":"ContainerStarted","Data":"5c60cbda68424565aa0123ec91f80470a0ee628fb7ccbe441bc1dcda5459ee7d"}
Jul 28 15:37:00.065934 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:37:00.065904    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96" event={"ID":"97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7","Type":"ContainerStarted","Data":"f5d3344530d21973ceffe8a4e54c74645c71e69fdaa4ace857398f4c1ad13f2a"}
Jul 28 15:37:05.088248 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:37:05.088212    2561 generic.go:356] "Generic (PLEG): container finished" podID="97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7" containerID="5c60cbda68424565aa0123ec91f80470a0ee628fb7ccbe441bc1dcda5459ee7d" exitCode=0
Jul 28 15:37:05.088655 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:37:05.088281    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96" event={"ID":"97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7","Type":"ContainerDied","Data":"5c60cbda68424565aa0123ec91f80470a0ee628fb7ccbe441bc1dcda5459ee7d"}
Jul 28 15:37:06.100795 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:37:06.100749    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96" event={"ID":"97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7","Type":"ContainerStarted","Data":"75b0e0616dd8bb4583c98188b46307fe26dbe03d89226e7cc2dcb59ae27e08d3"}
Jul 28 15:37:11.124167 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:37:11.124130    2561 generic.go:356] "Generic (PLEG): container finished" podID="97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7" containerID="75b0e0616dd8bb4583c98188b46307fe26dbe03d89226e7cc2dcb59ae27e08d3" exitCode=0
Jul 28 15:37:11.124593 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:37:11.124179    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96" event={"ID":"97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7","Type":"ContainerDied","Data":"75b0e0616dd8bb4583c98188b46307fe26dbe03d89226e7cc2dcb59ae27e08d3"}
Jul 28 15:37:12.135820 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:37:12.135777    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96" event={"ID":"97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7","Type":"ContainerStarted","Data":"63e9a72c5fddfb75967d75cce6d457a681d4e41bf03374a608226edb0f492cb6"}
Jul 28 15:37:12.136233 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:37:12.135867    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96" event={"ID":"97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7","Type":"ContainerStarted","Data":"7b724aa0f8596757bffbd814106c6b9482117435b9994c293002c26803590da6"}
Jul 28 15:37:12.136233 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:37:12.135889    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96" event={"ID":"97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7","Type":"ContainerStarted","Data":"77e63dbc31610eff82bdf550eae09521be8fbca16c913a518c3bd7cb17566133"}
Jul 28 15:37:12.161764 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:37:12.161574    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96" podStartSLOduration=14.161554053 podStartE2EDuration="14.161554053s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:36:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:37:12.160405002 +0000 UTC m=+1393.210773120" watchObservedRunningTime="2026-07-28 15:37:12.161554053 +0000 UTC m=+1393.211922159"
Jul 28 15:37:14.757801 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:37:14.757751    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96"
Jul 28 15:37:14.758338 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:37:14.757847    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96"
Jul 28 15:37:14.758338 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:37:14.757868    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96"
Jul 28 15:37:14.759590 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:37:14.759556    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96" podUID="97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7" containerName="online" probeResult="failure" output="Get \"https://10.133.0.33:6567/health\": dial tcp 10.133.0.33:6567: connect: connection refused"
Jul 28 15:37:14.759590 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:37:14.759563    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96" podUID="97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.33:8443: connect: connection refused"
Jul 28 15:37:14.759801 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:37:14.759593    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96" podUID="97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.33:8816: connect: connection refused"
Jul 28 15:37:17.759102 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:37:17.759072    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96"
Jul 28 15:37:17.759573 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:37:17.759258    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96"
Jul 28 15:37:17.759657 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:37:17.759598    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96"
Jul 28 15:37:17.759657 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:37:17.759630    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96"
Jul 28 15:37:17.760010 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:37:17.759985    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96"
Jul 28 15:37:17.760111 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:37:17.760091    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96"
Jul 28 15:37:17.765633 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:37:17.765616    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96"
Jul 28 15:37:18.163687 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:37:18.163654    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96"
Jul 28 15:37:18.168369 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:37:18.168342    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96"
Jul 28 15:38:20.262319 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:20.262280    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96"]
Jul 28 15:38:20.262880 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:20.262555    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96" podUID="97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7" containerName="online" containerID="cri-o://77e63dbc31610eff82bdf550eae09521be8fbca16c913a518c3bd7cb17566133" gracePeriod=30
Jul 28 15:38:20.262880 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:20.262615    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96" podUID="97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7" containerName="ui" containerID="cri-o://63e9a72c5fddfb75967d75cce6d457a681d4e41bf03374a608226edb0f492cb6" gracePeriod=30
Jul 28 15:38:20.262880 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:20.262640    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96" podUID="97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7" containerName="offline" containerID="cri-o://7b724aa0f8596757bffbd814106c6b9482117435b9994c293002c26803590da6" gracePeriod=30
Jul 28 15:38:20.412587 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:20.412549    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc"]
Jul 28 15:38:20.413046 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:20.412851    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc" podUID="07736af3-fb5a-48f7-9d8a-9383d288d994" containerName="registry" containerID="cri-o://777ec417ee411a4ebad9943b34161f19dd8950f14f4960c605b45ef770fbff70" gracePeriod=30
Jul 28 15:38:20.413046 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:20.412886    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc" podUID="07736af3-fb5a-48f7-9d8a-9383d288d994" containerName="ui" containerID="cri-o://c2cfb1df91c72fadcc2ff1da94e7374f6866956112355eb6529a59a8031741a0" gracePeriod=30
Jul 28 15:38:20.413046 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:20.412908    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc" podUID="07736af3-fb5a-48f7-9d8a-9383d288d994" containerName="offline" containerID="cri-o://5c5960e9a38cb4bf992d6f689b85694d71ed184c01791742264e94133c172d7b" gracePeriod=30
Jul 28 15:38:20.413046 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:20.413025    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc" podUID="07736af3-fb5a-48f7-9d8a-9383d288d994" containerName="online" containerID="cri-o://4632412ece563def67e84cf541e03311eb16517ee41e21b19db87179dd0dfd20" gracePeriod=30
Jul 28 15:38:21.408246 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:21.408211    2561 generic.go:356] "Generic (PLEG): container finished" podID="07736af3-fb5a-48f7-9d8a-9383d288d994" containerID="c2cfb1df91c72fadcc2ff1da94e7374f6866956112355eb6529a59a8031741a0" exitCode=0
Jul 28 15:38:21.408246 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:21.408242    2561 generic.go:356] "Generic (PLEG): container finished" podID="07736af3-fb5a-48f7-9d8a-9383d288d994" containerID="4632412ece563def67e84cf541e03311eb16517ee41e21b19db87179dd0dfd20" exitCode=0
Jul 28 15:38:21.411063 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:21.411040    2561 generic.go:356] "Generic (PLEG): container finished" podID="97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7" containerID="63e9a72c5fddfb75967d75cce6d457a681d4e41bf03374a608226edb0f492cb6" exitCode=0
Jul 28 15:38:21.411063 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:21.411060    2561 generic.go:356] "Generic (PLEG): container finished" podID="97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7" containerID="77e63dbc31610eff82bdf550eae09521be8fbca16c913a518c3bd7cb17566133" exitCode=0
Jul 28 15:38:21.411219 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:21.411065    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc" event={"ID":"07736af3-fb5a-48f7-9d8a-9383d288d994","Type":"ContainerDied","Data":"c2cfb1df91c72fadcc2ff1da94e7374f6866956112355eb6529a59a8031741a0"}
Jul 28 15:38:21.411219 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:21.411100    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc" event={"ID":"07736af3-fb5a-48f7-9d8a-9383d288d994","Type":"ContainerDied","Data":"4632412ece563def67e84cf541e03311eb16517ee41e21b19db87179dd0dfd20"}
Jul 28 15:38:21.411219 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:21.411114    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96" event={"ID":"97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7","Type":"ContainerDied","Data":"63e9a72c5fddfb75967d75cce6d457a681d4e41bf03374a608226edb0f492cb6"}
Jul 28 15:38:21.411219 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:21.411127    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96" event={"ID":"97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7","Type":"ContainerDied","Data":"77e63dbc31610eff82bdf550eae09521be8fbca16c913a518c3bd7cb17566133"}
Jul 28 15:38:22.810135 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:22.810089    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc" podUID="07736af3-fb5a-48f7-9d8a-9383d288d994" containerName="online" probeResult="failure" output="Get \"https://10.133.0.32:6567/health\": dial tcp 10.133.0.32:6567: connect: connection refused"
Jul 28 15:38:25.821977 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:25.821940    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc" podUID="07736af3-fb5a-48f7-9d8a-9383d288d994" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.32:8443: connect: connection refused"
Jul 28 15:38:27.760084 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:27.760040    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96" podUID="97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.33:8443: connect: connection refused"
Jul 28 15:38:28.164766 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:28.164719    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96" podUID="97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7" containerName="online" probeResult="failure" output="Get \"https://10.133.0.33:6567/health\": dial tcp 10.133.0.33:6567: connect: connection refused"
Jul 28 15:38:32.810795 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:32.810746    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc" podUID="07736af3-fb5a-48f7-9d8a-9383d288d994" containerName="online" probeResult="failure" output="Get \"https://10.133.0.32:6567/health\": dial tcp 10.133.0.32:6567: connect: connection refused"
Jul 28 15:38:35.821725 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:35.821685    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc" podUID="07736af3-fb5a-48f7-9d8a-9383d288d994" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.32:8443: connect: connection refused"
Jul 28 15:38:37.760435 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:37.760390    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96" podUID="97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.33:8443: connect: connection refused"
Jul 28 15:38:38.164339 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:38.164305    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96" podUID="97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7" containerName="online" probeResult="failure" output="Get \"https://10.133.0.33:6567/health\": dial tcp 10.133.0.33:6567: connect: connection refused"
Jul 28 15:38:42.810389 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:42.810339    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc" podUID="07736af3-fb5a-48f7-9d8a-9383d288d994" containerName="online" probeResult="failure" output="Get \"https://10.133.0.32:6567/health\": dial tcp 10.133.0.32:6567: connect: connection refused"
Jul 28 15:38:42.810892 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:42.810482    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc"
Jul 28 15:38:45.822275 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:45.822231    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc" podUID="07736af3-fb5a-48f7-9d8a-9383d288d994" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.32:8443: connect: connection refused"
Jul 28 15:38:45.822692 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:45.822378    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc"
Jul 28 15:38:47.760265 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:47.760214    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96" podUID="97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.33:8443: connect: connection refused"
Jul 28 15:38:47.760660 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:47.760343    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96"
Jul 28 15:38:48.164736 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:48.164686    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96" podUID="97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7" containerName="online" probeResult="failure" output="Get \"https://10.133.0.33:6567/health\": dial tcp 10.133.0.33:6567: connect: connection refused"
Jul 28 15:38:48.164940 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:48.164809    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96"
Jul 28 15:38:50.525205 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:50.525122    2561 generic.go:356] "Generic (PLEG): container finished" podID="07736af3-fb5a-48f7-9d8a-9383d288d994" containerID="5c5960e9a38cb4bf992d6f689b85694d71ed184c01791742264e94133c172d7b" exitCode=137
Jul 28 15:38:50.525205 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:50.525145    2561 generic.go:356] "Generic (PLEG): container finished" podID="07736af3-fb5a-48f7-9d8a-9383d288d994" containerID="777ec417ee411a4ebad9943b34161f19dd8950f14f4960c605b45ef770fbff70" exitCode=137
Jul 28 15:38:50.525205 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:50.525194    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc" event={"ID":"07736af3-fb5a-48f7-9d8a-9383d288d994","Type":"ContainerDied","Data":"5c5960e9a38cb4bf992d6f689b85694d71ed184c01791742264e94133c172d7b"}
Jul 28 15:38:50.525691 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:50.525239    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc" event={"ID":"07736af3-fb5a-48f7-9d8a-9383d288d994","Type":"ContainerDied","Data":"777ec417ee411a4ebad9943b34161f19dd8950f14f4960c605b45ef770fbff70"}
Jul 28 15:38:50.527559 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:50.527537    2561 generic.go:356] "Generic (PLEG): container finished" podID="97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7" containerID="7b724aa0f8596757bffbd814106c6b9482117435b9994c293002c26803590da6" exitCode=137
Jul 28 15:38:50.527688 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:50.527570    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96" event={"ID":"97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7","Type":"ContainerDied","Data":"7b724aa0f8596757bffbd814106c6b9482117435b9994c293002c26803590da6"}
Jul 28 15:38:50.917979 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:50.917956    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96"
Jul 28 15:38:51.029317 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.029242    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7-ui-tls\") pod \"97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7\" (UID: \"97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7\") "
Jul 28 15:38:51.029317 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.029290    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7-feast-data\") pod \"97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7\" (UID: \"97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7\") "
Jul 28 15:38:51.029535 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.029324    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7-offline-tls\") pod \"97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7\" (UID: \"97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7\") "
Jul 28 15:38:51.029535 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.029351    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-flj8t\" (UniqueName: \"kubernetes.io/projected/97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7-kube-api-access-flj8t\") pod \"97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7\" (UID: \"97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7\") "
Jul 28 15:38:51.029535 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.029370    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7-registry-tls\") pod \"97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7\" (UID: \"97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7\") "
Jul 28 15:38:51.029535 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.029401    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7-online-tls\") pod \"97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7\" (UID: \"97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7\") "
Jul 28 15:38:51.029819 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.029764    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7" (UID: "97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 15:38:51.029975 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.029933    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7-feast-data" (OuterVolumeSpecName: "feast-data") pod "97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7" (UID: "97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 15:38:51.031654 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.031626    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7-online-tls" (OuterVolumeSpecName: "online-tls") pod "97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7" (UID: "97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 15:38:51.031654 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.031646    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7" (UID: "97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 15:38:51.031787 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.031621    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7-kube-api-access-flj8t" (OuterVolumeSpecName: "kube-api-access-flj8t") pod "97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7" (UID: "97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7"). InnerVolumeSpecName "kube-api-access-flj8t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 15:38:51.031787 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.031725    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7" (UID: "97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 15:38:51.069281 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.069254    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc"
Jul 28 15:38:51.130019 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.129984    2561 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7-ui-tls\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:38:51.130019 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.130011    2561 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7-feast-data\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:38:51.130019 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.130021    2561 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7-offline-tls\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:38:51.130264 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.130030    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flj8t\" (UniqueName: \"kubernetes.io/projected/97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7-kube-api-access-flj8t\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:38:51.130264 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.130039    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7-registry-tls\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:38:51.130264 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.130047    2561 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7-online-tls\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:38:51.230708 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.230677    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/07736af3-fb5a-48f7-9d8a-9383d288d994-feast-data\") pod \"07736af3-fb5a-48f7-9d8a-9383d288d994\" (UID: \"07736af3-fb5a-48f7-9d8a-9383d288d994\") "
Jul 28 15:38:51.230904 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.230719    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqmxr\" (UniqueName: \"kubernetes.io/projected/07736af3-fb5a-48f7-9d8a-9383d288d994-kube-api-access-qqmxr\") pod \"07736af3-fb5a-48f7-9d8a-9383d288d994\" (UID: \"07736af3-fb5a-48f7-9d8a-9383d288d994\") "
Jul 28 15:38:51.230904 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.230741    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/07736af3-fb5a-48f7-9d8a-9383d288d994-registry-tls\") pod \"07736af3-fb5a-48f7-9d8a-9383d288d994\" (UID: \"07736af3-fb5a-48f7-9d8a-9383d288d994\") "
Jul 28 15:38:51.230904 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.230772    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/07736af3-fb5a-48f7-9d8a-9383d288d994-offline-tls\") pod \"07736af3-fb5a-48f7-9d8a-9383d288d994\" (UID: \"07736af3-fb5a-48f7-9d8a-9383d288d994\") "
Jul 28 15:38:51.231078 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.230922    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/07736af3-fb5a-48f7-9d8a-9383d288d994-ui-tls\") pod \"07736af3-fb5a-48f7-9d8a-9383d288d994\" (UID: \"07736af3-fb5a-48f7-9d8a-9383d288d994\") "
Jul 28 15:38:51.231078 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.230990    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/07736af3-fb5a-48f7-9d8a-9383d288d994-online-tls\") pod \"07736af3-fb5a-48f7-9d8a-9383d288d994\" (UID: \"07736af3-fb5a-48f7-9d8a-9383d288d994\") "
Jul 28 15:38:51.233073 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.232084    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07736af3-fb5a-48f7-9d8a-9383d288d994-feast-data" (OuterVolumeSpecName: "feast-data") pod "07736af3-fb5a-48f7-9d8a-9383d288d994" (UID: "07736af3-fb5a-48f7-9d8a-9383d288d994"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 15:38:51.233976 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.233940    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07736af3-fb5a-48f7-9d8a-9383d288d994-online-tls" (OuterVolumeSpecName: "online-tls") pod "07736af3-fb5a-48f7-9d8a-9383d288d994" (UID: "07736af3-fb5a-48f7-9d8a-9383d288d994"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 15:38:51.234098 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.233995    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07736af3-fb5a-48f7-9d8a-9383d288d994-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "07736af3-fb5a-48f7-9d8a-9383d288d994" (UID: "07736af3-fb5a-48f7-9d8a-9383d288d994"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 15:38:51.234412 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.234384    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07736af3-fb5a-48f7-9d8a-9383d288d994-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "07736af3-fb5a-48f7-9d8a-9383d288d994" (UID: "07736af3-fb5a-48f7-9d8a-9383d288d994"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 15:38:51.235991 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.235946    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07736af3-fb5a-48f7-9d8a-9383d288d994-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "07736af3-fb5a-48f7-9d8a-9383d288d994" (UID: "07736af3-fb5a-48f7-9d8a-9383d288d994"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 15:38:51.238861 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.238813    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07736af3-fb5a-48f7-9d8a-9383d288d994-kube-api-access-qqmxr" (OuterVolumeSpecName: "kube-api-access-qqmxr") pod "07736af3-fb5a-48f7-9d8a-9383d288d994" (UID: "07736af3-fb5a-48f7-9d8a-9383d288d994"). InnerVolumeSpecName "kube-api-access-qqmxr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 15:38:51.332522 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.332490    2561 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/07736af3-fb5a-48f7-9d8a-9383d288d994-feast-data\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:38:51.332676 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.332548    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqmxr\" (UniqueName: \"kubernetes.io/projected/07736af3-fb5a-48f7-9d8a-9383d288d994-kube-api-access-qqmxr\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:38:51.332676 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.332564    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/07736af3-fb5a-48f7-9d8a-9383d288d994-registry-tls\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:38:51.332676 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.332577    2561 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/07736af3-fb5a-48f7-9d8a-9383d288d994-offline-tls\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:38:51.332676 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.332588    2561 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/07736af3-fb5a-48f7-9d8a-9383d288d994-ui-tls\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:38:51.332676 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.332599    2561 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/07736af3-fb5a-48f7-9d8a-9383d288d994-online-tls\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:38:51.534891 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.534853    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc" event={"ID":"07736af3-fb5a-48f7-9d8a-9383d288d994","Type":"ContainerDied","Data":"d85e9699256939936fccfafe0b0bf1df3a86759fd3dd6a7f1db8806924c2d82c"}
Jul 28 15:38:51.534891 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.534872    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc"
Jul 28 15:38:51.535466 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.534915    2561 scope.go:117] "RemoveContainer" containerID="c2cfb1df91c72fadcc2ff1da94e7374f6866956112355eb6529a59a8031741a0"
Jul 28 15:38:51.537933 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.537910    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96" event={"ID":"97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7","Type":"ContainerDied","Data":"f5d3344530d21973ceffe8a4e54c74645c71e69fdaa4ace857398f4c1ad13f2a"}
Jul 28 15:38:51.538024 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.537957    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96"
Jul 28 15:38:51.544175 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.544158    2561 scope.go:117] "RemoveContainer" containerID="5c5960e9a38cb4bf992d6f689b85694d71ed184c01791742264e94133c172d7b"
Jul 28 15:38:51.551541 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.551511    2561 scope.go:117] "RemoveContainer" containerID="4632412ece563def67e84cf541e03311eb16517ee41e21b19db87179dd0dfd20"
Jul 28 15:38:51.555192 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.555170    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc"]
Jul 28 15:38:51.559500 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.559478    2561 scope.go:117] "RemoveContainer" containerID="777ec417ee411a4ebad9943b34161f19dd8950f14f4960c605b45ef770fbff70"
Jul 28 15:38:51.560736 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.560717    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-kxchc"]
Jul 28 15:38:51.566725 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.566709    2561 scope.go:117] "RemoveContainer" containerID="9ef236037a8c839c211fc090fd0508889e84f0c692b681df01ccd746618bc45e"
Jul 28 15:38:51.573859 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.573840    2561 scope.go:117] "RemoveContainer" containerID="f80e1ead51a730daab57d409bd1526dc3372a0bcec6387f8ec1082416946a093"
Jul 28 15:38:51.573932 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.573857    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96"]
Jul 28 15:38:51.580432 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.580414    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-cvg96"]
Jul 28 15:38:51.581154 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.581135    2561 scope.go:117] "RemoveContainer" containerID="63e9a72c5fddfb75967d75cce6d457a681d4e41bf03374a608226edb0f492cb6"
Jul 28 15:38:51.588279 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.588263    2561 scope.go:117] "RemoveContainer" containerID="7b724aa0f8596757bffbd814106c6b9482117435b9994c293002c26803590da6"
Jul 28 15:38:51.595511 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.595491    2561 scope.go:117] "RemoveContainer" containerID="77e63dbc31610eff82bdf550eae09521be8fbca16c913a518c3bd7cb17566133"
Jul 28 15:38:51.602641 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.602596    2561 scope.go:117] "RemoveContainer" containerID="75b0e0616dd8bb4583c98188b46307fe26dbe03d89226e7cc2dcb59ae27e08d3"
Jul 28 15:38:51.610036 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:51.610021    2561 scope.go:117] "RemoveContainer" containerID="5c60cbda68424565aa0123ec91f80470a0ee628fb7ccbe441bc1dcda5459ee7d"
Jul 28 15:38:53.410363 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:53.410333    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07736af3-fb5a-48f7-9d8a-9383d288d994" path="/var/lib/kubelet/pods/07736af3-fb5a-48f7-9d8a-9383d288d994/volumes"
Jul 28 15:38:53.410941 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:38:53.410926    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7" path="/var/lib/kubelet/pods/97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7/volumes"
Jul 28 15:39:31.788022 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.787946    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7"]
Jul 28 15:39:31.788970 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.788934    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07736af3-fb5a-48f7-9d8a-9383d288d994" containerName="feast-init"
Jul 28 15:39:31.789084 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.788975    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="07736af3-fb5a-48f7-9d8a-9383d288d994" containerName="feast-init"
Jul 28 15:39:31.789084 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.788990    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07736af3-fb5a-48f7-9d8a-9383d288d994" containerName="online"
Jul 28 15:39:31.789084 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.789002    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="07736af3-fb5a-48f7-9d8a-9383d288d994" containerName="online"
Jul 28 15:39:31.789084 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.789040    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7" containerName="offline"
Jul 28 15:39:31.789084 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.789051    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7" containerName="offline"
Jul 28 15:39:31.789084 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.789074    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7" containerName="online"
Jul 28 15:39:31.789084 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.789085    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7" containerName="online"
Jul 28 15:39:31.789527 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.789120    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7" containerName="ui"
Jul 28 15:39:31.789527 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.789129    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7" containerName="ui"
Jul 28 15:39:31.789527 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.789142    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07736af3-fb5a-48f7-9d8a-9383d288d994" containerName="feast-apply"
Jul 28 15:39:31.789527 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.789152    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="07736af3-fb5a-48f7-9d8a-9383d288d994" containerName="feast-apply"
Jul 28 15:39:31.789527 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.789174    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07736af3-fb5a-48f7-9d8a-9383d288d994" containerName="registry"
Jul 28 15:39:31.789527 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.789185    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="07736af3-fb5a-48f7-9d8a-9383d288d994" containerName="registry"
Jul 28 15:39:31.789527 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.789206    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07736af3-fb5a-48f7-9d8a-9383d288d994" containerName="offline"
Jul 28 15:39:31.789527 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.789219    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="07736af3-fb5a-48f7-9d8a-9383d288d994" containerName="offline"
Jul 28 15:39:31.789527 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.789230    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07736af3-fb5a-48f7-9d8a-9383d288d994" containerName="ui"
Jul 28 15:39:31.789527 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.789240    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="07736af3-fb5a-48f7-9d8a-9383d288d994" containerName="ui"
Jul 28 15:39:31.789527 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.789252    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7" containerName="feast-init"
Jul 28 15:39:31.789527 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.789268    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7" containerName="feast-init"
Jul 28 15:39:31.789527 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.789282    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7" containerName="feast-apply"
Jul 28 15:39:31.789527 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.789294    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7" containerName="feast-apply"
Jul 28 15:39:31.789527 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.789450    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="07736af3-fb5a-48f7-9d8a-9383d288d994" containerName="registry"
Jul 28 15:39:31.789527 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.789462    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="07736af3-fb5a-48f7-9d8a-9383d288d994" containerName="ui"
Jul 28 15:39:31.789527 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.789475    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7" containerName="online"
Jul 28 15:39:31.789527 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.789490    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7" containerName="offline"
Jul 28 15:39:31.789527 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.789505    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="07736af3-fb5a-48f7-9d8a-9383d288d994" containerName="offline"
Jul 28 15:39:31.789527 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.789520    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="97e8a0d3-ef7d-4c66-ad08-cc7ff74fc0e7" containerName="ui"
Jul 28 15:39:31.789527 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.789530    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="07736af3-fb5a-48f7-9d8a-9383d288d994" containerName="online"
Jul 28 15:39:31.794517 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.794495    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7"
Jul 28 15:39:31.797578 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.797542    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-registry-tls\""
Jul 28 15:39:31.797578 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.797570    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-ui-tls\""
Jul 28 15:39:31.797813 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.797593    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"openshift-service-ca.crt\""
Jul 28 15:39:31.797900 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.797882    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-offline-tls\""
Jul 28 15:39:31.797956 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.797912    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-pxchd\""
Jul 28 15:39:31.797956 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.797934    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-feast\"/\"kube-root-ca.crt\""
Jul 28 15:39:31.798029 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.797913    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-online-tls\""
Jul 28 15:39:31.804026 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.804008    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7"]
Jul 28 15:39:31.823364 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.823340    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/820b8ad9-52de-4630-a940-4e42503d1645-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-mb4t7\" (UID: \"820b8ad9-52de-4630-a940-4e42503d1645\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7"
Jul 28 15:39:31.823483 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.823397    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/820b8ad9-52de-4630-a940-4e42503d1645-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-mb4t7\" (UID: \"820b8ad9-52de-4630-a940-4e42503d1645\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7"
Jul 28 15:39:31.823483 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.823435    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/820b8ad9-52de-4630-a940-4e42503d1645-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-mb4t7\" (UID: \"820b8ad9-52de-4630-a940-4e42503d1645\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7"
Jul 28 15:39:31.823483 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.823454    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/820b8ad9-52de-4630-a940-4e42503d1645-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-mb4t7\" (UID: \"820b8ad9-52de-4630-a940-4e42503d1645\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7"
Jul 28 15:39:31.823483 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.823475    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/820b8ad9-52de-4630-a940-4e42503d1645-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-mb4t7\" (UID: \"820b8ad9-52de-4630-a940-4e42503d1645\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7"
Jul 28 15:39:31.823614 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.823490    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpcvc\" (UniqueName: \"kubernetes.io/projected/820b8ad9-52de-4630-a940-4e42503d1645-kube-api-access-tpcvc\") pod \"feast-simple-feast-setup-777d6cc998-mb4t7\" (UID: \"820b8ad9-52de-4630-a940-4e42503d1645\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7"
Jul 28 15:39:31.924333 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.924303    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/820b8ad9-52de-4630-a940-4e42503d1645-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-mb4t7\" (UID: \"820b8ad9-52de-4630-a940-4e42503d1645\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7"
Jul 28 15:39:31.924509 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.924338    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/820b8ad9-52de-4630-a940-4e42503d1645-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-mb4t7\" (UID: \"820b8ad9-52de-4630-a940-4e42503d1645\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7"
Jul 28 15:39:31.924509 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.924361    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/820b8ad9-52de-4630-a940-4e42503d1645-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-mb4t7\" (UID: \"820b8ad9-52de-4630-a940-4e42503d1645\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7"
Jul 28 15:39:31.924509 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.924381    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/820b8ad9-52de-4630-a940-4e42503d1645-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-mb4t7\" (UID: \"820b8ad9-52de-4630-a940-4e42503d1645\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7"
Jul 28 15:39:31.924509 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.924396    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpcvc\" (UniqueName: \"kubernetes.io/projected/820b8ad9-52de-4630-a940-4e42503d1645-kube-api-access-tpcvc\") pod \"feast-simple-feast-setup-777d6cc998-mb4t7\" (UID: \"820b8ad9-52de-4630-a940-4e42503d1645\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7"
Jul 28 15:39:31.924509 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.924441    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/820b8ad9-52de-4630-a940-4e42503d1645-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-mb4t7\" (UID: \"820b8ad9-52de-4630-a940-4e42503d1645\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7"
Jul 28 15:39:31.924509 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:39:31.924492    2561 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found
Jul 28 15:39:31.924819 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:39:31.924524    2561 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Jul 28 15:39:31.924819 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:39:31.924568    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/820b8ad9-52de-4630-a940-4e42503d1645-offline-tls podName:820b8ad9-52de-4630-a940-4e42503d1645 nodeName:}" failed. No retries permitted until 2026-07-28 15:39:32.424545339 +0000 UTC m=+1533.474913423 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/820b8ad9-52de-4630-a940-4e42503d1645-offline-tls") pod "feast-simple-feast-setup-777d6cc998-mb4t7" (UID: "820b8ad9-52de-4630-a940-4e42503d1645") : secret "feast-simple-feast-setup-offline-tls" not found
Jul 28 15:39:31.924819 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:39:31.924584    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/820b8ad9-52de-4630-a940-4e42503d1645-ui-tls podName:820b8ad9-52de-4630-a940-4e42503d1645 nodeName:}" failed. No retries permitted until 2026-07-28 15:39:32.424575787 +0000 UTC m=+1533.474943871 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/820b8ad9-52de-4630-a940-4e42503d1645-ui-tls") pod "feast-simple-feast-setup-777d6cc998-mb4t7" (UID: "820b8ad9-52de-4630-a940-4e42503d1645") : secret "feast-simple-feast-setup-ui-tls" not found
Jul 28 15:39:31.924819 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.924702    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/820b8ad9-52de-4630-a940-4e42503d1645-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-mb4t7\" (UID: \"820b8ad9-52de-4630-a940-4e42503d1645\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7"
Jul 28 15:39:31.926727 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.926705    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/820b8ad9-52de-4630-a940-4e42503d1645-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-mb4t7\" (UID: \"820b8ad9-52de-4630-a940-4e42503d1645\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7"
Jul 28 15:39:31.926816 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.926745    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/820b8ad9-52de-4630-a940-4e42503d1645-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-mb4t7\" (UID: \"820b8ad9-52de-4630-a940-4e42503d1645\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7"
Jul 28 15:39:31.934009 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:31.933986    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpcvc\" (UniqueName: \"kubernetes.io/projected/820b8ad9-52de-4630-a940-4e42503d1645-kube-api-access-tpcvc\") pod \"feast-simple-feast-setup-777d6cc998-mb4t7\" (UID: \"820b8ad9-52de-4630-a940-4e42503d1645\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7"
Jul 28 15:39:32.429043 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:32.429010    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/820b8ad9-52de-4630-a940-4e42503d1645-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-mb4t7\" (UID: \"820b8ad9-52de-4630-a940-4e42503d1645\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7"
Jul 28 15:39:32.429234 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:32.429049    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/820b8ad9-52de-4630-a940-4e42503d1645-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-mb4t7\" (UID: \"820b8ad9-52de-4630-a940-4e42503d1645\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7"
Jul 28 15:39:32.431478 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:32.431443    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/820b8ad9-52de-4630-a940-4e42503d1645-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-mb4t7\" (UID: \"820b8ad9-52de-4630-a940-4e42503d1645\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7"
Jul 28 15:39:32.431596 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:32.431448    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/820b8ad9-52de-4630-a940-4e42503d1645-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-mb4t7\" (UID: \"820b8ad9-52de-4630-a940-4e42503d1645\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7"
Jul 28 15:39:32.703620 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:32.703538    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7"
Jul 28 15:39:32.844041 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:32.844016    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7"]
Jul 28 15:39:32.845165 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:39:32.845135    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod820b8ad9_52de_4630_a940_4e42503d1645.slice/crio-748c7cf9be564ccb56333eb5b13cd0d8054e6e9844860b17cd5d2e47d0c02fd0 WatchSource:0}: Error finding container 748c7cf9be564ccb56333eb5b13cd0d8054e6e9844860b17cd5d2e47d0c02fd0: Status 404 returned error can't find the container with id 748c7cf9be564ccb56333eb5b13cd0d8054e6e9844860b17cd5d2e47d0c02fd0
Jul 28 15:39:33.698505 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:33.698464    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7" event={"ID":"820b8ad9-52de-4630-a940-4e42503d1645","Type":"ContainerStarted","Data":"86369105a1ad2c40acdc857e9495869514488ef5e48bdc0056ad43dd61b95dc2"}
Jul 28 15:39:33.698699 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:33.698515    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7" event={"ID":"820b8ad9-52de-4630-a940-4e42503d1645","Type":"ContainerStarted","Data":"748c7cf9be564ccb56333eb5b13cd0d8054e6e9844860b17cd5d2e47d0c02fd0"}
Jul 28 15:39:37.715080 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:37.715044    2561 generic.go:356] "Generic (PLEG): container finished" podID="820b8ad9-52de-4630-a940-4e42503d1645" containerID="86369105a1ad2c40acdc857e9495869514488ef5e48bdc0056ad43dd61b95dc2" exitCode=0
Jul 28 15:39:37.715438 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:37.715106    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7" event={"ID":"820b8ad9-52de-4630-a940-4e42503d1645","Type":"ContainerDied","Data":"86369105a1ad2c40acdc857e9495869514488ef5e48bdc0056ad43dd61b95dc2"}
Jul 28 15:39:38.721079 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:38.721046    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7" event={"ID":"820b8ad9-52de-4630-a940-4e42503d1645","Type":"ContainerStarted","Data":"d5c663a90311c21bbc5c41b7d9eef9a5c75bd43f0f0987c1fa0034318623052d"}
Jul 28 15:39:43.740281 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:43.740244    2561 generic.go:356] "Generic (PLEG): container finished" podID="820b8ad9-52de-4630-a940-4e42503d1645" containerID="d5c663a90311c21bbc5c41b7d9eef9a5c75bd43f0f0987c1fa0034318623052d" exitCode=0
Jul 28 15:39:43.740704 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:43.740288    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7" event={"ID":"820b8ad9-52de-4630-a940-4e42503d1645","Type":"ContainerDied","Data":"d5c663a90311c21bbc5c41b7d9eef9a5c75bd43f0f0987c1fa0034318623052d"}
Jul 28 15:39:44.749537 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:44.749501    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7" event={"ID":"820b8ad9-52de-4630-a940-4e42503d1645","Type":"ContainerStarted","Data":"30c855eb2fa5c79ea0691fdfcf8eecfc1ccafeeedf9896b3c41d61cd8b64d01e"}
Jul 28 15:39:44.750158 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:44.750115    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7" event={"ID":"820b8ad9-52de-4630-a940-4e42503d1645","Type":"ContainerStarted","Data":"83bb1eb38a828c744a33d235d8e3bdd0f3c8ece3f2a4b9521410cbcc8561a701"}
Jul 28 15:39:44.750304 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:44.750288    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7" event={"ID":"820b8ad9-52de-4630-a940-4e42503d1645","Type":"ContainerStarted","Data":"c95f80d7f40c3b80837098857341a35465a2cc81a4a0a247ec6ef54d9493fba1"}
Jul 28 15:39:44.750425 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:44.750412    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7" event={"ID":"820b8ad9-52de-4630-a940-4e42503d1645","Type":"ContainerStarted","Data":"5c3848cd291f9107d5888b463186fdbbdab7729ea2d013b2738b6149fffc0a92"}
Jul 28 15:39:44.779040 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:44.778964    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7" podStartSLOduration=13.778941142 podStartE2EDuration="13.778941142s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:39:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:39:44.775770975 +0000 UTC m=+1545.826139117" watchObservedRunningTime="2026-07-28 15:39:44.778941142 +0000 UTC m=+1545.829309248"
Jul 28 15:39:47.703817 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:47.703769    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7"
Jul 28 15:39:47.704310 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:47.703854    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7"
Jul 28 15:39:47.704310 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:47.703881    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7"
Jul 28 15:39:47.704437 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:47.704338    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7"
Jul 28 15:39:47.705943 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:47.705913    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7" podUID="820b8ad9-52de-4630-a940-4e42503d1645" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.34:8443: connect: connection refused"
Jul 28 15:39:47.706185 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:47.705956    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7" podUID="820b8ad9-52de-4630-a940-4e42503d1645" containerName="online" probeResult="failure" output="Get \"https://10.133.0.34:6567/health\": dial tcp 10.133.0.34:6567: connect: connection refused"
Jul 28 15:39:47.706270 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:47.705960    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7" podUID="820b8ad9-52de-4630-a940-4e42503d1645" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.34:8816: connect: connection refused"
Jul 28 15:39:47.706270 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:47.706000    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7" podUID="820b8ad9-52de-4630-a940-4e42503d1645" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.34:6571: connect: connection refused"
Jul 28 15:39:50.704639 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:50.704582    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7"
Jul 28 15:39:50.705173 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:50.704883    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7"
Jul 28 15:39:50.705279 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:50.705256    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7"
Jul 28 15:39:50.705338 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:50.705302    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7"
Jul 28 15:39:50.705377 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:50.705357    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7"
Jul 28 15:39:50.705474 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:50.705463    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7"
Jul 28 15:39:50.705513 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:50.705498    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7"
Jul 28 15:39:50.709646 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:50.709629    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7"
Jul 28 15:39:50.779634 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:50.779606    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7"
Jul 28 15:39:50.779810 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:50.779648    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7"
Jul 28 15:39:50.780004 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:50.779985    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7"
Jul 28 15:39:50.782648 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:39:50.782626    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7"
Jul 28 15:40:51.824631 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:40:51.824546    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7"]
Jul 28 15:40:51.825434 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:40:51.824856    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7" podUID="820b8ad9-52de-4630-a940-4e42503d1645" containerName="registry" containerID="cri-o://5c3848cd291f9107d5888b463186fdbbdab7729ea2d013b2738b6149fffc0a92" gracePeriod=30
Jul 28 15:40:51.825434 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:40:51.824946    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7" podUID="820b8ad9-52de-4630-a940-4e42503d1645" containerName="ui" containerID="cri-o://30c855eb2fa5c79ea0691fdfcf8eecfc1ccafeeedf9896b3c41d61cd8b64d01e" gracePeriod=30
Jul 28 15:40:51.825434 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:40:51.825056    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7" podUID="820b8ad9-52de-4630-a940-4e42503d1645" containerName="offline" containerID="cri-o://83bb1eb38a828c744a33d235d8e3bdd0f3c8ece3f2a4b9521410cbcc8561a701" gracePeriod=30
Jul 28 15:40:51.825434 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:40:51.825128    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7" podUID="820b8ad9-52de-4630-a940-4e42503d1645" containerName="online" containerID="cri-o://c95f80d7f40c3b80837098857341a35465a2cc81a4a0a247ec6ef54d9493fba1" gracePeriod=30
Jul 28 15:40:52.137001 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:40:52.136966    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46"]
Jul 28 15:40:52.140786 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:40:52.140755    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46"
Jul 28 15:40:52.143775 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:40:52.143749    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-feast\"/\"feast-simple-feast-setup-dockercfg-tj6pq\""
Jul 28 15:40:52.154742 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:40:52.154714    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46"]
Jul 28 15:40:52.279460 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:40:52.279427    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/02c2c611-b60c-415c-867c-25cfbb3772f3-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-m7h46\" (UID: \"02c2c611-b60c-415c-867c-25cfbb3772f3\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46"
Jul 28 15:40:52.279647 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:40:52.279475    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/02c2c611-b60c-415c-867c-25cfbb3772f3-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-m7h46\" (UID: \"02c2c611-b60c-415c-867c-25cfbb3772f3\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46"
Jul 28 15:40:52.279647 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:40:52.279581    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/02c2c611-b60c-415c-867c-25cfbb3772f3-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-m7h46\" (UID: \"02c2c611-b60c-415c-867c-25cfbb3772f3\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46"
Jul 28 15:40:52.279728 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:40:52.279654    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/02c2c611-b60c-415c-867c-25cfbb3772f3-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-m7h46\" (UID: \"02c2c611-b60c-415c-867c-25cfbb3772f3\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46"
Jul 28 15:40:52.279728 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:40:52.279682    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f62s8\" (UniqueName: \"kubernetes.io/projected/02c2c611-b60c-415c-867c-25cfbb3772f3-kube-api-access-f62s8\") pod \"feast-simple-feast-setup-777d6cc998-m7h46\" (UID: \"02c2c611-b60c-415c-867c-25cfbb3772f3\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46"
Jul 28 15:40:52.279728 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:40:52.279715    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/02c2c611-b60c-415c-867c-25cfbb3772f3-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-m7h46\" (UID: \"02c2c611-b60c-415c-867c-25cfbb3772f3\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46"
Jul 28 15:40:52.380814 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:40:52.380769    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/02c2c611-b60c-415c-867c-25cfbb3772f3-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-m7h46\" (UID: \"02c2c611-b60c-415c-867c-25cfbb3772f3\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46"
Jul 28 15:40:52.380814 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:40:52.380808    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f62s8\" (UniqueName: \"kubernetes.io/projected/02c2c611-b60c-415c-867c-25cfbb3772f3-kube-api-access-f62s8\") pod \"feast-simple-feast-setup-777d6cc998-m7h46\" (UID: \"02c2c611-b60c-415c-867c-25cfbb3772f3\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46"
Jul 28 15:40:52.381080 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:40:52.380853    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/02c2c611-b60c-415c-867c-25cfbb3772f3-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-m7h46\" (UID: \"02c2c611-b60c-415c-867c-25cfbb3772f3\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46"
Jul 28 15:40:52.381080 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:40:52.380888    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/02c2c611-b60c-415c-867c-25cfbb3772f3-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-m7h46\" (UID: \"02c2c611-b60c-415c-867c-25cfbb3772f3\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46"
Jul 28 15:40:52.381080 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:40:52.380918    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/02c2c611-b60c-415c-867c-25cfbb3772f3-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-m7h46\" (UID: \"02c2c611-b60c-415c-867c-25cfbb3772f3\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46"
Jul 28 15:40:52.381080 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:40:52.380940    2561 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-ui-tls: secret "feast-simple-feast-setup-ui-tls" not found
Jul 28 15:40:52.381080 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:40:52.380961    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/02c2c611-b60c-415c-867c-25cfbb3772f3-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-m7h46\" (UID: \"02c2c611-b60c-415c-867c-25cfbb3772f3\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46"
Jul 28 15:40:52.381080 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:40:52.381007    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02c2c611-b60c-415c-867c-25cfbb3772f3-ui-tls podName:02c2c611-b60c-415c-867c-25cfbb3772f3 nodeName:}" failed. No retries permitted until 2026-07-28 15:40:52.880985054 +0000 UTC m=+1613.931353137 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "ui-tls" (UniqueName: "kubernetes.io/secret/02c2c611-b60c-415c-867c-25cfbb3772f3-ui-tls") pod "feast-simple-feast-setup-777d6cc998-m7h46" (UID: "02c2c611-b60c-415c-867c-25cfbb3772f3") : secret "feast-simple-feast-setup-ui-tls" not found
Jul 28 15:40:52.381080 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:40:52.381048    2561 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-registry-tls: secret "feast-simple-feast-setup-registry-tls" not found
Jul 28 15:40:52.381421 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:40:52.381102    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02c2c611-b60c-415c-867c-25cfbb3772f3-registry-tls podName:02c2c611-b60c-415c-867c-25cfbb3772f3 nodeName:}" failed. No retries permitted until 2026-07-28 15:40:52.881085401 +0000 UTC m=+1613.931453483 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/secret/02c2c611-b60c-415c-867c-25cfbb3772f3-registry-tls") pod "feast-simple-feast-setup-777d6cc998-m7h46" (UID: "02c2c611-b60c-415c-867c-25cfbb3772f3") : secret "feast-simple-feast-setup-registry-tls" not found
Jul 28 15:40:52.381421 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:40:52.381147    2561 secret.go:189] Couldn't get secret test-ns-feast/feast-simple-feast-setup-offline-tls: secret "feast-simple-feast-setup-offline-tls" not found
Jul 28 15:40:52.381421 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:40:52.381207    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02c2c611-b60c-415c-867c-25cfbb3772f3-offline-tls podName:02c2c611-b60c-415c-867c-25cfbb3772f3 nodeName:}" failed. No retries permitted until 2026-07-28 15:40:52.881193945 +0000 UTC m=+1613.931562034 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/02c2c611-b60c-415c-867c-25cfbb3772f3-offline-tls") pod "feast-simple-feast-setup-777d6cc998-m7h46" (UID: "02c2c611-b60c-415c-867c-25cfbb3772f3") : secret "feast-simple-feast-setup-offline-tls" not found
Jul 28 15:40:52.381421 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:40:52.381315    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/02c2c611-b60c-415c-867c-25cfbb3772f3-feast-data\") pod \"feast-simple-feast-setup-777d6cc998-m7h46\" (UID: \"02c2c611-b60c-415c-867c-25cfbb3772f3\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46"
Jul 28 15:40:52.383333 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:40:52.383309    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/02c2c611-b60c-415c-867c-25cfbb3772f3-online-tls\") pod \"feast-simple-feast-setup-777d6cc998-m7h46\" (UID: \"02c2c611-b60c-415c-867c-25cfbb3772f3\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46"
Jul 28 15:40:52.394340 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:40:52.394269    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f62s8\" (UniqueName: \"kubernetes.io/projected/02c2c611-b60c-415c-867c-25cfbb3772f3-kube-api-access-f62s8\") pod \"feast-simple-feast-setup-777d6cc998-m7h46\" (UID: \"02c2c611-b60c-415c-867c-25cfbb3772f3\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46"
Jul 28 15:40:52.884478 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:40:52.884430    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/02c2c611-b60c-415c-867c-25cfbb3772f3-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-m7h46\" (UID: \"02c2c611-b60c-415c-867c-25cfbb3772f3\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46"
Jul 28 15:40:52.884909 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:40:52.884518    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/02c2c611-b60c-415c-867c-25cfbb3772f3-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-m7h46\" (UID: \"02c2c611-b60c-415c-867c-25cfbb3772f3\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46"
Jul 28 15:40:52.884909 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:40:52.884565    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/02c2c611-b60c-415c-867c-25cfbb3772f3-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-m7h46\" (UID: \"02c2c611-b60c-415c-867c-25cfbb3772f3\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46"
Jul 28 15:40:52.887021 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:40:52.886988    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/02c2c611-b60c-415c-867c-25cfbb3772f3-ui-tls\") pod \"feast-simple-feast-setup-777d6cc998-m7h46\" (UID: \"02c2c611-b60c-415c-867c-25cfbb3772f3\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46"
Jul 28 15:40:52.887021 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:40:52.887016    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/02c2c611-b60c-415c-867c-25cfbb3772f3-offline-tls\") pod \"feast-simple-feast-setup-777d6cc998-m7h46\" (UID: \"02c2c611-b60c-415c-867c-25cfbb3772f3\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46"
Jul 28 15:40:52.887171 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:40:52.887063    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/02c2c611-b60c-415c-867c-25cfbb3772f3-registry-tls\") pod \"feast-simple-feast-setup-777d6cc998-m7h46\" (UID: \"02c2c611-b60c-415c-867c-25cfbb3772f3\") " pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46"
Jul 28 15:40:53.014347 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:40:53.014308    2561 generic.go:356] "Generic (PLEG): container finished" podID="820b8ad9-52de-4630-a940-4e42503d1645" containerID="30c855eb2fa5c79ea0691fdfcf8eecfc1ccafeeedf9896b3c41d61cd8b64d01e" exitCode=0
Jul 28 15:40:53.014347 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:40:53.014338    2561 generic.go:356] "Generic (PLEG): container finished" podID="820b8ad9-52de-4630-a940-4e42503d1645" containerID="c95f80d7f40c3b80837098857341a35465a2cc81a4a0a247ec6ef54d9493fba1" exitCode=0
Jul 28 15:40:53.014559 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:40:53.014365    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7" event={"ID":"820b8ad9-52de-4630-a940-4e42503d1645","Type":"ContainerDied","Data":"30c855eb2fa5c79ea0691fdfcf8eecfc1ccafeeedf9896b3c41d61cd8b64d01e"}
Jul 28 15:40:53.014559 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:40:53.014401    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7" event={"ID":"820b8ad9-52de-4630-a940-4e42503d1645","Type":"ContainerDied","Data":"c95f80d7f40c3b80837098857341a35465a2cc81a4a0a247ec6ef54d9493fba1"}
Jul 28 15:40:53.050574 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:40:53.050541    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46"
Jul 28 15:40:53.185981 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:40:53.185959    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46"]
Jul 28 15:40:53.187235 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:40:53.187208    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod02c2c611_b60c_415c_867c_25cfbb3772f3.slice/crio-451615443ef12979191703959d2f5e230aa04e1e9485353a792e2036b3ff1273 WatchSource:0}: Error finding container 451615443ef12979191703959d2f5e230aa04e1e9485353a792e2036b3ff1273: Status 404 returned error can't find the container with id 451615443ef12979191703959d2f5e230aa04e1e9485353a792e2036b3ff1273
Jul 28 15:40:54.019945 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:40:54.019909    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46" event={"ID":"02c2c611-b60c-415c-867c-25cfbb3772f3","Type":"ContainerStarted","Data":"4de9ff8e4cd12e7b405eaf6b4d2193d85621b03c580aaa6342a40ba348e90b1d"}
Jul 28 15:40:54.020346 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:40:54.019953    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46" event={"ID":"02c2c611-b60c-415c-867c-25cfbb3772f3","Type":"ContainerStarted","Data":"451615443ef12979191703959d2f5e230aa04e1e9485353a792e2036b3ff1273"}
Jul 28 15:40:58.036299 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:40:58.036268    2561 generic.go:356] "Generic (PLEG): container finished" podID="02c2c611-b60c-415c-867c-25cfbb3772f3" containerID="4de9ff8e4cd12e7b405eaf6b4d2193d85621b03c580aaa6342a40ba348e90b1d" exitCode=0
Jul 28 15:40:58.036657 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:40:58.036351    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46" event={"ID":"02c2c611-b60c-415c-867c-25cfbb3772f3","Type":"ContainerDied","Data":"4de9ff8e4cd12e7b405eaf6b4d2193d85621b03c580aaa6342a40ba348e90b1d"}
Jul 28 15:40:59.041351 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:40:59.041319    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46" event={"ID":"02c2c611-b60c-415c-867c-25cfbb3772f3","Type":"ContainerStarted","Data":"2a20ea3588bc06f99ae562fc89ebd077f94c52cdbd5c01b8707f14581cd9afb0"}
Jul 28 15:41:00.705469 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:00.705427    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7" podUID="820b8ad9-52de-4630-a940-4e42503d1645" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.34:8443: connect: connection refused"
Jul 28 15:41:00.780179 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:00.780132    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7" podUID="820b8ad9-52de-4630-a940-4e42503d1645" containerName="online" probeResult="failure" output="Get \"https://10.133.0.34:6567/health\": dial tcp 10.133.0.34:6567: connect: connection refused"
Jul 28 15:41:04.063467 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:04.063380    2561 generic.go:356] "Generic (PLEG): container finished" podID="02c2c611-b60c-415c-867c-25cfbb3772f3" containerID="2a20ea3588bc06f99ae562fc89ebd077f94c52cdbd5c01b8707f14581cd9afb0" exitCode=0
Jul 28 15:41:04.063467 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:04.063422    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46" event={"ID":"02c2c611-b60c-415c-867c-25cfbb3772f3","Type":"ContainerDied","Data":"2a20ea3588bc06f99ae562fc89ebd077f94c52cdbd5c01b8707f14581cd9afb0"}
Jul 28 15:41:05.073225 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:05.073185    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46" event={"ID":"02c2c611-b60c-415c-867c-25cfbb3772f3","Type":"ContainerStarted","Data":"b62ae9372a0369a999f3770b24fb57d126d16997be12043a9091c84ecd3d9b2f"}
Jul 28 15:41:05.073743 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:05.073250    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46" event={"ID":"02c2c611-b60c-415c-867c-25cfbb3772f3","Type":"ContainerStarted","Data":"7d9a1853e73e2d5d7c367e7c1cfe1551fbe7f1a59f0772eb8c465edcae961198"}
Jul 28 15:41:05.073743 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:05.073271    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46" event={"ID":"02c2c611-b60c-415c-867c-25cfbb3772f3","Type":"ContainerStarted","Data":"cb3341df54edd497f76ab4a72a739a24b235601065b1bf917af698e1e1cce2b1"}
Jul 28 15:41:05.073743 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:05.073290    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46" event={"ID":"02c2c611-b60c-415c-867c-25cfbb3772f3","Type":"ContainerStarted","Data":"1947d0897353377e0d75e3d68656bd2f055186e7ab3462dae51c8c7d23f9f0a1"}
Jul 28 15:41:05.101316 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:05.101253    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46" podStartSLOduration=13.10123035 podStartE2EDuration="13.10123035s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:40:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:41:05.098430925 +0000 UTC m=+1626.148799033" watchObservedRunningTime="2026-07-28 15:41:05.10123035 +0000 UTC m=+1626.151598456"
Jul 28 15:41:08.051795 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:08.051197    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46"
Jul 28 15:41:08.052386 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:08.052361    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46"
Jul 28 15:41:08.052527 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:08.052395    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46"
Jul 28 15:41:08.052527 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:08.052416    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46"
Jul 28 15:41:08.053602 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:08.053559    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46" podUID="02c2c611-b60c-415c-867c-25cfbb3772f3" containerName="registry" probeResult="failure" output="dial tcp 10.133.0.35:6571: connect: connection refused"
Jul 28 15:41:08.054005 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:08.053976    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46" podUID="02c2c611-b60c-415c-867c-25cfbb3772f3" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.35:8816: connect: connection refused"
Jul 28 15:41:08.054195 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:08.053981    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46" podUID="02c2c611-b60c-415c-867c-25cfbb3772f3" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.35:8443: connect: connection refused"
Jul 28 15:41:08.054307 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:08.053980    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46" podUID="02c2c611-b60c-415c-867c-25cfbb3772f3" containerName="online" probeResult="failure" output="Get \"https://10.133.0.35:6567/health\": dial tcp 10.133.0.35:6567: connect: connection refused"
Jul 28 15:41:10.705844 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:10.705783    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7" podUID="820b8ad9-52de-4630-a940-4e42503d1645" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.34:8443: connect: connection refused"
Jul 28 15:41:10.779963 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:10.779924    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7" podUID="820b8ad9-52de-4630-a940-4e42503d1645" containerName="online" probeResult="failure" output="Get \"https://10.133.0.34:6567/health\": dial tcp 10.133.0.34:6567: connect: connection refused"
Jul 28 15:41:11.052211 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:11.052102    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46"
Jul 28 15:41:11.052354 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:11.052265    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46"
Jul 28 15:41:11.052554 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:11.052540    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46"
Jul 28 15:41:11.052683 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:11.052660    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46"
Jul 28 15:41:11.052751 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:11.052704    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46"
Jul 28 15:41:11.052751 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:11.052722    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46"
Jul 28 15:41:11.053122 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:11.053073    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46"
Jul 28 15:41:11.053238 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:11.053140    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46"
Jul 28 15:41:11.053238 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:11.053187    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46"
Jul 28 15:41:11.057451 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:11.057435    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46"
Jul 28 15:41:11.104359 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:11.104333    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46"
Jul 28 15:41:11.107315 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:11.107296    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46"
Jul 28 15:41:20.705696 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:20.705651    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7" podUID="820b8ad9-52de-4630-a940-4e42503d1645" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.34:8443: connect: connection refused"
Jul 28 15:41:20.706143 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:20.705808    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7"
Jul 28 15:41:20.780222 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:20.780180    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7" podUID="820b8ad9-52de-4630-a940-4e42503d1645" containerName="online" probeResult="failure" output="Get \"https://10.133.0.34:6567/health\": dial tcp 10.133.0.34:6567: connect: connection refused"
Jul 28 15:41:20.780398 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:20.780308    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7"
Jul 28 15:41:22.148969 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:22.148881    2561 generic.go:356] "Generic (PLEG): container finished" podID="820b8ad9-52de-4630-a940-4e42503d1645" containerID="83bb1eb38a828c744a33d235d8e3bdd0f3c8ece3f2a4b9521410cbcc8561a701" exitCode=137
Jul 28 15:41:22.148969 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:22.148904    2561 generic.go:356] "Generic (PLEG): container finished" podID="820b8ad9-52de-4630-a940-4e42503d1645" containerID="5c3848cd291f9107d5888b463186fdbbdab7729ea2d013b2738b6149fffc0a92" exitCode=137
Jul 28 15:41:22.148969 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:22.148937    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7" event={"ID":"820b8ad9-52de-4630-a940-4e42503d1645","Type":"ContainerDied","Data":"83bb1eb38a828c744a33d235d8e3bdd0f3c8ece3f2a4b9521410cbcc8561a701"}
Jul 28 15:41:22.148969 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:22.148966    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7" event={"ID":"820b8ad9-52de-4630-a940-4e42503d1645","Type":"ContainerDied","Data":"5c3848cd291f9107d5888b463186fdbbdab7729ea2d013b2738b6149fffc0a92"}
Jul 28 15:41:22.468034 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:22.468005    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7"
Jul 28 15:41:22.528891 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:22.528863    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/820b8ad9-52de-4630-a940-4e42503d1645-registry-tls\") pod \"820b8ad9-52de-4630-a940-4e42503d1645\" (UID: \"820b8ad9-52de-4630-a940-4e42503d1645\") "
Jul 28 15:41:22.528891 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:22.528892    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/820b8ad9-52de-4630-a940-4e42503d1645-online-tls\") pod \"820b8ad9-52de-4630-a940-4e42503d1645\" (UID: \"820b8ad9-52de-4630-a940-4e42503d1645\") "
Jul 28 15:41:22.529123 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:22.528922    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/820b8ad9-52de-4630-a940-4e42503d1645-feast-data\") pod \"820b8ad9-52de-4630-a940-4e42503d1645\" (UID: \"820b8ad9-52de-4630-a940-4e42503d1645\") "
Jul 28 15:41:22.529123 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:22.528946    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tpcvc\" (UniqueName: \"kubernetes.io/projected/820b8ad9-52de-4630-a940-4e42503d1645-kube-api-access-tpcvc\") pod \"820b8ad9-52de-4630-a940-4e42503d1645\" (UID: \"820b8ad9-52de-4630-a940-4e42503d1645\") "
Jul 28 15:41:22.529123 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:22.528997    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/820b8ad9-52de-4630-a940-4e42503d1645-offline-tls\") pod \"820b8ad9-52de-4630-a940-4e42503d1645\" (UID: \"820b8ad9-52de-4630-a940-4e42503d1645\") "
Jul 28 15:41:22.529123 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:22.529032    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/820b8ad9-52de-4630-a940-4e42503d1645-ui-tls\") pod \"820b8ad9-52de-4630-a940-4e42503d1645\" (UID: \"820b8ad9-52de-4630-a940-4e42503d1645\") "
Jul 28 15:41:22.529471 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:22.529445    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/820b8ad9-52de-4630-a940-4e42503d1645-feast-data" (OuterVolumeSpecName: "feast-data") pod "820b8ad9-52de-4630-a940-4e42503d1645" (UID: "820b8ad9-52de-4630-a940-4e42503d1645"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 15:41:22.531219 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:22.531191    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/820b8ad9-52de-4630-a940-4e42503d1645-online-tls" (OuterVolumeSpecName: "online-tls") pod "820b8ad9-52de-4630-a940-4e42503d1645" (UID: "820b8ad9-52de-4630-a940-4e42503d1645"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 15:41:22.531440 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:22.531422    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/820b8ad9-52de-4630-a940-4e42503d1645-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "820b8ad9-52de-4630-a940-4e42503d1645" (UID: "820b8ad9-52de-4630-a940-4e42503d1645"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 15:41:22.531516 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:22.531451    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/820b8ad9-52de-4630-a940-4e42503d1645-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "820b8ad9-52de-4630-a940-4e42503d1645" (UID: "820b8ad9-52de-4630-a940-4e42503d1645"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 15:41:22.531563 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:22.531523    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/820b8ad9-52de-4630-a940-4e42503d1645-kube-api-access-tpcvc" (OuterVolumeSpecName: "kube-api-access-tpcvc") pod "820b8ad9-52de-4630-a940-4e42503d1645" (UID: "820b8ad9-52de-4630-a940-4e42503d1645"). InnerVolumeSpecName "kube-api-access-tpcvc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 15:41:22.531563 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:22.531522    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/820b8ad9-52de-4630-a940-4e42503d1645-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "820b8ad9-52de-4630-a940-4e42503d1645" (UID: "820b8ad9-52de-4630-a940-4e42503d1645"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 15:41:22.629689 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:22.629663    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tpcvc\" (UniqueName: \"kubernetes.io/projected/820b8ad9-52de-4630-a940-4e42503d1645-kube-api-access-tpcvc\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:41:22.629689 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:22.629688    2561 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/820b8ad9-52de-4630-a940-4e42503d1645-offline-tls\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:41:22.629877 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:22.629700    2561 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/820b8ad9-52de-4630-a940-4e42503d1645-ui-tls\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:41:22.629877 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:22.629709    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/820b8ad9-52de-4630-a940-4e42503d1645-registry-tls\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:41:22.629877 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:22.629736    2561 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/820b8ad9-52de-4630-a940-4e42503d1645-online-tls\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:41:22.629877 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:22.629743    2561 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/820b8ad9-52de-4630-a940-4e42503d1645-feast-data\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:41:23.155890 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:23.155847    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7" event={"ID":"820b8ad9-52de-4630-a940-4e42503d1645","Type":"ContainerDied","Data":"748c7cf9be564ccb56333eb5b13cd0d8054e6e9844860b17cd5d2e47d0c02fd0"}
Jul 28 15:41:23.155890 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:23.155879    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7"
Jul 28 15:41:23.156439 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:23.155916    2561 scope.go:117] "RemoveContainer" containerID="30c855eb2fa5c79ea0691fdfcf8eecfc1ccafeeedf9896b3c41d61cd8b64d01e"
Jul 28 15:41:23.165059 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:23.165042    2561 scope.go:117] "RemoveContainer" containerID="83bb1eb38a828c744a33d235d8e3bdd0f3c8ece3f2a4b9521410cbcc8561a701"
Jul 28 15:41:23.172427 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:23.172409    2561 scope.go:117] "RemoveContainer" containerID="c95f80d7f40c3b80837098857341a35465a2cc81a4a0a247ec6ef54d9493fba1"
Jul 28 15:41:23.180982 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:23.180951    2561 scope.go:117] "RemoveContainer" containerID="5c3848cd291f9107d5888b463186fdbbdab7729ea2d013b2738b6149fffc0a92"
Jul 28 15:41:23.181213 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:23.181163    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7"]
Jul 28 15:41:23.184947 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:23.184924    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-mb4t7"]
Jul 28 15:41:23.191959 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:23.191939    2561 scope.go:117] "RemoveContainer" containerID="d5c663a90311c21bbc5c41b7d9eef9a5c75bd43f0f0987c1fa0034318623052d"
Jul 28 15:41:23.198804 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:23.198787    2561 scope.go:117] "RemoveContainer" containerID="86369105a1ad2c40acdc857e9495869514488ef5e48bdc0056ad43dd61b95dc2"
Jul 28 15:41:23.410219 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:41:23.410140    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="820b8ad9-52de-4630-a940-4e42503d1645" path="/var/lib/kubelet/pods/820b8ad9-52de-4630-a940-4e42503d1645/volumes"
Jul 28 15:42:13.647071 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:13.647040    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn"]
Jul 28 15:42:13.647481 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:13.647331    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="820b8ad9-52de-4630-a940-4e42503d1645" containerName="registry"
Jul 28 15:42:13.647481 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:13.647342    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="820b8ad9-52de-4630-a940-4e42503d1645" containerName="registry"
Jul 28 15:42:13.647481 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:13.647351    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="820b8ad9-52de-4630-a940-4e42503d1645" containerName="offline"
Jul 28 15:42:13.647481 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:13.647356    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="820b8ad9-52de-4630-a940-4e42503d1645" containerName="offline"
Jul 28 15:42:13.647481 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:13.647382    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="820b8ad9-52de-4630-a940-4e42503d1645" containerName="online"
Jul 28 15:42:13.647481 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:13.647388    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="820b8ad9-52de-4630-a940-4e42503d1645" containerName="online"
Jul 28 15:42:13.647481 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:13.647400    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="820b8ad9-52de-4630-a940-4e42503d1645" containerName="feast-apply"
Jul 28 15:42:13.647481 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:13.647404    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="820b8ad9-52de-4630-a940-4e42503d1645" containerName="feast-apply"
Jul 28 15:42:13.647481 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:13.647410    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="820b8ad9-52de-4630-a940-4e42503d1645" containerName="ui"
Jul 28 15:42:13.647481 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:13.647415    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="820b8ad9-52de-4630-a940-4e42503d1645" containerName="ui"
Jul 28 15:42:13.647481 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:13.647422    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="820b8ad9-52de-4630-a940-4e42503d1645" containerName="feast-init"
Jul 28 15:42:13.647481 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:13.647427    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="820b8ad9-52de-4630-a940-4e42503d1645" containerName="feast-init"
Jul 28 15:42:13.647481 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:13.647480    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="820b8ad9-52de-4630-a940-4e42503d1645" containerName="offline"
Jul 28 15:42:13.647912 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:13.647490    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="820b8ad9-52de-4630-a940-4e42503d1645" containerName="online"
Jul 28 15:42:13.647912 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:13.647497    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="820b8ad9-52de-4630-a940-4e42503d1645" containerName="ui"
Jul 28 15:42:13.647912 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:13.647503    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="820b8ad9-52de-4630-a940-4e42503d1645" containerName="registry"
Jul 28 15:42:13.651048 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:13.651026    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn"
Jul 28 15:42:13.653784 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:13.653766    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-online-tls\""
Jul 28 15:42:13.653973 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:13.653958    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-ui-tls\""
Jul 28 15:42:13.654055 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:13.653980    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"kube-root-ca.crt\""
Jul 28 15:42:13.654144 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:13.654129    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-client-ca\""
Jul 28 15:42:13.654206 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:13.654193    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-offline-tls\""
Jul 28 15:42:13.654271 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:13.654254    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"test-ns-remote-registry\"/\"openshift-service-ca.crt\""
Jul 28 15:42:13.655252 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:13.655237    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"test-ns-remote-registry\"/\"feast-simple-feast-remote-setup-dockercfg-hr8gt\""
Jul 28 15:42:13.664272 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:13.664251    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn"]
Jul 28 15:42:13.719422 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:13.719393    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b37feca8-b636-4434-b428-9d25e04848b6-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-6vhtn\" (UID: \"b37feca8-b636-4434-b428-9d25e04848b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn"
Jul 28 15:42:13.719422 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:13.719427    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnkjd\" (UniqueName: \"kubernetes.io/projected/b37feca8-b636-4434-b428-9d25e04848b6-kube-api-access-xnkjd\") pod \"feast-simple-feast-remote-setup-db6955c6c-6vhtn\" (UID: \"b37feca8-b636-4434-b428-9d25e04848b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn"
Jul 28 15:42:13.719629 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:13.719455    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b37feca8-b636-4434-b428-9d25e04848b6-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-6vhtn\" (UID: \"b37feca8-b636-4434-b428-9d25e04848b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn"
Jul 28 15:42:13.719629 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:13.719515    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b37feca8-b636-4434-b428-9d25e04848b6-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-6vhtn\" (UID: \"b37feca8-b636-4434-b428-9d25e04848b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn"
Jul 28 15:42:13.719629 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:13.719566    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/b37feca8-b636-4434-b428-9d25e04848b6-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-6vhtn\" (UID: \"b37feca8-b636-4434-b428-9d25e04848b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn"
Jul 28 15:42:13.719629 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:13.719582    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b37feca8-b636-4434-b428-9d25e04848b6-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-6vhtn\" (UID: \"b37feca8-b636-4434-b428-9d25e04848b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn"
Jul 28 15:42:13.820540 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:13.820513    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b37feca8-b636-4434-b428-9d25e04848b6-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-6vhtn\" (UID: \"b37feca8-b636-4434-b428-9d25e04848b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn"
Jul 28 15:42:13.820697 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:13.820546    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnkjd\" (UniqueName: \"kubernetes.io/projected/b37feca8-b636-4434-b428-9d25e04848b6-kube-api-access-xnkjd\") pod \"feast-simple-feast-remote-setup-db6955c6c-6vhtn\" (UID: \"b37feca8-b636-4434-b428-9d25e04848b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn"
Jul 28 15:42:13.820697 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:13.820579    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b37feca8-b636-4434-b428-9d25e04848b6-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-6vhtn\" (UID: \"b37feca8-b636-4434-b428-9d25e04848b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn"
Jul 28 15:42:13.820697 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:13.820613    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b37feca8-b636-4434-b428-9d25e04848b6-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-6vhtn\" (UID: \"b37feca8-b636-4434-b428-9d25e04848b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn"
Jul 28 15:42:13.820697 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:13.820667    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/b37feca8-b636-4434-b428-9d25e04848b6-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-6vhtn\" (UID: \"b37feca8-b636-4434-b428-9d25e04848b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn"
Jul 28 15:42:13.820697 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:13.820689    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b37feca8-b636-4434-b428-9d25e04848b6-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-6vhtn\" (UID: \"b37feca8-b636-4434-b428-9d25e04848b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn"
Jul 28 15:42:13.820993 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:42:13.820738    2561 secret.go:189] Couldn't get secret test-ns-remote-registry/feast-simple-feast-remote-setup-offline-tls: secret "feast-simple-feast-remote-setup-offline-tls" not found
Jul 28 15:42:13.820993 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:42:13.820852    2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b37feca8-b636-4434-b428-9d25e04848b6-offline-tls podName:b37feca8-b636-4434-b428-9d25e04848b6 nodeName:}" failed. No retries permitted until 2026-07-28 15:42:14.320809011 +0000 UTC m=+1695.371177100 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "offline-tls" (UniqueName: "kubernetes.io/secret/b37feca8-b636-4434-b428-9d25e04848b6-offline-tls") pod "feast-simple-feast-remote-setup-db6955c6c-6vhtn" (UID: "b37feca8-b636-4434-b428-9d25e04848b6") : secret "feast-simple-feast-remote-setup-offline-tls" not found
Jul 28 15:42:13.821134 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:13.821112    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b37feca8-b636-4434-b428-9d25e04848b6-feast-data\") pod \"feast-simple-feast-remote-setup-db6955c6c-6vhtn\" (UID: \"b37feca8-b636-4434-b428-9d25e04848b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn"
Jul 28 15:42:13.821419 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:13.821397    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/b37feca8-b636-4434-b428-9d25e04848b6-registry-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-6vhtn\" (UID: \"b37feca8-b636-4434-b428-9d25e04848b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn"
Jul 28 15:42:13.823087 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:13.823061    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b37feca8-b636-4434-b428-9d25e04848b6-online-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-6vhtn\" (UID: \"b37feca8-b636-4434-b428-9d25e04848b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn"
Jul 28 15:42:13.823189 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:13.823096    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b37feca8-b636-4434-b428-9d25e04848b6-ui-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-6vhtn\" (UID: \"b37feca8-b636-4434-b428-9d25e04848b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn"
Jul 28 15:42:13.831642 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:13.831616    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnkjd\" (UniqueName: \"kubernetes.io/projected/b37feca8-b636-4434-b428-9d25e04848b6-kube-api-access-xnkjd\") pod \"feast-simple-feast-remote-setup-db6955c6c-6vhtn\" (UID: \"b37feca8-b636-4434-b428-9d25e04848b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn"
Jul 28 15:42:14.324300 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:14.324267    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b37feca8-b636-4434-b428-9d25e04848b6-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-6vhtn\" (UID: \"b37feca8-b636-4434-b428-9d25e04848b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn"
Jul 28 15:42:14.326579 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:14.326553    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b37feca8-b636-4434-b428-9d25e04848b6-offline-tls\") pod \"feast-simple-feast-remote-setup-db6955c6c-6vhtn\" (UID: \"b37feca8-b636-4434-b428-9d25e04848b6\") " pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn"
Jul 28 15:42:14.560702 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:14.560654    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn"
Jul 28 15:42:14.697914 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:14.697888    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn"]
Jul 28 15:42:14.699441 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:42:14.699415    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb37feca8_b636_4434_b428_9d25e04848b6.slice/crio-4d906c369ffb98c21a4e294da4b3f26166c9b252c3b87c6234b0194d2c6c275f WatchSource:0}: Error finding container 4d906c369ffb98c21a4e294da4b3f26166c9b252c3b87c6234b0194d2c6c275f: Status 404 returned error can't find the container with id 4d906c369ffb98c21a4e294da4b3f26166c9b252c3b87c6234b0194d2c6c275f
Jul 28 15:42:15.355644 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:15.355606    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn" event={"ID":"b37feca8-b636-4434-b428-9d25e04848b6","Type":"ContainerStarted","Data":"1646bcf7229345ef1a3e6c3c0d6942b21208ed62f572f86b26d66f70b7ab60eb"}
Jul 28 15:42:15.355644 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:15.355651    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn" event={"ID":"b37feca8-b636-4434-b428-9d25e04848b6","Type":"ContainerStarted","Data":"4d906c369ffb98c21a4e294da4b3f26166c9b252c3b87c6234b0194d2c6c275f"}
Jul 28 15:42:19.378439 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:19.378406    2561 generic.go:356] "Generic (PLEG): container finished" podID="b37feca8-b636-4434-b428-9d25e04848b6" containerID="1646bcf7229345ef1a3e6c3c0d6942b21208ed62f572f86b26d66f70b7ab60eb" exitCode=0
Jul 28 15:42:19.378793 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:19.378474    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn" event={"ID":"b37feca8-b636-4434-b428-9d25e04848b6","Type":"ContainerDied","Data":"1646bcf7229345ef1a3e6c3c0d6942b21208ed62f572f86b26d66f70b7ab60eb"}
Jul 28 15:42:20.384601 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:20.384561    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn" event={"ID":"b37feca8-b636-4434-b428-9d25e04848b6","Type":"ContainerStarted","Data":"2321e8babb9a817351ec8d27c89a762457739409209a8982813ad37a86cc6e32"}
Jul 28 15:42:25.405767 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:25.405685    2561 generic.go:356] "Generic (PLEG): container finished" podID="b37feca8-b636-4434-b428-9d25e04848b6" containerID="2321e8babb9a817351ec8d27c89a762457739409209a8982813ad37a86cc6e32" exitCode=0
Jul 28 15:42:25.408964 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:25.408934    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn" event={"ID":"b37feca8-b636-4434-b428-9d25e04848b6","Type":"ContainerDied","Data":"2321e8babb9a817351ec8d27c89a762457739409209a8982813ad37a86cc6e32"}
Jul 28 15:42:26.414404 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:26.414363    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn" event={"ID":"b37feca8-b636-4434-b428-9d25e04848b6","Type":"ContainerStarted","Data":"97ec44d785abe89281f2e5780113669c639912ebd6c53f70f7b391d3a240451b"}
Jul 28 15:42:26.414942 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:26.414428    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn" event={"ID":"b37feca8-b636-4434-b428-9d25e04848b6","Type":"ContainerStarted","Data":"71106187da86049639c74a95ee6b60ac154ef91282a9d07e9328ea5e3d601aff"}
Jul 28 15:42:26.414942 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:26.414448    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn" event={"ID":"b37feca8-b636-4434-b428-9d25e04848b6","Type":"ContainerStarted","Data":"8f4ea535594a6d7a8709f15a626f646338c85c3aa8906082596d84db423f7064"}
Jul 28 15:42:26.439787 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:26.439729    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn" podStartSLOduration=13.43971294 podStartE2EDuration="13.43971294s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:42:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:42:26.437592894 +0000 UTC m=+1707.487961023" watchObservedRunningTime="2026-07-28 15:42:26.43971294 +0000 UTC m=+1707.490081045"
Jul 28 15:42:26.560992 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:26.560956    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn"
Jul 28 15:42:26.561192 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:26.561010    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn"
Jul 28 15:42:26.561192 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:26.561047    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn"
Jul 28 15:42:26.562857 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:26.562786    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn" podUID="b37feca8-b636-4434-b428-9d25e04848b6" containerName="online" probeResult="failure" output="Get \"https://10.133.0.36:6567/health\": dial tcp 10.133.0.36:6567: connect: connection refused"
Jul 28 15:42:26.562857 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:26.562818    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn" podUID="b37feca8-b636-4434-b428-9d25e04848b6" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.36:8816: connect: connection refused"
Jul 28 15:42:26.563090 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:26.562794    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn" podUID="b37feca8-b636-4434-b428-9d25e04848b6" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.36:8443: connect: connection refused"
Jul 28 15:42:29.561955 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:29.561911    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn" podUID="b37feca8-b636-4434-b428-9d25e04848b6" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.36:8443: connect: connection refused"
Jul 28 15:42:29.562459 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:29.561915    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn" podUID="b37feca8-b636-4434-b428-9d25e04848b6" containerName="online" probeResult="failure" output="Get \"https://10.133.0.36:6567/health\": dial tcp 10.133.0.36:6567: connect: connection refused"
Jul 28 15:42:29.562459 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:29.561911    2561 prober.go:120] "Probe failed" probeType="Startup" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn" podUID="b37feca8-b636-4434-b428-9d25e04848b6" containerName="offline" probeResult="failure" output="dial tcp 10.133.0.36:8816: connect: connection refused"
Jul 28 15:42:32.562553 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:32.562525    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn"
Jul 28 15:42:32.562966 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:32.562644    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn"
Jul 28 15:42:32.563023 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:32.562996    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn"
Jul 28 15:42:32.563077 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:32.563035    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn"
Jul 28 15:42:32.563420 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:32.563396    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn"
Jul 28 15:42:32.563561 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:32.563450    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn"
Jul 28 15:42:32.568910 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:32.568890    2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn"
Jul 28 15:42:33.445400 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:33.445373    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn"
Jul 28 15:42:33.449855 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:42:33.449820    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn"
Jul 28 15:43:34.611049 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:43:34.611004    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn"]
Jul 28 15:43:34.611592 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:43:34.611277    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn" podUID="b37feca8-b636-4434-b428-9d25e04848b6" containerName="online" containerID="cri-o://8f4ea535594a6d7a8709f15a626f646338c85c3aa8906082596d84db423f7064" gracePeriod=30
Jul 28 15:43:34.611592 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:43:34.611371    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn" podUID="b37feca8-b636-4434-b428-9d25e04848b6" containerName="offline" containerID="cri-o://71106187da86049639c74a95ee6b60ac154ef91282a9d07e9328ea5e3d601aff" gracePeriod=30
Jul 28 15:43:34.611592 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:43:34.611393    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn" podUID="b37feca8-b636-4434-b428-9d25e04848b6" containerName="ui" containerID="cri-o://97ec44d785abe89281f2e5780113669c639912ebd6c53f70f7b391d3a240451b" gracePeriod=30
Jul 28 15:43:34.764568 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:43:34.764537    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46"]
Jul 28 15:43:34.764841 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:43:34.764802    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46" podUID="02c2c611-b60c-415c-867c-25cfbb3772f3" containerName="registry" containerID="cri-o://1947d0897353377e0d75e3d68656bd2f055186e7ab3462dae51c8c7d23f9f0a1" gracePeriod=30
Jul 28 15:43:34.765032 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:43:34.764859    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46" podUID="02c2c611-b60c-415c-867c-25cfbb3772f3" containerName="offline" containerID="cri-o://7d9a1853e73e2d5d7c367e7c1cfe1551fbe7f1a59f0772eb8c465edcae961198" gracePeriod=30
Jul 28 15:43:34.765184 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:43:34.764867    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46" podUID="02c2c611-b60c-415c-867c-25cfbb3772f3" containerName="online" containerID="cri-o://cb3341df54edd497f76ab4a72a739a24b235601065b1bf917af698e1e1cce2b1" gracePeriod=30
Jul 28 15:43:34.765184 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:43:34.764884    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46" podUID="02c2c611-b60c-415c-867c-25cfbb3772f3" containerName="ui" containerID="cri-o://b62ae9372a0369a999f3770b24fb57d126d16997be12043a9091c84ecd3d9b2f" gracePeriod=30
Jul 28 15:43:35.684001 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:43:35.683973    2561 generic.go:356] "Generic (PLEG): container finished" podID="b37feca8-b636-4434-b428-9d25e04848b6" containerID="97ec44d785abe89281f2e5780113669c639912ebd6c53f70f7b391d3a240451b" exitCode=0
Jul 28 15:43:35.684001 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:43:35.683998    2561 generic.go:356] "Generic (PLEG): container finished" podID="b37feca8-b636-4434-b428-9d25e04848b6" containerID="8f4ea535594a6d7a8709f15a626f646338c85c3aa8906082596d84db423f7064" exitCode=0
Jul 28 15:43:35.684515 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:43:35.684048    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn" event={"ID":"b37feca8-b636-4434-b428-9d25e04848b6","Type":"ContainerDied","Data":"97ec44d785abe89281f2e5780113669c639912ebd6c53f70f7b391d3a240451b"}
Jul 28 15:43:35.684515 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:43:35.684099    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn" event={"ID":"b37feca8-b636-4434-b428-9d25e04848b6","Type":"ContainerDied","Data":"8f4ea535594a6d7a8709f15a626f646338c85c3aa8906082596d84db423f7064"}
Jul 28 15:43:35.686853 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:43:35.686812    2561 generic.go:356] "Generic (PLEG): container finished" podID="02c2c611-b60c-415c-867c-25cfbb3772f3" containerID="b62ae9372a0369a999f3770b24fb57d126d16997be12043a9091c84ecd3d9b2f" exitCode=0
Jul 28 15:43:35.686853 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:43:35.686850    2561 generic.go:356] "Generic (PLEG): container finished" podID="02c2c611-b60c-415c-867c-25cfbb3772f3" containerID="cb3341df54edd497f76ab4a72a739a24b235601065b1bf917af698e1e1cce2b1" exitCode=0
Jul 28 15:43:35.687005 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:43:35.686848    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46" event={"ID":"02c2c611-b60c-415c-867c-25cfbb3772f3","Type":"ContainerDied","Data":"b62ae9372a0369a999f3770b24fb57d126d16997be12043a9091c84ecd3d9b2f"}
Jul 28 15:43:35.687005 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:43:35.686884    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46" event={"ID":"02c2c611-b60c-415c-867c-25cfbb3772f3","Type":"ContainerDied","Data":"cb3341df54edd497f76ab4a72a739a24b235601065b1bf917af698e1e1cce2b1"}
Jul 28 15:43:41.052984 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:43:41.052933    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46" podUID="02c2c611-b60c-415c-867c-25cfbb3772f3" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.35:8443: connect: connection refused"
Jul 28 15:43:41.104522 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:43:41.104485    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46" podUID="02c2c611-b60c-415c-867c-25cfbb3772f3" containerName="online" probeResult="failure" output="Get \"https://10.133.0.35:6567/health\": dial tcp 10.133.0.35:6567: connect: connection refused"
Jul 28 15:43:42.563548 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:43:42.563503    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn" podUID="b37feca8-b636-4434-b428-9d25e04848b6" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.36:8443: connect: connection refused"
Jul 28 15:43:43.445730 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:43:43.445695    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn" podUID="b37feca8-b636-4434-b428-9d25e04848b6" containerName="online" probeResult="failure" output="Get \"https://10.133.0.36:6567/health\": dial tcp 10.133.0.36:6567: connect: connection refused"
Jul 28 15:43:51.053179 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:43:51.053078    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46" podUID="02c2c611-b60c-415c-867c-25cfbb3772f3" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.35:8443: connect: connection refused"
Jul 28 15:43:51.104546 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:43:51.104514    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46" podUID="02c2c611-b60c-415c-867c-25cfbb3772f3" containerName="online" probeResult="failure" output="Get \"https://10.133.0.35:6567/health\": dial tcp 10.133.0.35:6567: connect: connection refused"
Jul 28 15:43:52.563879 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:43:52.563814    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn" podUID="b37feca8-b636-4434-b428-9d25e04848b6" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.36:8443: connect: connection refused"
Jul 28 15:43:53.445892 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:43:53.445852    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn" podUID="b37feca8-b636-4434-b428-9d25e04848b6" containerName="online" probeResult="failure" output="Get \"https://10.133.0.36:6567/health\": dial tcp 10.133.0.36:6567: connect: connection refused"
Jul 28 15:44:01.053305 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:01.053256    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46" podUID="02c2c611-b60c-415c-867c-25cfbb3772f3" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.35:8443: connect: connection refused"
Jul 28 15:44:01.053763 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:01.053403    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46"
Jul 28 15:44:01.105064 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:01.105022    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46" podUID="02c2c611-b60c-415c-867c-25cfbb3772f3" containerName="online" probeResult="failure" output="Get \"https://10.133.0.35:6567/health\": dial tcp 10.133.0.35:6567: connect: connection refused"
Jul 28 15:44:01.105244 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:01.105121    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46"
Jul 28 15:44:02.563272 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:02.563227    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn" podUID="b37feca8-b636-4434-b428-9d25e04848b6" containerName="ui" probeResult="failure" output="dial tcp 10.133.0.36:8443: connect: connection refused"
Jul 28 15:44:02.563698 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:02.563359    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn"
Jul 28 15:44:03.446037 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:03.445998    2561 prober.go:120] "Probe failed" probeType="Readiness" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn" podUID="b37feca8-b636-4434-b428-9d25e04848b6" containerName="online" probeResult="failure" output="Get \"https://10.133.0.36:6567/health\": dial tcp 10.133.0.36:6567: connect: connection refused"
Jul 28 15:44:03.446217 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:03.446104    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn"
Jul 28 15:44:04.799263 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:04.799232    2561 generic.go:356] "Generic (PLEG): container finished" podID="b37feca8-b636-4434-b428-9d25e04848b6" containerID="71106187da86049639c74a95ee6b60ac154ef91282a9d07e9328ea5e3d601aff" exitCode=137
Jul 28 15:44:04.799540 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:04.799304    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn" event={"ID":"b37feca8-b636-4434-b428-9d25e04848b6","Type":"ContainerDied","Data":"71106187da86049639c74a95ee6b60ac154ef91282a9d07e9328ea5e3d601aff"}
Jul 28 15:44:05.259698 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.259677    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn"
Jul 28 15:44:05.382561 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.382495    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b37feca8-b636-4434-b428-9d25e04848b6-offline-tls\") pod \"b37feca8-b636-4434-b428-9d25e04848b6\" (UID: \"b37feca8-b636-4434-b428-9d25e04848b6\") "
Jul 28 15:44:05.382561 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.382536    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/b37feca8-b636-4434-b428-9d25e04848b6-registry-tls\") pod \"b37feca8-b636-4434-b428-9d25e04848b6\" (UID: \"b37feca8-b636-4434-b428-9d25e04848b6\") "
Jul 28 15:44:05.382561 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.382557    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b37feca8-b636-4434-b428-9d25e04848b6-feast-data\") pod \"b37feca8-b636-4434-b428-9d25e04848b6\" (UID: \"b37feca8-b636-4434-b428-9d25e04848b6\") "
Jul 28 15:44:05.382819 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.382577    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xnkjd\" (UniqueName: \"kubernetes.io/projected/b37feca8-b636-4434-b428-9d25e04848b6-kube-api-access-xnkjd\") pod \"b37feca8-b636-4434-b428-9d25e04848b6\" (UID: \"b37feca8-b636-4434-b428-9d25e04848b6\") "
Jul 28 15:44:05.382819 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.382652    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b37feca8-b636-4434-b428-9d25e04848b6-online-tls\") pod \"b37feca8-b636-4434-b428-9d25e04848b6\" (UID: \"b37feca8-b636-4434-b428-9d25e04848b6\") "
Jul 28 15:44:05.382819 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.382671    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b37feca8-b636-4434-b428-9d25e04848b6-ui-tls\") pod \"b37feca8-b636-4434-b428-9d25e04848b6\" (UID: \"b37feca8-b636-4434-b428-9d25e04848b6\") "
Jul 28 15:44:05.383018 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.382960    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b37feca8-b636-4434-b428-9d25e04848b6-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b37feca8-b636-4434-b428-9d25e04848b6" (UID: "b37feca8-b636-4434-b428-9d25e04848b6"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 28 15:44:05.383176 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.383142    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b37feca8-b636-4434-b428-9d25e04848b6-feast-data" (OuterVolumeSpecName: "feast-data") pod "b37feca8-b636-4434-b428-9d25e04848b6" (UID: "b37feca8-b636-4434-b428-9d25e04848b6"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 15:44:05.385344 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.385318    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b37feca8-b636-4434-b428-9d25e04848b6-kube-api-access-xnkjd" (OuterVolumeSpecName: "kube-api-access-xnkjd") pod "b37feca8-b636-4434-b428-9d25e04848b6" (UID: "b37feca8-b636-4434-b428-9d25e04848b6"). InnerVolumeSpecName "kube-api-access-xnkjd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 15:44:05.385435 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.385343    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b37feca8-b636-4434-b428-9d25e04848b6-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "b37feca8-b636-4434-b428-9d25e04848b6" (UID: "b37feca8-b636-4434-b428-9d25e04848b6"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 15:44:05.385480 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.385435    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b37feca8-b636-4434-b428-9d25e04848b6-online-tls" (OuterVolumeSpecName: "online-tls") pod "b37feca8-b636-4434-b428-9d25e04848b6" (UID: "b37feca8-b636-4434-b428-9d25e04848b6"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 15:44:05.385480 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.385446    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b37feca8-b636-4434-b428-9d25e04848b6-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "b37feca8-b636-4434-b428-9d25e04848b6" (UID: "b37feca8-b636-4434-b428-9d25e04848b6"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 15:44:05.404427 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.404404    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46"
Jul 28 15:44:05.484122 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.484097    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/02c2c611-b60c-415c-867c-25cfbb3772f3-online-tls\") pod \"02c2c611-b60c-415c-867c-25cfbb3772f3\" (UID: \"02c2c611-b60c-415c-867c-25cfbb3772f3\") "
Jul 28 15:44:05.484268 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.484135    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/02c2c611-b60c-415c-867c-25cfbb3772f3-registry-tls\") pod \"02c2c611-b60c-415c-867c-25cfbb3772f3\" (UID: \"02c2c611-b60c-415c-867c-25cfbb3772f3\") "
Jul 28 15:44:05.484268 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.484170    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/02c2c611-b60c-415c-867c-25cfbb3772f3-ui-tls\") pod \"02c2c611-b60c-415c-867c-25cfbb3772f3\" (UID: \"02c2c611-b60c-415c-867c-25cfbb3772f3\") "
Jul 28 15:44:05.484268 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.484204    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/02c2c611-b60c-415c-867c-25cfbb3772f3-offline-tls\") pod \"02c2c611-b60c-415c-867c-25cfbb3772f3\" (UID: \"02c2c611-b60c-415c-867c-25cfbb3772f3\") "
Jul 28 15:44:05.484268 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.484234    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/02c2c611-b60c-415c-867c-25cfbb3772f3-feast-data\") pod \"02c2c611-b60c-415c-867c-25cfbb3772f3\" (UID: \"02c2c611-b60c-415c-867c-25cfbb3772f3\") "
Jul 28 15:44:05.484268 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.484265    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f62s8\" (UniqueName: \"kubernetes.io/projected/02c2c611-b60c-415c-867c-25cfbb3772f3-kube-api-access-f62s8\") pod \"02c2c611-b60c-415c-867c-25cfbb3772f3\" (UID: \"02c2c611-b60c-415c-867c-25cfbb3772f3\") "
Jul 28 15:44:05.484577 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.484486    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xnkjd\" (UniqueName: \"kubernetes.io/projected/b37feca8-b636-4434-b428-9d25e04848b6-kube-api-access-xnkjd\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:44:05.484577 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.484529    2561 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/b37feca8-b636-4434-b428-9d25e04848b6-online-tls\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:44:05.484577 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.484544    2561 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/b37feca8-b636-4434-b428-9d25e04848b6-ui-tls\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:44:05.484577 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.484556    2561 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/b37feca8-b636-4434-b428-9d25e04848b6-offline-tls\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:44:05.484577 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.484569    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/configmap/b37feca8-b636-4434-b428-9d25e04848b6-registry-tls\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:44:05.484577 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.484580    2561 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/b37feca8-b636-4434-b428-9d25e04848b6-feast-data\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:44:05.485026 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.484979    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02c2c611-b60c-415c-867c-25cfbb3772f3-feast-data" (OuterVolumeSpecName: "feast-data") pod "02c2c611-b60c-415c-867c-25cfbb3772f3" (UID: "02c2c611-b60c-415c-867c-25cfbb3772f3"). InnerVolumeSpecName "feast-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 15:44:05.486414 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.486381    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02c2c611-b60c-415c-867c-25cfbb3772f3-offline-tls" (OuterVolumeSpecName: "offline-tls") pod "02c2c611-b60c-415c-867c-25cfbb3772f3" (UID: "02c2c611-b60c-415c-867c-25cfbb3772f3"). InnerVolumeSpecName "offline-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 15:44:05.486563 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.486544    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02c2c611-b60c-415c-867c-25cfbb3772f3-kube-api-access-f62s8" (OuterVolumeSpecName: "kube-api-access-f62s8") pod "02c2c611-b60c-415c-867c-25cfbb3772f3" (UID: "02c2c611-b60c-415c-867c-25cfbb3772f3"). InnerVolumeSpecName "kube-api-access-f62s8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 15:44:05.486686 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.486667    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02c2c611-b60c-415c-867c-25cfbb3772f3-online-tls" (OuterVolumeSpecName: "online-tls") pod "02c2c611-b60c-415c-867c-25cfbb3772f3" (UID: "02c2c611-b60c-415c-867c-25cfbb3772f3"). InnerVolumeSpecName "online-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 15:44:05.486754 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.486689    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02c2c611-b60c-415c-867c-25cfbb3772f3-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "02c2c611-b60c-415c-867c-25cfbb3772f3" (UID: "02c2c611-b60c-415c-867c-25cfbb3772f3"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 15:44:05.486754 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.486703    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02c2c611-b60c-415c-867c-25cfbb3772f3-ui-tls" (OuterVolumeSpecName: "ui-tls") pod "02c2c611-b60c-415c-867c-25cfbb3772f3" (UID: "02c2c611-b60c-415c-867c-25cfbb3772f3"). InnerVolumeSpecName "ui-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 28 15:44:05.585690 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.585663    2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/secret/02c2c611-b60c-415c-867c-25cfbb3772f3-registry-tls\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:44:05.585690 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.585686    2561 reconciler_common.go:299] "Volume detached for volume \"ui-tls\" (UniqueName: \"kubernetes.io/secret/02c2c611-b60c-415c-867c-25cfbb3772f3-ui-tls\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:44:05.585690 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.585694    2561 reconciler_common.go:299] "Volume detached for volume \"offline-tls\" (UniqueName: \"kubernetes.io/secret/02c2c611-b60c-415c-867c-25cfbb3772f3-offline-tls\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:44:05.585925 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.585701    2561 reconciler_common.go:299] "Volume detached for volume \"feast-data\" (UniqueName: \"kubernetes.io/empty-dir/02c2c611-b60c-415c-867c-25cfbb3772f3-feast-data\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:44:05.585925 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.585710    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f62s8\" (UniqueName: \"kubernetes.io/projected/02c2c611-b60c-415c-867c-25cfbb3772f3-kube-api-access-f62s8\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:44:05.585925 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.585718    2561 reconciler_common.go:299] "Volume detached for volume \"online-tls\" (UniqueName: \"kubernetes.io/secret/02c2c611-b60c-415c-867c-25cfbb3772f3-online-tls\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:44:05.806112 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.806025    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn"
Jul 28 15:44:05.806112 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.806027    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn" event={"ID":"b37feca8-b636-4434-b428-9d25e04848b6","Type":"ContainerDied","Data":"4d906c369ffb98c21a4e294da4b3f26166c9b252c3b87c6234b0194d2c6c275f"}
Jul 28 15:44:05.806112 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.806094    2561 scope.go:117] "RemoveContainer" containerID="97ec44d785abe89281f2e5780113669c639912ebd6c53f70f7b391d3a240451b"
Jul 28 15:44:05.809282 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.809260    2561 generic.go:356] "Generic (PLEG): container finished" podID="02c2c611-b60c-415c-867c-25cfbb3772f3" containerID="7d9a1853e73e2d5d7c367e7c1cfe1551fbe7f1a59f0772eb8c465edcae961198" exitCode=137
Jul 28 15:44:05.809282 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.809280    2561 generic.go:356] "Generic (PLEG): container finished" podID="02c2c611-b60c-415c-867c-25cfbb3772f3" containerID="1947d0897353377e0d75e3d68656bd2f055186e7ab3462dae51c8c7d23f9f0a1" exitCode=137
Jul 28 15:44:05.809412 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.809297    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46" event={"ID":"02c2c611-b60c-415c-867c-25cfbb3772f3","Type":"ContainerDied","Data":"7d9a1853e73e2d5d7c367e7c1cfe1551fbe7f1a59f0772eb8c465edcae961198"}
Jul 28 15:44:05.809412 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.809323    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46" event={"ID":"02c2c611-b60c-415c-867c-25cfbb3772f3","Type":"ContainerDied","Data":"1947d0897353377e0d75e3d68656bd2f055186e7ab3462dae51c8c7d23f9f0a1"}
Jul 28 15:44:05.809412 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.809336    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46" event={"ID":"02c2c611-b60c-415c-867c-25cfbb3772f3","Type":"ContainerDied","Data":"451615443ef12979191703959d2f5e230aa04e1e9485353a792e2036b3ff1273"}
Jul 28 15:44:05.809412 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.809344    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46"
Jul 28 15:44:05.815791 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.815768    2561 scope.go:117] "RemoveContainer" containerID="71106187da86049639c74a95ee6b60ac154ef91282a9d07e9328ea5e3d601aff"
Jul 28 15:44:05.823533 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.823516    2561 scope.go:117] "RemoveContainer" containerID="8f4ea535594a6d7a8709f15a626f646338c85c3aa8906082596d84db423f7064"
Jul 28 15:44:05.830122 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.830099    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn"]
Jul 28 15:44:05.831104 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.831092    2561 scope.go:117] "RemoveContainer" containerID="2321e8babb9a817351ec8d27c89a762457739409209a8982813ad37a86cc6e32"
Jul 28 15:44:05.835528 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.835510    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-remote-registry/feast-simple-feast-remote-setup-db6955c6c-6vhtn"]
Jul 28 15:44:05.838235 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.838219    2561 scope.go:117] "RemoveContainer" containerID="1646bcf7229345ef1a3e6c3c0d6942b21208ed62f572f86b26d66f70b7ab60eb"
Jul 28 15:44:05.845305 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.845287    2561 scope.go:117] "RemoveContainer" containerID="b62ae9372a0369a999f3770b24fb57d126d16997be12043a9091c84ecd3d9b2f"
Jul 28 15:44:05.852574 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.852556    2561 scope.go:117] "RemoveContainer" containerID="7d9a1853e73e2d5d7c367e7c1cfe1551fbe7f1a59f0772eb8c465edcae961198"
Jul 28 15:44:05.854223 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.854205    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46"]
Jul 28 15:44:05.858233 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.858213    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["test-ns-feast/feast-simple-feast-setup-777d6cc998-m7h46"]
Jul 28 15:44:05.859772 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.859756    2561 scope.go:117] "RemoveContainer" containerID="cb3341df54edd497f76ab4a72a739a24b235601065b1bf917af698e1e1cce2b1"
Jul 28 15:44:05.866518 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.866503    2561 scope.go:117] "RemoveContainer" containerID="1947d0897353377e0d75e3d68656bd2f055186e7ab3462dae51c8c7d23f9f0a1"
Jul 28 15:44:05.873075 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.873061    2561 scope.go:117] "RemoveContainer" containerID="2a20ea3588bc06f99ae562fc89ebd077f94c52cdbd5c01b8707f14581cd9afb0"
Jul 28 15:44:05.879379 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.879365    2561 scope.go:117] "RemoveContainer" containerID="4de9ff8e4cd12e7b405eaf6b4d2193d85621b03c580aaa6342a40ba348e90b1d"
Jul 28 15:44:05.885691 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.885676    2561 scope.go:117] "RemoveContainer" containerID="b62ae9372a0369a999f3770b24fb57d126d16997be12043a9091c84ecd3d9b2f"
Jul 28 15:44:05.886025 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:44:05.886003    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b62ae9372a0369a999f3770b24fb57d126d16997be12043a9091c84ecd3d9b2f\": container with ID starting with b62ae9372a0369a999f3770b24fb57d126d16997be12043a9091c84ecd3d9b2f not found: ID does not exist" containerID="b62ae9372a0369a999f3770b24fb57d126d16997be12043a9091c84ecd3d9b2f"
Jul 28 15:44:05.886091 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.886033    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b62ae9372a0369a999f3770b24fb57d126d16997be12043a9091c84ecd3d9b2f"} err="failed to get container status \"b62ae9372a0369a999f3770b24fb57d126d16997be12043a9091c84ecd3d9b2f\": rpc error: code = NotFound desc = could not find container \"b62ae9372a0369a999f3770b24fb57d126d16997be12043a9091c84ecd3d9b2f\": container with ID starting with b62ae9372a0369a999f3770b24fb57d126d16997be12043a9091c84ecd3d9b2f not found: ID does not exist"
Jul 28 15:44:05.886091 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.886051    2561 scope.go:117] "RemoveContainer" containerID="7d9a1853e73e2d5d7c367e7c1cfe1551fbe7f1a59f0772eb8c465edcae961198"
Jul 28 15:44:05.886319 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:44:05.886301    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d9a1853e73e2d5d7c367e7c1cfe1551fbe7f1a59f0772eb8c465edcae961198\": container with ID starting with 7d9a1853e73e2d5d7c367e7c1cfe1551fbe7f1a59f0772eb8c465edcae961198 not found: ID does not exist" containerID="7d9a1853e73e2d5d7c367e7c1cfe1551fbe7f1a59f0772eb8c465edcae961198"
Jul 28 15:44:05.886365 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.886324    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d9a1853e73e2d5d7c367e7c1cfe1551fbe7f1a59f0772eb8c465edcae961198"} err="failed to get container status \"7d9a1853e73e2d5d7c367e7c1cfe1551fbe7f1a59f0772eb8c465edcae961198\": rpc error: code = NotFound desc = could not find container \"7d9a1853e73e2d5d7c367e7c1cfe1551fbe7f1a59f0772eb8c465edcae961198\": container with ID starting with 7d9a1853e73e2d5d7c367e7c1cfe1551fbe7f1a59f0772eb8c465edcae961198 not found: ID does not exist"
Jul 28 15:44:05.886365 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.886340    2561 scope.go:117] "RemoveContainer" containerID="cb3341df54edd497f76ab4a72a739a24b235601065b1bf917af698e1e1cce2b1"
Jul 28 15:44:05.886541 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:44:05.886527    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb3341df54edd497f76ab4a72a739a24b235601065b1bf917af698e1e1cce2b1\": container with ID starting with cb3341df54edd497f76ab4a72a739a24b235601065b1bf917af698e1e1cce2b1 not found: ID does not exist" containerID="cb3341df54edd497f76ab4a72a739a24b235601065b1bf917af698e1e1cce2b1"
Jul 28 15:44:05.886583 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.886545    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb3341df54edd497f76ab4a72a739a24b235601065b1bf917af698e1e1cce2b1"} err="failed to get container status \"cb3341df54edd497f76ab4a72a739a24b235601065b1bf917af698e1e1cce2b1\": rpc error: code = NotFound desc = could not find container \"cb3341df54edd497f76ab4a72a739a24b235601065b1bf917af698e1e1cce2b1\": container with ID starting with cb3341df54edd497f76ab4a72a739a24b235601065b1bf917af698e1e1cce2b1 not found: ID does not exist"
Jul 28 15:44:05.886583 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.886559    2561 scope.go:117] "RemoveContainer" containerID="1947d0897353377e0d75e3d68656bd2f055186e7ab3462dae51c8c7d23f9f0a1"
Jul 28 15:44:05.886784 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:44:05.886768    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1947d0897353377e0d75e3d68656bd2f055186e7ab3462dae51c8c7d23f9f0a1\": container with ID starting with 1947d0897353377e0d75e3d68656bd2f055186e7ab3462dae51c8c7d23f9f0a1 not found: ID does not exist" containerID="1947d0897353377e0d75e3d68656bd2f055186e7ab3462dae51c8c7d23f9f0a1"
Jul 28 15:44:05.886852 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.886801    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1947d0897353377e0d75e3d68656bd2f055186e7ab3462dae51c8c7d23f9f0a1"} err="failed to get container status \"1947d0897353377e0d75e3d68656bd2f055186e7ab3462dae51c8c7d23f9f0a1\": rpc error: code = NotFound desc = could not find container \"1947d0897353377e0d75e3d68656bd2f055186e7ab3462dae51c8c7d23f9f0a1\": container with ID starting with 1947d0897353377e0d75e3d68656bd2f055186e7ab3462dae51c8c7d23f9f0a1 not found: ID does not exist"
Jul 28 15:44:05.886852 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.886814    2561 scope.go:117] "RemoveContainer" containerID="2a20ea3588bc06f99ae562fc89ebd077f94c52cdbd5c01b8707f14581cd9afb0"
Jul 28 15:44:05.887026 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:44:05.887011    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2a20ea3588bc06f99ae562fc89ebd077f94c52cdbd5c01b8707f14581cd9afb0\": container with ID starting with 2a20ea3588bc06f99ae562fc89ebd077f94c52cdbd5c01b8707f14581cd9afb0 not found: ID does not exist" containerID="2a20ea3588bc06f99ae562fc89ebd077f94c52cdbd5c01b8707f14581cd9afb0"
Jul 28 15:44:05.887064 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.887029    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a20ea3588bc06f99ae562fc89ebd077f94c52cdbd5c01b8707f14581cd9afb0"} err="failed to get container status \"2a20ea3588bc06f99ae562fc89ebd077f94c52cdbd5c01b8707f14581cd9afb0\": rpc error: code = NotFound desc = could not find container \"2a20ea3588bc06f99ae562fc89ebd077f94c52cdbd5c01b8707f14581cd9afb0\": container with ID starting with 2a20ea3588bc06f99ae562fc89ebd077f94c52cdbd5c01b8707f14581cd9afb0 not found: ID does not exist"
Jul 28 15:44:05.887064 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.887040    2561 scope.go:117] "RemoveContainer" containerID="4de9ff8e4cd12e7b405eaf6b4d2193d85621b03c580aaa6342a40ba348e90b1d"
Jul 28 15:44:05.887282 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:44:05.887259    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4de9ff8e4cd12e7b405eaf6b4d2193d85621b03c580aaa6342a40ba348e90b1d\": container with ID starting with 4de9ff8e4cd12e7b405eaf6b4d2193d85621b03c580aaa6342a40ba348e90b1d not found: ID does not exist" containerID="4de9ff8e4cd12e7b405eaf6b4d2193d85621b03c580aaa6342a40ba348e90b1d"
Jul 28 15:44:05.887335 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.887290    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4de9ff8e4cd12e7b405eaf6b4d2193d85621b03c580aaa6342a40ba348e90b1d"} err="failed to get container status \"4de9ff8e4cd12e7b405eaf6b4d2193d85621b03c580aaa6342a40ba348e90b1d\": rpc error: code = NotFound desc = could not find container \"4de9ff8e4cd12e7b405eaf6b4d2193d85621b03c580aaa6342a40ba348e90b1d\": container with ID starting with 4de9ff8e4cd12e7b405eaf6b4d2193d85621b03c580aaa6342a40ba348e90b1d not found: ID does not exist"
Jul 28 15:44:05.887335 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.887312    2561 scope.go:117] "RemoveContainer" containerID="b62ae9372a0369a999f3770b24fb57d126d16997be12043a9091c84ecd3d9b2f"
Jul 28 15:44:05.887559 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.887542    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b62ae9372a0369a999f3770b24fb57d126d16997be12043a9091c84ecd3d9b2f"} err="failed to get container status \"b62ae9372a0369a999f3770b24fb57d126d16997be12043a9091c84ecd3d9b2f\": rpc error: code = NotFound desc = could not find container \"b62ae9372a0369a999f3770b24fb57d126d16997be12043a9091c84ecd3d9b2f\": container with ID starting with b62ae9372a0369a999f3770b24fb57d126d16997be12043a9091c84ecd3d9b2f not found: ID does not exist"
Jul 28 15:44:05.887602 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.887559    2561 scope.go:117] "RemoveContainer" containerID="7d9a1853e73e2d5d7c367e7c1cfe1551fbe7f1a59f0772eb8c465edcae961198"
Jul 28 15:44:05.887756 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.887739    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d9a1853e73e2d5d7c367e7c1cfe1551fbe7f1a59f0772eb8c465edcae961198"} err="failed to get container status \"7d9a1853e73e2d5d7c367e7c1cfe1551fbe7f1a59f0772eb8c465edcae961198\": rpc error: code = NotFound desc = could not find container \"7d9a1853e73e2d5d7c367e7c1cfe1551fbe7f1a59f0772eb8c465edcae961198\": container with ID starting with 7d9a1853e73e2d5d7c367e7c1cfe1551fbe7f1a59f0772eb8c465edcae961198 not found: ID does not exist"
Jul 28 15:44:05.887809 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.887756    2561 scope.go:117] "RemoveContainer" containerID="cb3341df54edd497f76ab4a72a739a24b235601065b1bf917af698e1e1cce2b1"
Jul 28 15:44:05.887974 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.887954    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb3341df54edd497f76ab4a72a739a24b235601065b1bf917af698e1e1cce2b1"} err="failed to get container status \"cb3341df54edd497f76ab4a72a739a24b235601065b1bf917af698e1e1cce2b1\": rpc error: code = NotFound desc = could not find container \"cb3341df54edd497f76ab4a72a739a24b235601065b1bf917af698e1e1cce2b1\": container with ID starting with cb3341df54edd497f76ab4a72a739a24b235601065b1bf917af698e1e1cce2b1 not found: ID does not exist"
Jul 28 15:44:05.888024 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.887976    2561 scope.go:117] "RemoveContainer" containerID="1947d0897353377e0d75e3d68656bd2f055186e7ab3462dae51c8c7d23f9f0a1"
Jul 28 15:44:05.888188 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.888163    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1947d0897353377e0d75e3d68656bd2f055186e7ab3462dae51c8c7d23f9f0a1"} err="failed to get container status \"1947d0897353377e0d75e3d68656bd2f055186e7ab3462dae51c8c7d23f9f0a1\": rpc error: code = NotFound desc = could not find container \"1947d0897353377e0d75e3d68656bd2f055186e7ab3462dae51c8c7d23f9f0a1\": container with ID starting with 1947d0897353377e0d75e3d68656bd2f055186e7ab3462dae51c8c7d23f9f0a1 not found: ID does not exist"
Jul 28 15:44:05.888188 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.888187    2561 scope.go:117] "RemoveContainer" containerID="2a20ea3588bc06f99ae562fc89ebd077f94c52cdbd5c01b8707f14581cd9afb0"
Jul 28 15:44:05.888415 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.888398    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2a20ea3588bc06f99ae562fc89ebd077f94c52cdbd5c01b8707f14581cd9afb0"} err="failed to get container status \"2a20ea3588bc06f99ae562fc89ebd077f94c52cdbd5c01b8707f14581cd9afb0\": rpc error: code = NotFound desc = could not find container \"2a20ea3588bc06f99ae562fc89ebd077f94c52cdbd5c01b8707f14581cd9afb0\": container with ID starting with 2a20ea3588bc06f99ae562fc89ebd077f94c52cdbd5c01b8707f14581cd9afb0 not found: ID does not exist"
Jul 28 15:44:05.888465 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.888419    2561 scope.go:117] "RemoveContainer" containerID="4de9ff8e4cd12e7b405eaf6b4d2193d85621b03c580aaa6342a40ba348e90b1d"
Jul 28 15:44:05.888631 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:05.888615    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4de9ff8e4cd12e7b405eaf6b4d2193d85621b03c580aaa6342a40ba348e90b1d"} err="failed to get container status \"4de9ff8e4cd12e7b405eaf6b4d2193d85621b03c580aaa6342a40ba348e90b1d\": rpc error: code = NotFound desc = could not find container \"4de9ff8e4cd12e7b405eaf6b4d2193d85621b03c580aaa6342a40ba348e90b1d\": container with ID starting with 4de9ff8e4cd12e7b405eaf6b4d2193d85621b03c580aaa6342a40ba348e90b1d not found: ID does not exist"
Jul 28 15:44:07.410008 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:07.409975    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02c2c611-b60c-415c-867c-25cfbb3772f3" path="/var/lib/kubelet/pods/02c2c611-b60c-415c-867c-25cfbb3772f3/volumes"
Jul 28 15:44:07.410561 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:07.410547    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b37feca8-b636-4434-b428-9d25e04848b6" path="/var/lib/kubelet/pods/b37feca8-b636-4434-b428-9d25e04848b6/volumes"
Jul 28 15:44:24.057914 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:24.057880    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-lxq4m/must-gather-jh5fv"]
Jul 28 15:44:24.058400 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:24.058144    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b37feca8-b636-4434-b428-9d25e04848b6" containerName="offline"
Jul 28 15:44:24.058400 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:24.058154    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b37feca8-b636-4434-b428-9d25e04848b6" containerName="offline"
Jul 28 15:44:24.058400 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:24.058162    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02c2c611-b60c-415c-867c-25cfbb3772f3" containerName="offline"
Jul 28 15:44:24.058400 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:24.058167    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="02c2c611-b60c-415c-867c-25cfbb3772f3" containerName="offline"
Jul 28 15:44:24.058400 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:24.058174    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02c2c611-b60c-415c-867c-25cfbb3772f3" containerName="feast-apply"
Jul 28 15:44:24.058400 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:24.058180    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="02c2c611-b60c-415c-867c-25cfbb3772f3" containerName="feast-apply"
Jul 28 15:44:24.058400 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:24.058188    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b37feca8-b636-4434-b428-9d25e04848b6" containerName="feast-apply"
Jul 28 15:44:24.058400 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:24.058193    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b37feca8-b636-4434-b428-9d25e04848b6" containerName="feast-apply"
Jul 28 15:44:24.058400 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:24.058202    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02c2c611-b60c-415c-867c-25cfbb3772f3" containerName="ui"
Jul 28 15:44:24.058400 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:24.058207    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="02c2c611-b60c-415c-867c-25cfbb3772f3" containerName="ui"
Jul 28 15:44:24.058400 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:24.058212    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b37feca8-b636-4434-b428-9d25e04848b6" containerName="online"
Jul 28 15:44:24.058400 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:24.058220    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b37feca8-b636-4434-b428-9d25e04848b6" containerName="online"
Jul 28 15:44:24.058400 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:24.058227    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b37feca8-b636-4434-b428-9d25e04848b6" containerName="ui"
Jul 28 15:44:24.058400 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:24.058231    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b37feca8-b636-4434-b428-9d25e04848b6" containerName="ui"
Jul 28 15:44:24.058400 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:24.058237    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02c2c611-b60c-415c-867c-25cfbb3772f3" containerName="feast-init"
Jul 28 15:44:24.058400 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:24.058242    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="02c2c611-b60c-415c-867c-25cfbb3772f3" containerName="feast-init"
Jul 28 15:44:24.058400 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:24.058248    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02c2c611-b60c-415c-867c-25cfbb3772f3" containerName="registry"
Jul 28 15:44:24.058400 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:24.058254    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="02c2c611-b60c-415c-867c-25cfbb3772f3" containerName="registry"
Jul 28 15:44:24.058400 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:24.058260    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02c2c611-b60c-415c-867c-25cfbb3772f3" containerName="online"
Jul 28 15:44:24.058400 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:24.058265    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="02c2c611-b60c-415c-867c-25cfbb3772f3" containerName="online"
Jul 28 15:44:24.058400 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:24.058273    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b37feca8-b636-4434-b428-9d25e04848b6" containerName="feast-init"
Jul 28 15:44:24.058400 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:24.058278    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b37feca8-b636-4434-b428-9d25e04848b6" containerName="feast-init"
Jul 28 15:44:24.058400 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:24.058326    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b37feca8-b636-4434-b428-9d25e04848b6" containerName="ui"
Jul 28 15:44:24.058400 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:24.058333    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="02c2c611-b60c-415c-867c-25cfbb3772f3" containerName="offline"
Jul 28 15:44:24.058400 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:24.058339    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b37feca8-b636-4434-b428-9d25e04848b6" containerName="online"
Jul 28 15:44:24.058400 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:24.058344    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="02c2c611-b60c-415c-867c-25cfbb3772f3" containerName="online"
Jul 28 15:44:24.058400 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:24.058350    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="02c2c611-b60c-415c-867c-25cfbb3772f3" containerName="ui"
Jul 28 15:44:24.058400 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:24.058356    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="02c2c611-b60c-415c-867c-25cfbb3772f3" containerName="registry"
Jul 28 15:44:24.058400 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:24.058362    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b37feca8-b636-4434-b428-9d25e04848b6" containerName="offline"
Jul 28 15:44:24.063358 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:24.063338    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lxq4m/must-gather-jh5fv"
Jul 28 15:44:24.066531 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:24.066512    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lxq4m\"/\"openshift-service-ca.crt\""
Jul 28 15:44:24.066652 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:24.066603    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-lxq4m\"/\"kube-root-ca.crt\""
Jul 28 15:44:24.066781 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:24.066765    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-lxq4m\"/\"default-dockercfg-4tz44\""
Jul 28 15:44:24.070661 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:24.070637    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lxq4m/must-gather-jh5fv"]
Jul 28 15:44:24.238701 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:24.238673    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78sbk\" (UniqueName: \"kubernetes.io/projected/61788cc3-f0d5-4d9e-8234-ff2e5b5b653e-kube-api-access-78sbk\") pod \"must-gather-jh5fv\" (UID: \"61788cc3-f0d5-4d9e-8234-ff2e5b5b653e\") " pod="openshift-must-gather-lxq4m/must-gather-jh5fv"
Jul 28 15:44:24.238701 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:24.238705    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/61788cc3-f0d5-4d9e-8234-ff2e5b5b653e-must-gather-output\") pod \"must-gather-jh5fv\" (UID: \"61788cc3-f0d5-4d9e-8234-ff2e5b5b653e\") " pod="openshift-must-gather-lxq4m/must-gather-jh5fv"
Jul 28 15:44:24.339788 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:24.339759    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78sbk\" (UniqueName: \"kubernetes.io/projected/61788cc3-f0d5-4d9e-8234-ff2e5b5b653e-kube-api-access-78sbk\") pod \"must-gather-jh5fv\" (UID: \"61788cc3-f0d5-4d9e-8234-ff2e5b5b653e\") " pod="openshift-must-gather-lxq4m/must-gather-jh5fv"
Jul 28 15:44:24.339999 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:24.339794    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/61788cc3-f0d5-4d9e-8234-ff2e5b5b653e-must-gather-output\") pod \"must-gather-jh5fv\" (UID: \"61788cc3-f0d5-4d9e-8234-ff2e5b5b653e\") " pod="openshift-must-gather-lxq4m/must-gather-jh5fv"
Jul 28 15:44:24.340121 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:24.340102    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/61788cc3-f0d5-4d9e-8234-ff2e5b5b653e-must-gather-output\") pod \"must-gather-jh5fv\" (UID: \"61788cc3-f0d5-4d9e-8234-ff2e5b5b653e\") " pod="openshift-must-gather-lxq4m/must-gather-jh5fv"
Jul 28 15:44:24.349428 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:24.349405    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-78sbk\" (UniqueName: \"kubernetes.io/projected/61788cc3-f0d5-4d9e-8234-ff2e5b5b653e-kube-api-access-78sbk\") pod \"must-gather-jh5fv\" (UID: \"61788cc3-f0d5-4d9e-8234-ff2e5b5b653e\") " pod="openshift-must-gather-lxq4m/must-gather-jh5fv"
Jul 28 15:44:24.373477 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:24.373451    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lxq4m/must-gather-jh5fv"
Jul 28 15:44:24.501800 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:24.501774    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-lxq4m/must-gather-jh5fv"]
Jul 28 15:44:24.504352 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:44:24.504323    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod61788cc3_f0d5_4d9e_8234_ff2e5b5b653e.slice/crio-2fc2a4d23cf128dd41732c64c0666ad6bde1e25d3879ed487c53c8e8d68bd527 WatchSource:0}: Error finding container 2fc2a4d23cf128dd41732c64c0666ad6bde1e25d3879ed487c53c8e8d68bd527: Status 404 returned error can't find the container with id 2fc2a4d23cf128dd41732c64c0666ad6bde1e25d3879ed487c53c8e8d68bd527
Jul 28 15:44:24.506237 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:24.506221    2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 28 15:44:24.878909 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:24.878873    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lxq4m/must-gather-jh5fv" event={"ID":"61788cc3-f0d5-4d9e-8234-ff2e5b5b653e","Type":"ContainerStarted","Data":"2fc2a4d23cf128dd41732c64c0666ad6bde1e25d3879ed487c53c8e8d68bd527"}
Jul 28 15:44:30.910562 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:30.910526    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lxq4m/must-gather-jh5fv" event={"ID":"61788cc3-f0d5-4d9e-8234-ff2e5b5b653e","Type":"ContainerStarted","Data":"06d2b8344fbc9313b0a09ef8fe9825880871d7a3e2a94c835e6798cd6a83afd2"}
Jul 28 15:44:30.911043 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:30.910573    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lxq4m/must-gather-jh5fv" event={"ID":"61788cc3-f0d5-4d9e-8234-ff2e5b5b653e","Type":"ContainerStarted","Data":"6841ab772bb617e225ece236356e7c11dd6cafb37d3a289d21e437952f492698"}
Jul 28 15:44:31.932131 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:31.932071    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-lxq4m/must-gather-jh5fv" podStartSLOduration=1.7752670720000001 podStartE2EDuration="7.932050044s" totalImagesPullingTime="6.156782972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 15:44:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:44:31.931587297 +0000 UTC m=+1832.981955400" watchObservedRunningTime="2026-07-28 15:44:31.932050044 +0000 UTC m=+1832.982418151"
Jul 28 15:44:40.951241 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:40.951209    2561 generic.go:356] "Generic (PLEG): container finished" podID="61788cc3-f0d5-4d9e-8234-ff2e5b5b653e" containerID="6841ab772bb617e225ece236356e7c11dd6cafb37d3a289d21e437952f492698" exitCode=0
Jul 28 15:44:40.951793 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:40.951259    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-lxq4m/must-gather-jh5fv" event={"ID":"61788cc3-f0d5-4d9e-8234-ff2e5b5b653e","Type":"ContainerDied","Data":"6841ab772bb617e225ece236356e7c11dd6cafb37d3a289d21e437952f492698"}
Jul 28 15:44:40.951793 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:40.951647    2561 scope.go:117] "RemoveContainer" containerID="6841ab772bb617e225ece236356e7c11dd6cafb37d3a289d21e437952f492698"
Jul 28 15:44:41.351404 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:41.351358    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-lxq4m_must-gather-jh5fv_61788cc3-f0d5-4d9e-8234-ff2e5b5b653e/gather/0.log"
Jul 28 15:44:44.260487 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:44.260456    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qpvsz_20741b19-0b49-488f-86cc-c974cd83fe30/global-pull-secret-syncer/0.log"
Jul 28 15:44:44.429032 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:44.428997    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-drg4d_bd8af8c2-2c6b-4dbe-8bcf-e3d908de7bbe/konnectivity-agent/0.log"
Jul 28 15:44:44.524591 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:44.524518    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-125.ec2.internal_15fb43c0c3be2d4b2fc124f01e5795dd/haproxy/0.log"
Jul 28 15:44:46.694133 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:46.694095    2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-lxq4m/must-gather-jh5fv"]
Jul 28 15:44:46.694565 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:46.694274    2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-lxq4m/must-gather-jh5fv" podUID="61788cc3-f0d5-4d9e-8234-ff2e5b5b653e" containerName="copy" containerID="cri-o://06d2b8344fbc9313b0a09ef8fe9825880871d7a3e2a94c835e6798cd6a83afd2" gracePeriod=2
Jul 28 15:44:46.697334 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:44:46.697297    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-jh5fv\" is forbidden: User \"system:node:ip-10-0-143-125.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-lxq4m\": no relationship found between node 'ip-10-0-143-125.ec2.internal' and this object" podUID="61788cc3-f0d5-4d9e-8234-ff2e5b5b653e" pod="openshift-must-gather-lxq4m/must-gather-jh5fv"
Jul 28 15:44:46.698519 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:46.698166    2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-lxq4m/must-gather-jh5fv"]
Jul 28 15:44:46.928259 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:46.928230    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-lxq4m_must-gather-jh5fv_61788cc3-f0d5-4d9e-8234-ff2e5b5b653e/copy/0.log"
Jul 28 15:44:46.930727 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:46.930710    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lxq4m/must-gather-jh5fv"
Jul 28 15:44:46.933412 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:44:46.933387    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-jh5fv\" is forbidden: User \"system:node:ip-10-0-143-125.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-lxq4m\": no relationship found between node 'ip-10-0-143-125.ec2.internal' and this object" podUID="61788cc3-f0d5-4d9e-8234-ff2e5b5b653e" pod="openshift-must-gather-lxq4m/must-gather-jh5fv"
Jul 28 15:44:46.973976 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:46.973908    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-lxq4m_must-gather-jh5fv_61788cc3-f0d5-4d9e-8234-ff2e5b5b653e/copy/0.log"
Jul 28 15:44:46.974317 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:46.974296    2561 generic.go:356] "Generic (PLEG): container finished" podID="61788cc3-f0d5-4d9e-8234-ff2e5b5b653e" containerID="06d2b8344fbc9313b0a09ef8fe9825880871d7a3e2a94c835e6798cd6a83afd2" exitCode=143
Jul 28 15:44:46.974373 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:46.974358    2561 scope.go:117] "RemoveContainer" containerID="06d2b8344fbc9313b0a09ef8fe9825880871d7a3e2a94c835e6798cd6a83afd2"
Jul 28 15:44:46.974409 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:46.974367    2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-lxq4m/must-gather-jh5fv"
Jul 28 15:44:46.976734 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:44:46.976708    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-jh5fv\" is forbidden: User \"system:node:ip-10-0-143-125.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-lxq4m\": no relationship found between node 'ip-10-0-143-125.ec2.internal' and this object" podUID="61788cc3-f0d5-4d9e-8234-ff2e5b5b653e" pod="openshift-must-gather-lxq4m/must-gather-jh5fv"
Jul 28 15:44:46.981837 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:46.981799    2561 scope.go:117] "RemoveContainer" containerID="6841ab772bb617e225ece236356e7c11dd6cafb37d3a289d21e437952f492698"
Jul 28 15:44:46.993648 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:46.993580    2561 scope.go:117] "RemoveContainer" containerID="06d2b8344fbc9313b0a09ef8fe9825880871d7a3e2a94c835e6798cd6a83afd2"
Jul 28 15:44:46.993929 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:44:46.993909    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06d2b8344fbc9313b0a09ef8fe9825880871d7a3e2a94c835e6798cd6a83afd2\": container with ID starting with 06d2b8344fbc9313b0a09ef8fe9825880871d7a3e2a94c835e6798cd6a83afd2 not found: ID does not exist" containerID="06d2b8344fbc9313b0a09ef8fe9825880871d7a3e2a94c835e6798cd6a83afd2"
Jul 28 15:44:46.994010 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:46.993940    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06d2b8344fbc9313b0a09ef8fe9825880871d7a3e2a94c835e6798cd6a83afd2"} err="failed to get container status \"06d2b8344fbc9313b0a09ef8fe9825880871d7a3e2a94c835e6798cd6a83afd2\": rpc error: code = NotFound desc = could not find container \"06d2b8344fbc9313b0a09ef8fe9825880871d7a3e2a94c835e6798cd6a83afd2\": container with ID starting with 06d2b8344fbc9313b0a09ef8fe9825880871d7a3e2a94c835e6798cd6a83afd2 not found: ID does not exist"
Jul 28 15:44:46.994010 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:46.993959    2561 scope.go:117] "RemoveContainer" containerID="6841ab772bb617e225ece236356e7c11dd6cafb37d3a289d21e437952f492698"
Jul 28 15:44:46.994197 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:44:46.994179    2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6841ab772bb617e225ece236356e7c11dd6cafb37d3a289d21e437952f492698\": container with ID starting with 6841ab772bb617e225ece236356e7c11dd6cafb37d3a289d21e437952f492698 not found: ID does not exist" containerID="6841ab772bb617e225ece236356e7c11dd6cafb37d3a289d21e437952f492698"
Jul 28 15:44:46.994263 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:46.994208    2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6841ab772bb617e225ece236356e7c11dd6cafb37d3a289d21e437952f492698"} err="failed to get container status \"6841ab772bb617e225ece236356e7c11dd6cafb37d3a289d21e437952f492698\": rpc error: code = NotFound desc = could not find container \"6841ab772bb617e225ece236356e7c11dd6cafb37d3a289d21e437952f492698\": container with ID starting with 6841ab772bb617e225ece236356e7c11dd6cafb37d3a289d21e437952f492698 not found: ID does not exist"
Jul 28 15:44:47.014644 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:47.014614    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/61788cc3-f0d5-4d9e-8234-ff2e5b5b653e-must-gather-output\") pod \"61788cc3-f0d5-4d9e-8234-ff2e5b5b653e\" (UID: \"61788cc3-f0d5-4d9e-8234-ff2e5b5b653e\") "
Jul 28 15:44:47.014763 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:47.014687    2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-78sbk\" (UniqueName: \"kubernetes.io/projected/61788cc3-f0d5-4d9e-8234-ff2e5b5b653e-kube-api-access-78sbk\") pod \"61788cc3-f0d5-4d9e-8234-ff2e5b5b653e\" (UID: \"61788cc3-f0d5-4d9e-8234-ff2e5b5b653e\") "
Jul 28 15:44:47.014986 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:47.014964    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61788cc3-f0d5-4d9e-8234-ff2e5b5b653e-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "61788cc3-f0d5-4d9e-8234-ff2e5b5b653e" (UID: "61788cc3-f0d5-4d9e-8234-ff2e5b5b653e"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 28 15:44:47.016954 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:47.016927    2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61788cc3-f0d5-4d9e-8234-ff2e5b5b653e-kube-api-access-78sbk" (OuterVolumeSpecName: "kube-api-access-78sbk") pod "61788cc3-f0d5-4d9e-8234-ff2e5b5b653e" (UID: "61788cc3-f0d5-4d9e-8234-ff2e5b5b653e"). InnerVolumeSpecName "kube-api-access-78sbk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 28 15:44:47.115905 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:47.115869    2561 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/61788cc3-f0d5-4d9e-8234-ff2e5b5b653e-must-gather-output\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:44:47.115905 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:47.115900    2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-78sbk\" (UniqueName: \"kubernetes.io/projected/61788cc3-f0d5-4d9e-8234-ff2e5b5b653e-kube-api-access-78sbk\") on node \"ip-10-0-143-125.ec2.internal\" DevicePath \"\""
Jul 28 15:44:47.285509 ip-10-0-143-125 kubenswrapper[2561]: E0728 15:44:47.285481    2561 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-jh5fv\" is forbidden: User \"system:node:ip-10-0-143-125.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-lxq4m\": no relationship found between node 'ip-10-0-143-125.ec2.internal' and this object" podUID="61788cc3-f0d5-4d9e-8234-ff2e5b5b653e" pod="openshift-must-gather-lxq4m/must-gather-jh5fv"
Jul 28 15:44:47.409667 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:47.409634    2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61788cc3-f0d5-4d9e-8234-ff2e5b5b653e" path="/var/lib/kubelet/pods/61788cc3-f0d5-4d9e-8234-ff2e5b5b653e/volumes"
Jul 28 15:44:48.342420 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:48.342381    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-df69h_c5cbe82e-7228-42f0-8706-5faac882b35e/cluster-monitoring-operator/0.log"
Jul 28 15:44:48.368115 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:48.368082    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-9sb6c_7ed1a5bd-c71d-4365-a808-013079e6970e/kube-state-metrics/0.log"
Jul 28 15:44:48.388778 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:48.388727    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-9sb6c_7ed1a5bd-c71d-4365-a808-013079e6970e/kube-rbac-proxy-main/0.log"
Jul 28 15:44:48.412223 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:48.412189    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-9sb6c_7ed1a5bd-c71d-4365-a808-013079e6970e/kube-rbac-proxy-self/0.log"
Jul 28 15:44:48.476151 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:48.476119    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-b7rrf_0113cdef-c44d-4e14-ade3-4b48aa414ae5/monitoring-plugin/0.log"
Jul 28 15:44:48.509977 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:48.509956    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8gtwn_85a13578-ac7e-46b7-92a4-6f23f3fe8901/node-exporter/0.log"
Jul 28 15:44:48.541104 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:48.541081    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8gtwn_85a13578-ac7e-46b7-92a4-6f23f3fe8901/kube-rbac-proxy/0.log"
Jul 28 15:44:48.564813 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:48.564790    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8gtwn_85a13578-ac7e-46b7-92a4-6f23f3fe8901/init-textfile/0.log"
Jul 28 15:44:49.045445 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:49.045422    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-v9kfh_69326ae8-732c-41ee-9feb-0687eaffdb3b/prometheus-operator/0.log"
Jul 28 15:44:49.067049 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:49.067022    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-v9kfh_69326ae8-732c-41ee-9feb-0687eaffdb3b/kube-rbac-proxy/0.log"
Jul 28 15:44:51.447667 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:51.447635    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-44cqd_8fe03823-8140-423f-b3c9-884405f02cc6/download-server/0.log"
Jul 28 15:44:51.469985 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:51.469951    2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-vfwwp/perf-node-gather-daemonset-89wlt"]
Jul 28 15:44:51.470247 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:51.470234    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61788cc3-f0d5-4d9e-8234-ff2e5b5b653e" containerName="gather"
Jul 28 15:44:51.470297 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:51.470249    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="61788cc3-f0d5-4d9e-8234-ff2e5b5b653e" containerName="gather"
Jul 28 15:44:51.470297 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:51.470260    2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61788cc3-f0d5-4d9e-8234-ff2e5b5b653e" containerName="copy"
Jul 28 15:44:51.470297 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:51.470266    2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="61788cc3-f0d5-4d9e-8234-ff2e5b5b653e" containerName="copy"
Jul 28 15:44:51.470384 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:51.470317    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="61788cc3-f0d5-4d9e-8234-ff2e5b5b653e" containerName="gather"
Jul 28 15:44:51.470384 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:51.470325    2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="61788cc3-f0d5-4d9e-8234-ff2e5b5b653e" containerName="copy"
Jul 28 15:44:51.475114 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:51.475092    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vfwwp/perf-node-gather-daemonset-89wlt"
Jul 28 15:44:51.478113 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:51.478093    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vfwwp\"/\"openshift-service-ca.crt\""
Jul 28 15:44:51.478225 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:51.478187    2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-vfwwp\"/\"kube-root-ca.crt\""
Jul 28 15:44:51.479235 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:51.479222    2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-vfwwp\"/\"default-dockercfg-brzkc\""
Jul 28 15:44:51.484985 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:51.484964    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vfwwp/perf-node-gather-daemonset-89wlt"]
Jul 28 15:44:51.548361 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:51.548322    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8d0ec99d-83ca-4c9f-b934-b80f30c671ab-sys\") pod \"perf-node-gather-daemonset-89wlt\" (UID: \"8d0ec99d-83ca-4c9f-b934-b80f30c671ab\") " pod="openshift-must-gather-vfwwp/perf-node-gather-daemonset-89wlt"
Jul 28 15:44:51.548545 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:51.548380    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8d0ec99d-83ca-4c9f-b934-b80f30c671ab-podres\") pod \"perf-node-gather-daemonset-89wlt\" (UID: \"8d0ec99d-83ca-4c9f-b934-b80f30c671ab\") " pod="openshift-must-gather-vfwwp/perf-node-gather-daemonset-89wlt"
Jul 28 15:44:51.548545 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:51.548407    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8d0ec99d-83ca-4c9f-b934-b80f30c671ab-lib-modules\") pod \"perf-node-gather-daemonset-89wlt\" (UID: \"8d0ec99d-83ca-4c9f-b934-b80f30c671ab\") " pod="openshift-must-gather-vfwwp/perf-node-gather-daemonset-89wlt"
Jul 28 15:44:51.548545 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:51.548437    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8d0ec99d-83ca-4c9f-b934-b80f30c671ab-proc\") pod \"perf-node-gather-daemonset-89wlt\" (UID: \"8d0ec99d-83ca-4c9f-b934-b80f30c671ab\") " pod="openshift-must-gather-vfwwp/perf-node-gather-daemonset-89wlt"
Jul 28 15:44:51.548545 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:51.548459    2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5xh2\" (UniqueName: \"kubernetes.io/projected/8d0ec99d-83ca-4c9f-b934-b80f30c671ab-kube-api-access-t5xh2\") pod \"perf-node-gather-daemonset-89wlt\" (UID: \"8d0ec99d-83ca-4c9f-b934-b80f30c671ab\") " pod="openshift-must-gather-vfwwp/perf-node-gather-daemonset-89wlt"
Jul 28 15:44:51.649199 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:51.649165    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5xh2\" (UniqueName: \"kubernetes.io/projected/8d0ec99d-83ca-4c9f-b934-b80f30c671ab-kube-api-access-t5xh2\") pod \"perf-node-gather-daemonset-89wlt\" (UID: \"8d0ec99d-83ca-4c9f-b934-b80f30c671ab\") " pod="openshift-must-gather-vfwwp/perf-node-gather-daemonset-89wlt"
Jul 28 15:44:51.649381 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:51.649216    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8d0ec99d-83ca-4c9f-b934-b80f30c671ab-sys\") pod \"perf-node-gather-daemonset-89wlt\" (UID: \"8d0ec99d-83ca-4c9f-b934-b80f30c671ab\") " pod="openshift-must-gather-vfwwp/perf-node-gather-daemonset-89wlt"
Jul 28 15:44:51.649381 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:51.649267    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8d0ec99d-83ca-4c9f-b934-b80f30c671ab-podres\") pod \"perf-node-gather-daemonset-89wlt\" (UID: \"8d0ec99d-83ca-4c9f-b934-b80f30c671ab\") " pod="openshift-must-gather-vfwwp/perf-node-gather-daemonset-89wlt"
Jul 28 15:44:51.649381 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:51.649292    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8d0ec99d-83ca-4c9f-b934-b80f30c671ab-lib-modules\") pod \"perf-node-gather-daemonset-89wlt\" (UID: \"8d0ec99d-83ca-4c9f-b934-b80f30c671ab\") " pod="openshift-must-gather-vfwwp/perf-node-gather-daemonset-89wlt"
Jul 28 15:44:51.649381 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:51.649329    2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8d0ec99d-83ca-4c9f-b934-b80f30c671ab-proc\") pod \"perf-node-gather-daemonset-89wlt\" (UID: \"8d0ec99d-83ca-4c9f-b934-b80f30c671ab\") " pod="openshift-must-gather-vfwwp/perf-node-gather-daemonset-89wlt"
Jul 28 15:44:51.649568 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:51.649381    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8d0ec99d-83ca-4c9f-b934-b80f30c671ab-sys\") pod \"perf-node-gather-daemonset-89wlt\" (UID: \"8d0ec99d-83ca-4c9f-b934-b80f30c671ab\") " pod="openshift-must-gather-vfwwp/perf-node-gather-daemonset-89wlt"
Jul 28 15:44:51.649568 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:51.649414    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8d0ec99d-83ca-4c9f-b934-b80f30c671ab-proc\") pod \"perf-node-gather-daemonset-89wlt\" (UID: \"8d0ec99d-83ca-4c9f-b934-b80f30c671ab\") " pod="openshift-must-gather-vfwwp/perf-node-gather-daemonset-89wlt"
Jul 28 15:44:51.649568 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:51.649421    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8d0ec99d-83ca-4c9f-b934-b80f30c671ab-podres\") pod \"perf-node-gather-daemonset-89wlt\" (UID: \"8d0ec99d-83ca-4c9f-b934-b80f30c671ab\") " pod="openshift-must-gather-vfwwp/perf-node-gather-daemonset-89wlt"
Jul 28 15:44:51.649568 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:51.649448    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8d0ec99d-83ca-4c9f-b934-b80f30c671ab-lib-modules\") pod \"perf-node-gather-daemonset-89wlt\" (UID: \"8d0ec99d-83ca-4c9f-b934-b80f30c671ab\") " pod="openshift-must-gather-vfwwp/perf-node-gather-daemonset-89wlt"
Jul 28 15:44:51.660623 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:51.660596    2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5xh2\" (UniqueName: \"kubernetes.io/projected/8d0ec99d-83ca-4c9f-b934-b80f30c671ab-kube-api-access-t5xh2\") pod \"perf-node-gather-daemonset-89wlt\" (UID: \"8d0ec99d-83ca-4c9f-b934-b80f30c671ab\") " pod="openshift-must-gather-vfwwp/perf-node-gather-daemonset-89wlt"
Jul 28 15:44:51.785022 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:51.784933    2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-vfwwp/perf-node-gather-daemonset-89wlt"
Jul 28 15:44:51.917048 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:51.916932    2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-vfwwp/perf-node-gather-daemonset-89wlt"]
Jul 28 15:44:51.919627 ip-10-0-143-125 kubenswrapper[2561]: W0728 15:44:51.919599    2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8d0ec99d_83ca_4c9f_b934_b80f30c671ab.slice/crio-17b12df1383c0d6587477a9e4e84a927684de9f9e4d5e8f1a7eb7e45b9b99f40 WatchSource:0}: Error finding container 17b12df1383c0d6587477a9e4e84a927684de9f9e4d5e8f1a7eb7e45b9b99f40: Status 404 returned error can't find the container with id 17b12df1383c0d6587477a9e4e84a927684de9f9e4d5e8f1a7eb7e45b9b99f40
Jul 28 15:44:51.942175 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:51.942156    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-hfwq7_615eb69b-2f19-4483-b1fd-7be078553384/volume-data-source-validator/0.log"
Jul 28 15:44:51.996080 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:51.996044    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vfwwp/perf-node-gather-daemonset-89wlt" event={"ID":"8d0ec99d-83ca-4c9f-b934-b80f30c671ab","Type":"ContainerStarted","Data":"ed0add88c7b4f50f269f5b38531ef3dad0a8a25262f6d52da1e075a3b8fd6d2e"}
Jul 28 15:44:51.996231 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:51.996095    2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-vfwwp/perf-node-gather-daemonset-89wlt" event={"ID":"8d0ec99d-83ca-4c9f-b934-b80f30c671ab","Type":"ContainerStarted","Data":"17b12df1383c0d6587477a9e4e84a927684de9f9e4d5e8f1a7eb7e45b9b99f40"}
Jul 28 15:44:51.996231 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:51.996122    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-vfwwp/perf-node-gather-daemonset-89wlt"
Jul 28 15:44:52.014121 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:52.014071    2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-vfwwp/perf-node-gather-daemonset-89wlt" podStartSLOduration=1.014055828 podStartE2EDuration="1.014055828s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 15:44:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 15:44:52.012207487 +0000 UTC m=+1853.062575587" watchObservedRunningTime="2026-07-28 15:44:52.014055828 +0000 UTC m=+1853.064423932"
Jul 28 15:44:52.701947 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:52.701915    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fdbqx_30319eb2-0e70-4b57-b466-15f119f06c01/dns/0.log"
Jul 28 15:44:52.726380 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:52.726350    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fdbqx_30319eb2-0e70-4b57-b466-15f119f06c01/kube-rbac-proxy/0.log"
Jul 28 15:44:52.815702 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:52.815675    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lv5xt_43c0a413-1cee-48b4-9c69-e7a5429dcc89/dns-node-resolver/0.log"
Jul 28 15:44:53.249320 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:53.249288    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-d85z2_8426ba3a-6768-4cea-aad5-dc6f897b568d/node-ca/0.log"
Jul 28 15:44:53.960034 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:53.960004    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7dc8547f57-57ktc_ec1ccecc-777e-492b-b655-75a18faf1aea/router/0.log"
Jul 28 15:44:54.298553 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:54.298481    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-m7sbs_b76cac71-0442-432d-afc4-c12ef52b534c/serve-healthcheck-canary/0.log"
Jul 28 15:44:54.648421 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:54.648391    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-fzgwv_b173c54c-c79a-4cdd-803b-c0b218c95bda/insights-operator/0.log"
Jul 28 15:44:54.648593 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:54.648433    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-fzgwv_b173c54c-c79a-4cdd-803b-c0b218c95bda/insights-operator/1.log"
Jul 28 15:44:54.740102 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:54.740070    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pr7fd_b90505e5-bf3d-4dfa-b88d-0cd9313b609a/kube-rbac-proxy/0.log"
Jul 28 15:44:54.761020 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:54.760995    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pr7fd_b90505e5-bf3d-4dfa-b88d-0cd9313b609a/exporter/0.log"
Jul 28 15:44:54.781892 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:54.781868    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pr7fd_b90505e5-bf3d-4dfa-b88d-0cd9313b609a/extractor/0.log"
Jul 28 15:44:58.008727 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:58.008697    2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-vfwwp/perf-node-gather-daemonset-89wlt"
Jul 28 15:44:59.776594 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:59.776527    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lrwfs_8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0/kube-multus-additional-cni-plugins/0.log"
Jul 28 15:44:59.796360 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:59.796337    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lrwfs_8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0/egress-router-binary-copy/0.log"
Jul 28 15:44:59.817106 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:59.817087    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lrwfs_8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0/cni-plugins/0.log"
Jul 28 15:44:59.836517 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:59.836495    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lrwfs_8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0/bond-cni-plugin/0.log"
Jul 28 15:44:59.858368 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:59.858345    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lrwfs_8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0/routeoverride-cni/0.log"
Jul 28 15:44:59.880275 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:59.880255    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lrwfs_8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0/whereabouts-cni-bincopy/0.log"
Jul 28 15:44:59.901865 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:44:59.901842    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-lrwfs_8dc3a6a5-45b9-4c21-8347-d6d3dfb9e3c0/whereabouts-cni/0.log"
Jul 28 15:45:00.388605 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:45:00.388577    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mh4nm_6da27f06-fd24-42f1-9bcf-20f6aa3e716d/kube-multus/0.log"
Jul 28 15:45:00.492335 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:45:00.492273    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hvlq9_4159b552-0523-406a-8816-4aef10a5829e/network-metrics-daemon/0.log"
Jul 28 15:45:00.513981 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:45:00.513952    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-hvlq9_4159b552-0523-406a-8816-4aef10a5829e/kube-rbac-proxy/0.log"
Jul 28 15:45:01.704119 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:45:01.704086    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zrkfd_2a40e45d-440d-4f88-8dc9-3047798a5239/ovn-controller/0.log"
Jul 28 15:45:01.720452 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:45:01.720430    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zrkfd_2a40e45d-440d-4f88-8dc9-3047798a5239/ovn-acl-logging/0.log"
Jul 28 15:45:01.744692 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:45:01.744670    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zrkfd_2a40e45d-440d-4f88-8dc9-3047798a5239/kube-rbac-proxy-node/0.log"
Jul 28 15:45:01.766267 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:45:01.766247    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zrkfd_2a40e45d-440d-4f88-8dc9-3047798a5239/kube-rbac-proxy-ovn-metrics/0.log"
Jul 28 15:45:01.787732 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:45:01.787708    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zrkfd_2a40e45d-440d-4f88-8dc9-3047798a5239/northd/0.log"
Jul 28 15:45:01.808782 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:45:01.808761    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zrkfd_2a40e45d-440d-4f88-8dc9-3047798a5239/nbdb/0.log"
Jul 28 15:45:01.829857 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:45:01.829841    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zrkfd_2a40e45d-440d-4f88-8dc9-3047798a5239/sbdb/0.log"
Jul 28 15:45:01.872576 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:45:01.872556    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zrkfd_2a40e45d-440d-4f88-8dc9-3047798a5239/ovnkube-controller/0.log"
Jul 28 15:45:02.793947 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:45:02.793918    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7d88cb55d8-5tz62_8c5d4df8-409b-4317-9654-61b8d19b0b38/check-endpoints/0.log"
Jul 28 15:45:02.841907 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:45:02.841876    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-mds5d_07bf4445-9e9d-45b5-9b36-e6cbd745ec0e/network-check-target-container/0.log"
Jul 28 15:45:03.701522 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:45:03.701492    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-ncczz_c87ad085-d80c-488c-a557-99f708627772/iptables-alerter/0.log"
Jul 28 15:45:04.327209 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:45:04.327182    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-r6ngg_c9a56fb7-e5de-4cd0-930f-0944440df51a/tuned/0.log"
Jul 28 15:45:06.762851 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:45:06.762812    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-5d6c75f84f-bfkmm_a8c7852f-a649-484b-b4e9-b24146452370/service-ca-operator/1.log"
Jul 28 15:45:06.763589 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:45:06.763573    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-5d6c75f84f-bfkmm_a8c7852f-a649-484b-b4e9-b24146452370/service-ca-operator/0.log"
Jul 28 15:45:07.410479 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:45:07.410454    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-8wts9_b6c83382-dbd5-4f3e-a52a-f33a0365e94e/csi-driver/0.log"
Jul 28 15:45:07.436530 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:45:07.436508    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-8wts9_b6c83382-dbd5-4f3e-a52a-f33a0365e94e/csi-node-driver-registrar/0.log"
Jul 28 15:45:07.458463 ip-10-0-143-125 kubenswrapper[2561]: I0728 15:45:07.458444    2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-csi-drivers_aws-ebs-csi-driver-node-8wts9_b6c83382-dbd5-4f3e-a52a-f33a0365e94e/csi-liveness-probe/0.log"